Re: noindex, follow

Jack wrote in
<cak69k$f80$1 (AT) nemesis (DOT) news.tpi.pl>

What does it mean?

If you mean what does "noindex, follow" mean, and if you found it in the
contents of a robots meta tag on a web page - it means that the page should
not be indexed by the search engine bot but that it should follow the links
to other linked pages, which themselves may have further robots meta
information. You might want to have a look at:
http://www.robotstxt.org/wc/meta-user.html

If you are asking because you are considering using it, I'd suggest the use
of robots.txt as a more reliable method. For more info, see:
http://www.robotstxt.org/wc/norobots.html#method

It's also worth mentioning that any robots instructions are subject to the
bot's preparedness to honour them - if it's essential that the bots don't
index a page, you may want to consider other approaches.

If you don't use a robots.txt file or the robots meta tag, the default is
that the bots will index the page and follow the links - in other words, to
have your site fully spidered, you don't have to do anything about the
bots - indexing everything is their default.

Even if you want the default of "index everything", it may be worth having a
completely empty robots.txt file so that you don't end up with a load of 404
file-not-found messages in your server logs from when the bots request the
file to check it.

--
PeterMcC
If you feel that any of the above is incorrect,
inappropriate or offensive in any way,
please ignore it and accept my apologies.