robots.txt

If you want your site indexed by search engines, what use (besides
elimination of a few 404's) is a robots.txt file? I have done several
searches and the only thing I find is the ability to block their access
to any/all portions of a site.
TIA
TK
http://wejuggle2.com
Still Having a Ball

Terry Kimpling <tknospa (AT) wejuggle2 (DOT) com> wrote:

If you want your site indexed by search engines, what use (besides
elimination of a few 404's) is a robots.txt file?

None [1], indexing is the default, you don't need to do anything.

[1] Although some use one just to get the requests for it out of their
server logs.

--
Spartanicus