Re: Order of meta tags matter?

On Sun, 17 Apr 2005 23:17:28 -0700, Don <no (AT) adr (DOT) com> wrote:

On 17 Apr 2005 11:45:59 -0700, diyseo (AT) rediffmail (DOT) com (Pramod) wrote:
[snip]
2. Hope you have not shut the door on Google in your robots.txt file

[snip]
Thanks for your reply. What do you mean regarding shutting the door on
Google in my robots.txt file. I don't believe I have such a file. Not sure
what you mean.

The person assumed that along with the META robots snippet that you
had a robots.txt file on the site. robots.txt is where you can specify
things like googlebot can index/follow links but the image bot for
Google is not allowed or hint that you don't want googlebot to
index/follow links shared in certain sections of your site.

So "shutting the door on Google in your robots.txt file" was referring
to the person hoping that you had not inadvertantly disallowed
Google's bot from spidering beyond your main page or your site as a
whole.

Carol