HighDots Forums  

google bot problem

alt.discuss.html alt.discuss.html


Discuss google bot problem in the alt.discuss.html forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
exxos
 
Posts: n/a

Default google bot problem - 04-04-2004 , 04:23 PM






hi all,

how can i stop the google bot from leeching all the frames on my site ? its
a good thing to have the main frame in the index of the homepage, but when
it leeches everyframe its a bit daft.

thanks
chris



Reply With Quote
  #2  
Old   
Steve Sundberg
 
Posts: n/a

Default Re: google bot problem - 04-05-2004 , 03:48 AM






On Sun, 4 Apr 2004 21:23:13 +0100, "exxos" <exxos (AT) home (DOT) co.uk> wrote:

Quote:
hi all,

how can i stop the google bot from leeching all the frames on my site ? its
a good thing to have the main frame in the index of the homepage, but when
it leeches everyframe its a bit daft.
Place a robots.txt file in your site directory that prevents Google,
and other search bots, from sniffing out the pages.

That, or stop using frames. I'm surprised people still use them.




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.