HighDots Forums  

Re: Google spider overkill

Search Engine Optimization Discussion about SEO/Search Engine Optimization (alt.internet.search-engines)


Discuss Re: Google spider overkill in the Search Engine Optimization forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Foxglove54321
 
Posts: n/a

Default Re: Google spider overkill - 07-04-2003 , 11:26 AM






Quote:
I found these lines in my server log files:

64.68.82.28 - - [02/Jul/2003:16:00:00 +0200] "GET / HTTP/1.0" 200
15473 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.58 - - [02/Jul/2003:16:36:13 +0200] "GET / HTTP/1.0" 200
15473 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.5 - - [02/Jul/2003:17:29:46 +0200] "GET / HTTP/1.0" 200
15502 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.18 - - [02/Jul/2003:17:47:28 +0200] "GET / HTTP/1.0" 200
15502 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"


Four different spiders visited my home page at the same day!
Is this usual?
Yes it is, especially now just after the dance.


--
Alice Woolley
http://www.insidethebubble.co.uk/
Inside the Bubble - autism information


Reply With Quote
  #2  
Old   
no one
 
Posts: n/a

Default Re: Google spider overkill - 07-05-2003 , 01:18 AM






Richard Joseph <usenet (AT) rjsoftware (DOT) com> wrote:
Quote:
On Fri, 04 Jul 2003 15:26:56 GMT, Foxglove54321 wrote:


Four different spiders visited my home page at the same day!
Is this usual?

Yes it is, especially now just after the dance.

Is this last, long dance officially over?
The definition of "Google Dance" has changed apparently. It seems that
the database is constantly in flux these days, so if you define
"dance" as results jumping around, it may never end - nor should you
care.

As far as "new results being rolled in from the last month's crawls"
(what _I_ really care about), that still happens about once a month or
so and lasts only a few days while in process.

--
I.



Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.