"Robert Chen" <lorechen (AT) lycos (DOT) com> wrote:
Quote:
Oh,really?
But I found the date changed everyday in one site.And then the google's
date changed,also.What's the meaning?Does the "spider" crawl that site
everyday and then change the result? |
Until a month ago there were two very distinct bots. GoogleBot (a 'deep'
crawler) and FreshBot (which did daily updates).
Some sites were categorized as either being lively enough to be indexed on a
daily basis (like weblogs, and news sites, for example). FreshBot then
visited these sites on an almost-daily basis, and their results in Google
were more up to date. Things have changed this month, however. Now the old
deep crawler is rarely seen, and FreshBot is actually doing the full job.
This is an operational change at Google, although things may change back to
normal again, watch this space.. :-)
Pete