crawling :(

i have 3 sites all with PR of 4, one is spidered on an almost daily basis
with the others remaining unspidered for almost 2 months now

anyone know a tip to get the new content indexed?

On Thu, 06 May 2004 13:08:07 +0100, mark | r wrote:

i have 3 sites all with PR of 4, one is spidered on an almost daily basis
with the others remaining unspidered for almost 2 months now

anyone know a tip to get the new content indexed?

1. Make sure your site is crawlable.

a. Test your site in a stick-dumb web browser such as Lynx, to make sure
that Googlebot (which can also be stick-dumb) can navigate it.

2. Get inbound links.

Nothing will get Googlebot to crawl your site faster than inbond links.



--
Will
Webmaster: http://www.internet-search-engines-faq.com

"Will Spencer" <will.spencer (AT) internet-search-engines-faq (DOT) com> wrote in
message
newsan.2004.05.06.13.05.51.634000 (AT) internet-search-engines-faq (DOT) com...

On Thu, 06 May 2004 13:08:07 +0100, mark | r wrote:

i have 3 sites all with PR of 4, one is spidered on an almost daily
basis
with the others remaining unspidered for almost 2 months now

anyone know a tip to get the new content indexed?


1. Make sure your site is crawlable.

a. Test your site in a stick-dumb web browser such as Lynx, to make sure
that Googlebot (which can also be stick-dumb) can navigate it.

2. Get inbound links.

Nothing will get Googlebot to crawl your site faster than inbond links.



--
Will
Webmaster: http://www.internet-search-engines-faq.com

If it helps any, Mark, I am experiencing the same problem.

The only pages being spidered are those with new/recent inbound links.

Todd