Allow robot access to protected content -
06-07-2006
, 02:55 PM
Anyone know how to allow Google's robots to index protected content?
My company has a site that requires a subscription to access the info,
but we'd like to have google index those pages. I see there are many
sites who've managed this.
I can't allow by user-agent since my authentication software doesn't
allow that. Is there any way to give Google a username and password? Or
is there an IP, or range of IPs, that google uses?
Thanks. |