![]() | |
![]() |
| | Thread Tools | Display Modes |
#1
| |||
| |||
|
|
Their googlebot fetches about 1 page per second from my site, thus making me pay insane amounts for bandwidth. I want to tell someone there to reduce frequency of their vidits, it is outrageous. Crawl-delay has no effect on them. i |
#2
| |||
| |||
|
|
On Sun, 15 Jan 2006 17:48:54 +0000, Roy Schestowitz <newsgroups (AT) schestowitz (DOT) com> wrote: __/ [Ignoramus26433] on Sunday 15 January 2006 17:35 \__ Their googlebot fetches about 1 page per second from my site, thus making me pay insane amounts for bandwidth. I want to tell someone there to reduce frequency of their vidits, it is outrageous. Crawl-delay has no effect on them. i You said this before in this newsgroup. You said that they had been hammering your server. Why don't you call them? Public number is +1 650 253 000 and non-public (formerly so?) is +1 650 330 0100 (Press 5, then 3 to get a person during daytime). I will call them and report my results. i -- |
#3
| |||
| |||
|
|
Ignoramus26433 wrote: On Sun, 15 Jan 2006 17:48:54 +0000, Roy Schestowitz newsgroups (AT) schestowitz (DOT) com> wrote: __/ [Ignoramus26433] on Sunday 15 January 2006 17:35 \__ Their googlebot fetches about 1 page per second from my site, thus making me pay insane amounts for bandwidth. I want to tell someone there to reduce frequency of their vidits, it is outrageous. Crawl-delay has no effect on them. i You said this before in this newsgroup. You said that they had been hammering your server. Why don't you call them? Public number is +1 650 253 000 and non-public (formerly so?) is +1 650 330 0100 (Press 5, then 3 to get a person during daytime). I will call them and report my results. |
|
i -- Maybe try using your robots.txt file to stop them from crawling your entire website, until you can get their attention. |
|
Can I ask how many pages your website has? Also, if you have control over a firewall, check your logs and stop allowing the offending bot. I would bet it's a specific IP from google. |
#4
| |||
| |||
|
|
Roy, I tried to call their nonpublic number, it is busy much of the time. Can you please correct the typo (missing digit) in the public number? Thanks |
![]() |
| Thread Tools | |
| Display Modes | |
| |