HighDots Forums  

baidu spider and referer spam

Search Engine Optimization Discussion about SEO/Search Engine Optimization (alt.internet.search-engines)


Discuss baidu spider and referer spam in the Search Engine Optimization forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Fritz M
 
Posts: n/a

Default baidu spider and referer spam - 06-05-2005 , 05:31 PM






I just noticed that the Baidu Spider has started putting "findmore.org"
as the referer in their header.

My stats page is Disallowed in robots.txt so referer spam doesn't work,
but I still dislike the idea that these guys are trying it. The spider
is crawling at a reasonable rate (just a couple of hits per hour at the
most), so bandwidth isn't an issue.

Any thoughts on this? Is putting a referer in the spider crawl spammy?
Should I ban these guys from my website?

RFM


Reply With Quote
  #2  
Old   
Koms Bomb
 
Posts: n/a

Default Re: baidu spider and referer spam - 06-06-2005 , 02:57 AM






Quote:
I just noticed that the Baidu Spider has started putting "findmore.org"
as the referer in their header.

My stats page is Disallowed in robots.txt so referer spam doesn't work,
but I still dislike the idea that these guys are trying it. The spider
is crawling at a reasonable rate (just a couple of hits per hour at the
most), so bandwidth isn't an issue.

Any thoughts on this? Is putting a referer in the spider crawl spammy?
Should I ban these guys from my website?
Have no idea on your question.
What I can tell you is baidu is a Chinese search engine. If your don't
expect Chinese visitors to visit your website, maybe you can ban it.




Reply With Quote
  #3  
Old   
Fritz M
 
Posts: n/a

Default Re: baidu spider and referer spam - 06-06-2005 , 02:36 PM



Koms Bomb wrote:

Quote:
Have no idea on your question.
I wasn't quite awake when I posted my original note. It turns out it's
a spoof spider pretending to be the Baidu spider. I've already banned
the IP addresses in question.

RFM



Reply With Quote
  #4  
Old   
davidof
 
Posts: n/a

Default Re: baidu spider and referer spam - 06-07-2005 , 04:34 AM



Fritz M wrote:
Quote:
I just noticed that the Baidu Spider has started putting "findmore.org"
as the referer in their header.
as a rule I ban all referrer spammers


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.