HighDots Forums  

google index - site removed

Search Engine Optimization Discussion about SEO/Search Engine Optimization (alt.internet.search-engines)


Discuss google index - site removed in the Search Engine Optimization forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
gamingbusiness@gmail.com
 
Posts: n/a

Default google index - site removed - 09-03-2006 , 08:35 AM






Hi

our site http://officialbettingreview.com was recently removed from
the google index, and I cannot understand why

The only thing that has changed on our site, is new pages ( real pages
with real content )

I dont believe our site is spammy

The only other thing we had done differently was to submit google
sitemaps

I am wondering why they removed the site, can anyone here offer any
insite?

Thanks for any assistance.

Ian


Reply With Quote
  #2  
Old   
Roy Schestowitz
 
Posts: n/a

Default Re: google index - site removed - 09-03-2006 , 08:47 AM






__/ [ gamingbusiness (AT) gmail (DOT) com ] on Sunday 03 September 2006 13:35 \__

Quote:
Hi

our site http://officialbettingreview.com was recently removed from
the google index, and I cannot understand why

The only thing that has changed on our site, is new pages ( real pages
with real content )

I dont believe our site is spammy

The only other thing we had done differently was to submit google
sitemaps

I am wondering why they removed the site, can anyone here offer any
insite?

Thanks for any assistance.

Ian
http://officialbettingreview.com/robots.txt

Seems harmless (assumed all should be crawled)

http://www.google.com/search?sourcei...iew%2Eco m%2F

No pages indexed.

Upon closer inspection, it seems like it's possibly a Google error. I check
saturation across datacentres and get:

www.google.com Not Found Not Found 8 N/A Error
www.google.co.uk Not Found Not Found 8 N/A Error
64.233.161.99 Not Found Not Found 10 N/A 4,810
64.233.167.99 Not Found Not Found 10 N/A Error
64.233.171.99 Not Found Not Found 10 N/A 4,710
64.233.179.99 Not Found Not Found 10 N/A 4,880
64.233.183.99 Not Found Not Found 10 N/A Error
64.233.185.99 Not Found Not Found 10 N/A 4,880
64.233.187.99 Not Found Not Found 8 N/A Error
64.233.189.104 Not Found Not Found 10 N/A Error
66.102.7.99 Not Found Not Found 10 N/A Error
66.102.9.99 Not Found Not Found 10 N/A Error
66.102.11.99 Not Found Not Found 10 N/A Error

If you used to have ~5,000 pages indexed, the perhaps a glitch is involved.
Unless, of course, there was banishment by principle. I haven't looked at
your Web site properly, but if you can think about something rival would
whine about.......

Best wishes,

Roy

--
Unisys: open source software set to have a similar impact as the Internet
http://Schestowitz.com | Open Prospects ¦ PGP-Key: 0x74572E8E
Tasks: 131 total, 1 running, 129 sleeping, 0 stopped, 1 zombie
http://iuron.com - knowledge engine, not a search engine


Reply With Quote
  #3  
Old   
Jezsta Web Productions
 
Posts: n/a

Default Re: google index - site removed - 09-03-2006 , 08:50 AM



<gamingbusiness (AT) gmail (DOT) com> wrote

Quote:
Hi

our site http://officialbettingreview.com was recently removed from
the google index, and I cannot understand why
Yep seems to be removed. How about those sites you link to? Loads of
gambling sites do spam you know and you have to what out who you link to
also.

Stacey

--
Crafts - Directory - Your Online Crafting Source
http://www.ecraftsonline.net/
A New Focus In Web Marketing - Search Engine Optimization
http://jezsta.com




Reply With Quote
  #4  
Old   
gamingbusiness@gmail.com
 
Posts: n/a

Default Re: google index - site removed - 09-06-2006 , 06:29 AM



Thanks for the input Roy,

hard to say, I know the only thing we did was submit a sitemap

Then after 2 days the section on sitemaps said our site was removed
from the index

Perhaps foul play from a competitor, there are many "sleazy" operators
in this business, which was originally what created the need for our
site.

What is even stranger is the fact that google now says:

Pages from your site are included in Google's index. See Index stats.
[?]
Googlebot last successfully accessed your home page on Sep 2, 2006 .
You have submitted 1 Sitemaps. You have no Sitemap errors.

Yet I cannot find one page in the index

:S

Wish I knew what was going on

Ian


Roy Schestowitz wrote:
Quote:
__/ [ gamingbusiness (AT) gmail (DOT) com ] on Sunday 03 September 2006 13:35 \__

Hi

our site http://officialbettingreview.com was recently removed from
the google index, and I cannot understand why

The only thing that has changed on our site, is new pages ( real pages
with real content )

I dont believe our site is spammy

The only other thing we had done differently was to submit google
sitemaps

I am wondering why they removed the site, can anyone here offer any
insite?

Thanks for any assistance.

Ian

http://officialbettingreview.com/robots.txt

Seems harmless (assumed all should be crawled)

http://www.google.com/search?sourcei...iew%2Eco m%2F

No pages indexed.

Upon closer inspection, it seems like it's possibly a Google error. I check
saturation across datacentres and get:

www.google.com Not Found Not Found 8 N/A Error
www.google.co.uk Not Found Not Found 8 N/A Error
64.233.161.99 Not Found Not Found 10 N/A 4,810
64.233.167.99 Not Found Not Found 10 N/A Error
64.233.171.99 Not Found Not Found 10 N/A 4,710
64.233.179.99 Not Found Not Found 10 N/A 4,880
64.233.183.99 Not Found Not Found 10 N/A Error
64.233.185.99 Not Found Not Found 10 N/A 4,880
64.233.187.99 Not Found Not Found 8 N/A Error
64.233.189.104 Not Found Not Found 10 N/A Error
66.102.7.99 Not Found Not Found 10 N/A Error
66.102.9.99 Not Found Not Found 10 N/A Error
66.102.11.99 Not Found Not Found 10 N/A Error

If you used to have ~5,000 pages indexed, the perhaps a glitch is involved.
Unless, of course, there was banishment by principle. I haven't looked at
your Web site properly, but if you can think about something rival would
whine about.......

Best wishes,

Roy

--
Unisys: open source software set to have a similar impact as the Internet
http://Schestowitz.com | Open Prospects ¦ PGP-Key: 0x74572E8E
Tasks: 131 total, 1 running, 129 sleeping, 0 stopped, 1 zombie
http://iuron.com - knowledge engine, not a search engine


Reply With Quote
  #5  
Old   
Roy Schestowitz
 
Posts: n/a

Default Re: google index - site removed - 09-06-2006 , 06:49 AM



__/ [ gamingbusiness (AT) gmail (DOT) com ] on Wednesday 06 September 2006 11:29 \__

Quote:
Roy Schestowitz wrote:
__/ [ gamingbusiness (AT) gmail (DOT) com ] on Sunday 03 September 2006 13:35 \__

Hi

our site http://officialbettingreview.com was recently removed from
the google index, and I cannot understand why

The only thing that has changed on our site, is new pages ( real pages
with real content )

I dont believe our site is spammy

The only other thing we had done differently was to submit google
sitemaps

I am wondering why they removed the site, can anyone here offer any
insite?

Thanks for any assistance.

Ian

http://officialbettingreview.com/robots.txt

Seems harmless (assumed all should be crawled)


http://www.google.com/search?sourcei...iew%2Eco m%2F

No pages indexed.

Upon closer inspection, it seems like it's possibly a Google error. I
check saturation across datacentres and get:

www.google.com Not Found Not Found 8 N/A Error
www.google.co.uk Not Found Not Found 8 N/A
Error
64.233.161.99 Not Found Not Found 10 N/A 4,810
64.233.167.99 Not Found Not Found 10 N/A Error
64.233.171.99 Not Found Not Found 10 N/A 4,710
64.233.179.99 Not Found Not Found 10 N/A 4,880
64.233.183.99 Not Found Not Found 10 N/A Error
64.233.185.99 Not Found Not Found 10 N/A 4,880
64.233.187.99 Not Found Not Found 8 N/A Error
64.233.189.104 Not Found Not Found 10 N/A Error
66.102.7.99 Not Found Not Found 10 N/A Error
66.102.9.99 Not Found Not Found 10 N/A Error
66.102.11.99 Not Found Not Found 10 N/A Error

If you used to have ~5,000 pages indexed, the perhaps a glitch is
involved. Unless, of course, there was banishment by principle. I haven't
looked at your Web site properly, but if you can think about something
rival would whine about.......

Thanks for the input Roy,

hard to say, I know the only thing we did was submit a sitemap

Then after 2 days the section on sitemaps said our site was removed
from the index

Perhaps foul play from a competitor, there are many "sleazy" operators
in this business, which was originally what created the need for our
site.

What is even stranger is the fact that google now says:

Pages from your site are included in Google's index. See Index stats.
[?]
Googlebot last successfully accessed your home page on Sep 2, 2006 .
You have submitted 1 Sitemaps. You have no Sitemap errors.

Yet I cannot find one page in the index

:S

Wish I knew what was going on
Hi Ian,

I am assuming the sitemap you submitted was by no means void. Before you
replied, I had thought that I should point out that bad a site map, much
like bad robots.txt file, can have a seriously bad effect. I have randomly
selected 2 links from your front page to see if the neighbouring sites are
banned. Be aware that gambling sites are some of the nastiest, vilest things
that exist on the Web. I must have erased and blocked tens of thousands of
spam comments attempts from blackhat gambling sites that use hijacked
Windows PC's (zombies) to unleash their damage. And then there's E-mail
spam, as well.

Anyway, I couldn't quite find a 'bad neighbour', but I suggest that you check
if the submission of a sitemap intersected with the ban merely by
coincidence. You might also wish to try filing a reinclusion request and see
if you get reincluded, or at least receive an explanation.

http://www.mattcutts.com/blog/reincl...request-howto/

Best wishes,

Roy

--
Tux is sexy <
http://bbspot.com/Images/News_Featur...hilton_tux.jpg >
http://Schestowitz.com | GNU is Not UNIX | PGP-Key: 0x74572E8E
roy pts/3 cg001a.halls.man Tue Sep 5 19:06 still logged in
http://iuron.com - proposing a non-profit search engine


Reply With Quote
  #6  
Old   
Jez
 
Posts: n/a

Default Re: google index - site removed - 09-06-2006 , 07:10 AM





gamingbusiness (AT) gmail (DOT) com wrote:
Quote:
Hi

our site http://officialbettingreview.com was recently removed from
the google index, and I cannot understand why

The only thing that has changed on our site, is new pages ( real pages
with real content )

I dont believe our site is spammy

The only other thing we had done differently was to submit google
sitemaps

I am wondering why they removed the site, can anyone here offer any
insite?

Thanks for any assistance.

Ian

Hi Ian,

I think that google is "losing" data again. My index page is no longer
present on the UK only DC and a couple of internal index pages also are
AWOL.

I notice also that a site that hosts a blog of mine have also suffered
immensely with this. All proportion of their own site and loads of the
blogs they host have just disappeared totally, mine included. Not
cached, it's like they never existed. PR still remains though.

I just hope that they all return soon.

Has anyone else seen anything like this?

Jez.


Reply With Quote
  #7  
Old   
Phil Payne
 
Posts: n/a

Default Re: google index - site removed - 09-06-2006 , 07:13 AM



Quote:
I am wondering why they removed the site, can anyone here offer any
insite?
Fix the doctype - it's recently been causing odd Googlebot behaviour.

http://validator.w3.org/check?uri=ht...eview.com%2 F

That lists 241 errors - it's nothing like that many really, it's
actually mainly a doctype mismatch.

Does the sitemap console list any crawling errors?

It's also dog-slow to load, BTW, even at 4Mb/s.



Reply With Quote
  #8  
Old   
Roy Schestowitz
 
Posts: n/a

Default Re: google index - site removed - 09-06-2006 , 07:29 AM



__/ [ Jez ] on Wednesday 06 September 2006 12:10 \__

Quote:
gamingbusiness (AT) gmail (DOT) com wrote:
Hi

our site http://officialbettingreview.com was recently removed from
the google index, and I cannot understand why

The only thing that has changed on our site, is new pages ( real pages
with real content )

I dont believe our site is spammy

The only other thing we had done differently was to submit google
sitemaps

I am wondering why they removed the site, can anyone here offer any
insite?

Thanks for any assistance.

Ian


Hi Ian,

I think that google is "losing" data again. My index page is no longer
present on the UK only DC and a couple of internal index pages also are
AWOL.

Really? I am glad you said this (patience... read on) because I suspect that
another wave of page dropping has begun recently. From about 1000 (text
search, Google) referrals a day and all of my pages indexed, I have now just
about 200 a day. This began happening 1-2 weeks ago. Pages are dropped and
the traffic continues to decline, accordingly.

Meanwhile, Tonnie and I have been in touch with Matt Cutts several times, in
order to report hundreds or thousands of spam content Web sites with tens of
thousands of pages in each. Some of them relied on typos for traffic and
probably depended on AdSense for revenue. But this catchup chase was
hopeless (Tonnie did all the work, bless him!). Lenient registrars meant
that such sites just kept emerging faster than Tonnie could catch them. And
the lists grew longer and longer...


Quote:
I notice also that a site that hosts a blog of mine have also suffered
immensely with this. All proportion of their own site and loads of the
blogs they host have just disappeared totally, mine included. Not
cached, it's like they never existed. PR still remains though.

I just hope that they all return soon.

Has anyone else seen anything like this?

Jez, please keep me/us informed about this. *smile* It's probably worth a
separate thread altogether.

Ian, the degradation and depletion of indices appears to be gradual. This was
the same back in March when 6 billion subsites had many innocent Webmasters
victimised. So if your pages just vanished overnight, the explanation might
be different. Also, the fact that your front page does not exist rules this
out as a probable cause.

Best wishes,

Roy

--
Can Mac OS X and Vista catch up? http://www.youtube.com/watch?v=wYjv0S_k0xo
http://Schestowitz.com | SuSE Linux | PGP-Key: 0x74572E8E
12:20pm up 48 days 0:32, 8 users, load average: 0.27, 0.50, 0.53
http://iuron.com - Open Source knowledge engine project


Reply With Quote
  #9  
Old   
Jez
 
Posts: n/a

Default Re: google index - site removed - 09-06-2006 , 07:44 AM





Roy Schestowitz wrote:
Quote:
__/ [ Jez ] on Wednesday 06 September 2006 12:10 \__




Has anyone else seen anything like this?



Jez, please keep me/us informed about this. *smile* It's probably worth a
separate thread altogether.

Roy, the blog site I refer to is upsaid.com, take a peek yourself. I
have written to the webmaster there and also left a message on their
forum, but no one has got back in touch with me. If you do a site:upsaid
search you can see how many pages are remaining in the cache but visit
all of the main pages and most of the blogs and you will find no trace
of them.

Jez.


Reply With Quote
  #10  
Old   
gamingbusiness@gmail.com
 
Posts: n/a

Default Re: google index - site removed - 09-09-2006 , 11:30 AM



Hi Roy,

The site is definitely blocked/excluded. It says so in my sitemaps
console

There were no errors in the crawl stats

I submitted a reinclusion request explaining we had done nothing new,
other than to sumit the site map.

I read somewhere the problem might be our phpbb forum, as it has many
thousands of pages and google may view it as spam, so I put a
robots.txt file there to exlude the forums, and advised them of this in
my reinclusion request, but to day

not reincluded, nor received a response.

IMHO google has gotten to big for their own good.

They ignore web content providers which are the life blood of the
internet apart from the surfers themselves, and frankly I am at a point
where if they cannot show the common decency to provide responses, I
will work with other engines and encourage anyone an everyone I come
into contact with to do the same. It seems in todays day and age that
is the only way to remind a company of where they came from.

Our results are great on Yahoo & MSN so we will turn our focus there
and have our own little google boycott.






Roy Schestowitz wrote:
Quote:
__/ [ gamingbusiness (AT) gmail (DOT) com ] on Wednesday 06 September 2006 11:29 \__

Roy Schestowitz wrote:
__/ [ gamingbusiness (AT) gmail (DOT) com ] on Sunday 03 September 2006 13:35 \__

Hi

our site http://officialbettingreview.com was recently removed from
the google index, and I cannot understand why

The only thing that has changed on our site, is new pages ( real pages
with real content )

I dont believe our site is spammy

The only other thing we had done differently was to submit google
sitemaps

I am wondering why they removed the site, can anyone here offer any
insite?

Thanks for any assistance.

Ian

http://officialbettingreview.com/robots.txt

Seems harmless (assumed all should be crawled)


http://www.google.com/search?sourcei...iew%2Eco m%2F

No pages indexed.

Upon closer inspection, it seems like it's possibly a Google error. I
check saturation across datacentres and get:

www.google.com Not Found Not Found 8 N/A Error
www.google.co.uk Not Found Not Found 8 N/A
Error
64.233.161.99 Not Found Not Found 10 N/A 4,810
64.233.167.99 Not Found Not Found 10 N/A Error
64.233.171.99 Not Found Not Found 10 N/A 4,710
64.233.179.99 Not Found Not Found 10 N/A 4,880
64.233.183.99 Not Found Not Found 10 N/A Error
64.233.185.99 Not Found Not Found 10 N/A 4,880
64.233.187.99 Not Found Not Found 8 N/A Error
64.233.189.104 Not Found Not Found 10 N/A Error
66.102.7.99 Not Found Not Found 10 N/A Error
66.102.9.99 Not Found Not Found 10 N/A Error
66.102.11.99 Not Found Not Found 10 N/A Error

If you used to have ~5,000 pages indexed, the perhaps a glitch is
involved. Unless, of course, there was banishment by principle. I haven't
looked at your Web site properly, but if you can think about something
rival would whine about.......

Thanks for the input Roy,

hard to say, I know the only thing we did was submit a sitemap

Then after 2 days the section on sitemaps said our site was removed
from the index

Perhaps foul play from a competitor, there are many "sleazy" operators
in this business, which was originally what created the need for our
site.

What is even stranger is the fact that google now says:

Pages from your site are included in Google's index. See Index stats.
[?]
Googlebot last successfully accessed your home page on Sep 2, 2006 .
You have submitted 1 Sitemaps. You have no Sitemap errors.

Yet I cannot find one page in the index

:S

Wish I knew what was going on

Hi Ian,

I am assuming the sitemap you submitted was by no means void. Before you
replied, I had thought that I should point out that bad a site map, much
like bad robots.txt file, can have a seriously bad effect. I have randomly
selected 2 links from your front page to see if the neighbouring sites are
banned. Be aware that gambling sites are some of the nastiest, vilest things
that exist on the Web. I must have erased and blocked tens of thousands of
spam comments attempts from blackhat gambling sites that use hijacked
Windows PC's (zombies) to unleash their damage. And then there's E-mail
spam, as well.

Anyway, I couldn't quite find a 'bad neighbour', but I suggest that you check
if the submission of a sitemap intersected with the ban merely by
coincidence. You might also wish to try filing a reinclusion request and see
if you get reincluded, or at least receive an explanation.

http://www.mattcutts.com/blog/reincl...request-howto/

Best wishes,

Roy

--
Tux is sexy
http://bbspot.com/Images/News_Featur...hilton_tux.jpg
http://Schestowitz.com | GNU is Not UNIX | PGP-Key: 0x74572E8E
roy pts/3 cg001a.halls.man Tue Sep 5 19:06 still logged in
http://iuron.com - proposing a non-profit search engine


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.