Listings just bombed in Yahoo any suggestions?

Hi,

I have a software program that monitors Google, Yahoo and MSN every
hour and tells me how many pages I have listed.

In the last hour my number of pages listed in Yahoo has dropped from 83
to 1. Does anyone have any ideas what may have caused this? I have
always had pretty good SERPs with Yahoo.

Now and again the program does glitch and throw a 0 result. So when it
said 1, I went and checked on Yahoo and sure enough I only have 1 page
listed. I have added 2 new pages today, but I haven't deleted or
renamed any, so I can't understand the sudden drop.

Do I need to keep resubmitting my site to Yahoo? I assumed that once it
was being crawled by the spider that it would return automatically. I
only manually submit a urllist.txt if I have done any major changes.

Any advice would be fabulous.

Thanks, Louise

"Louise.Richardson (AT) shaw (DOT) ca" <Louise.Richardson (AT) shaw (DOT) ca> wrote:

Hi,

I have a software program that monitors Google, Yahoo and MSN every
hour and tells me how many pages I have listed.

My goodness, are you addicted or what? Once a day would sound more then
sufficient.

Does this little miracle use APIs or just hammer each SE?

--
John Perl SEO tools: http://johnbokma.com/perl/
or have them custom made
Experienced (web) developer: http://castleamber.com/

Hi John,

I haven't got the foggiest - I didn't write it. No I am not addicted
(yet). I don't have to look every hour - I just look when I happen to
be processing orders or sorting ot e-mails. It logs the results once an
hour, it is interesting to look at the trends, page numbers do
fluctuate and also to see how long it takes for pages to be listed. It
was created to help me see the status of listings for Google in
particular. But now it seems Google is doing OK, but Yahoo has bombed
on me.

Hi John,

I have my answer to Yahoo - apparently they did the mother of all
updates today and they have had a few problems (to put it mildly). My
pages have magically just all reappeared!

"Louise.Richardson (AT) shaw (DOT) ca" <Louise.Richardson (AT) shaw (DOT) ca> wrote:

Hi John,

I have my answer to Yahoo - apparently they did the mother of all
updates today and they have had a few problems (to put it mildly). My
pages have magically just all reappeared!

I recommend to check how the program does this hourly checking. If it uses
the API it means that an hourly checking might burn at least your Google
daily limit fast. If they don't, your IP might get blocked (Yahoo! seems to
do this). The block is temporarily, but if you just need Yahoo and it's
blocked...

Also, every hour, I have no idea how often the SEs are updated, but
checking once every day still sounds a lot to me.

Finally, if you reply to a message, it's common to quote at least the name
of the author of the previous message, and the part you're replying to.
Quoting is possible with Google Groups, see
<http://groups.google.com/support/bin/answer.py?answer=14213&topic=250>

Also, some people have their software automatically ignore posts coming via
Google just for this reason (not quoting).

--
John Perl SEO tools: http://johnbokma.com/perl/
or have them custom made
Experienced (web) developer: http://castleamber.com/

John Bokma wrote:

"Louise.Richardson (AT) shaw (DOT) ca" <Louise.Richardson (AT) shaw (DOT) ca> wrote:

Hi John,

I have my answer to Yahoo - apparently they did the mother of all
updates today and they have had a few problems (to put it mildly). My
pages have magically just all reappeared!

I recommend to check how the program does this hourly checking. If it uses
the API it means that an hourly checking might burn at least your Google
daily limit fast. If they don't, your IP might get blocked (Yahoo! seems
to do this). The block is temporarily, but if you just need Yahoo and it's
blocked...

It sounds like the software is doing a single site:domain.tld query once per
hour.


--
Brian Wakem
Email: http://homepage.ntlworld.com/b.wakem/myemail.png

Louise.Richardson (AT) shaw (DOT) ca wrote:

I have my answer to Yahoo - apparently they did the mother of all
updates today and they have had a few problems (to put it mildly). My
pages have magically just all reappeared!

Hi Louise,

Do you mind sharing where does the info about Yahoo update (specifically
the scale thereof) come from? I also had my sites magically re-appear
today after getting 1/3 of usual saturation yesterday. Funny thing though:
Yahoo referrals were up 20% yesterday. So, I suspect it was just a glitch
in the reported number of indexed pages rather than actual index or
algo-related problem.

--
Cheers,
Dmitri
See Site Sig Below
-------------------------------------


--
##-----------------------------------------------##
Article posted with Web Developer's USENET Archive
http://www.1-script.com/forums
Web and RSS gateway to your favorite newsgroup -
alt.internet.search-engines - 16245 messages and counting!
##-----------------------------------------------##

On Tue, 18 Oct 2005 13:09:37 GMT, info_at_1-script_dot_com (AT) foo (DOT) com
(www.1-script.com) wrote:

Louise.Richardson (AT) shaw (DOT) ca wrote:

I have my answer to Yahoo - apparently they did the mother of all
updates today and they have had a few problems (to put it mildly). My
pages have magically just all reappeared!

Hi Louise,

Do you mind sharing where does the info about Yahoo update (specifically
the scale thereof) come from? I also had my sites magically re-appear
today after getting 1/3 of usual saturation yesterday. Funny thing though:
Yahoo referrals were up 20% yesterday. So, I suspect it was just a glitch
in the reported number of indexed pages rather than actual index or
algo-related problem.

--
Cheers,
Dmitri
See Site Sig Below
-------------------------------------

I think there is a problem with yahoo.
I just did a search and it came up with this :

Oops!
We ran into a temporary problem while performing your search. Please
try your search again.


hth
plh
Paul



http://www.newsfeeds.com The #1 Newsgroup Service in the World! 120,000+ Newsgroups
----= East and West-Coast Server Farms - Total Privacy via Encryption =----

Brian Wakem <no (AT) email (DOT) com> wrote:

John Bokma wrote:

"Louise.Richardson (AT) shaw (DOT) ca" <Louise.Richardson (AT) shaw (DOT) ca> wrote:

Hi John,

I have my answer to Yahoo - apparently they did the mother of all
updates today and they have had a few problems (to put it mildly).
My pages have magically just all reappeared!

I recommend to check how the program does this hourly checking. If it
uses the API it means that an hourly checking might burn at least
your Google daily limit fast. If they don't, your IP might get
blocked (Yahoo! seems to do this). The block is temporarily, but if
you just need Yahoo and it's blocked...

It sounds like the software is doing a single site:domain.tld query
once per hour.

Which, if there are more then 100 results, needs additional queries.
But even if it are less then 100 results, every hour (!)

--
John Perl SEO tools: http://johnbokma.com/perl/
or have them custom made
Experienced (web) developer: http://castleamber.com/

John Bokma wrote:

Brian Wakem <no (AT) email (DOT) com> wrote:

John Bokma wrote:

"Louise.Richardson (AT) shaw (DOT) ca" <Louise.Richardson (AT) shaw (DOT) ca> wrote:

Hi John,

I have my answer to Yahoo - apparently they did the mother of all
updates today and they have had a few problems (to put it mildly).
My pages have magically just all reappeared!

I recommend to check how the program does this hourly checking. If it
uses the API it means that an hourly checking might burn at least
your Google daily limit fast. If they don't, your IP might get
blocked (Yahoo! seems to do this). The block is temporarily, but if
you just need Yahoo and it's blocked...

It sounds like the software is doing a single site:domain.tld query
once per hour.

Which, if there are more then 100 results, needs additional queries.
But even if it are less then 100 results, every hour (!)

No. All it is doing is telling her how many pages she has listed on each
SE. A single request will do.

$ perl -MLWP::UserAgent -e '$ua=LWP::UserAgent->new(agent=>"Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.1; SV1)")
$res=$ua->get("http://www.google.co.uk/search?q=site%3Ajohnbokma.com");print
"\nGoogle has $1 pages of John Bokma'\''s site listed.\n" if $res->content
=~ m!ofabout <b>([\d,]+)</b>!'

Google has 800 pages of John Bokma's site listed.



--
Brian Wakem
Email: http://homepage.ntlworld.com/b.wakem/myemail.png