HighDots Forums  

Need help extracting green url's from google results pages

Search Engine Optimization Discussion about SEO/Search Engine Optimization (alt.internet.search-engines)


Discuss Need help extracting green url's from google results pages in the Search Engine Optimization forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Alpha
 
Posts: n/a

Default Need help extracting green url's from google results pages - 12-14-2005 , 08:00 AM






I am looking for a program/way to extract the green urls out of
multiple pages of google results. Anybody know a (non technical idiot
proof) way to do this or maybe a search engine which gives only urls as
its results and accepts various filter operators like google does?.....

thanks..........A


Reply With Quote
  #2  
Old   
Roy Schestowitz
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-14-2005 , 10:17 AM






__/ [Alpha] on Wednesday 14 December 2005 13:00 \__

Quote:
I am looking for a program/way to extract the green urls out of
multiple pages of google results. Anybody know a (non technical idiot
proof) way to do this or maybe a search engine which gives only urls as
its results and accepts various filter operators like google does?.....

thanks..........A
I suggest you have a look at: http://gada.be/

This includes, to some level, results from all the major search engines
and far beyond that. It also returns results as feeds, which are easy to
parse and get the URL's out of. By the way, your phrasing of the problem
was rather poor, so I can't be sure if that's truly what you have been
looking for.

Somebody is already doing similar work, but he assembles the results as
XML objects:

http://www.benhammersley.com/project..._soap_api.html

Hope it helps,

Roy

--
Roy S. Schestowitz | Useless fact: Falsity implies anything
http://Schestowitz.com | SuSE Linux | PGP-Key: 0x74572E8E
3:10pm up 3 days 22:19, 6 users, load average: 0.49, 0.45, 0.38
http://iuron.com - next generation of search paradigms


Reply With Quote
  #3  
Old   
John Bokma
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-14-2005 , 03:25 PM



"Alpha" <newsgroupmailer (AT) hotmail (DOT) com> wrote:

Quote:
I am looking for a program/way to extract the green urls out of
multiple pages of google results.
What's a green url?

--
John Perl SEO tools: http://johnbokma.com/perl/
or have them custom made
Experienced (web) developer: http://castleamber.com/


Reply With Quote
  #4  
Old   
Stacey
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-14-2005 , 04:25 PM



"John Bokma" <john (AT) castleamber (DOT) com> wrote

Quote:
"Alpha" <newsgroupmailer (AT) hotmail (DOT) com> wrote:

I am looking for a program/way to extract the green urls out of
multiple pages of google results.

What's a green url?
The URL's that Google list at the bottom of the snippets are green.

Stacey




Reply With Quote
  #5  
Old   
John Bokma
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-14-2005 , 04:35 PM



"Stacey" <Remove-the-Y-stacey (AT) staceyssimplestuff (DOT) com> wrote:

Quote:
"John Bokma" <john (AT) castleamber (DOT) com> wrote in message
news:Xns972C92AFBE61Ccastleamber (AT) 130 (DOT) 133.1.4...
"Alpha" <newsgroupmailer (AT) hotmail (DOT) com> wrote:

I am looking for a program/way to extract the green urls out of
multiple pages of google results.

What's a green url?

The URL's that Google list at the bottom of the snippets are green.
Aaargh. I thought is was some type of URL (like environment friendly :-D).
Extracting those is a piece of cake: either scrape Google itself (against
the policy of Google), or use the Google API.

I write stuff like that for a living :-)

--
John Perl SEO tools: http://johnbokma.com/perl/
or have them custom made
Experienced (web) developer: http://castleamber.com/


Reply With Quote
  #6  
Old   
Stacey
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-14-2005 , 04:39 PM



"John Bokma" <john (AT) castleamber (DOT) com> wrote

Quote:
"Stacey" <Remove-the-Y-stacey (AT) staceyssimplestuff (DOT) com> wrote:

"John Bokma" <john (AT) castleamber (DOT) com> wrote in message
news:Xns972C92AFBE61Ccastleamber (AT) 130 (DOT) 133.1.4...
"Alpha" <newsgroupmailer (AT) hotmail (DOT) com> wrote:

I am looking for a program/way to extract the green urls out of
multiple pages of google results.

What's a green url?

The URL's that Google list at the bottom of the snippets are green.

Aaargh. I thought is was some type of URL (like environment friendly :-D).
:-) Yep ECO friendly....or mine is. I recycle.

Quote:
Extracting those is a piece of cake: either scrape Google itself (against
the policy of Google), or use the Google API.

I write stuff like that for a living :-)
Yeah, I was thinking this person might want to scrape so I just ignored it.
Can you make the URL's non-green? :-)

Stacey




Reply With Quote
  #7  
Old   
John Bokma
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-14-2005 , 05:20 PM



"Stacey" <stacey (AT) staceyssimplestuff (DOT) com> wrote:

[ green URLs in Google ]
Quote:
Yeah, I was thinking this person might want to scrape so I just
ignored it. Can you make the URL's non-green? :-)
Yes, if you use Firefox you can install something called GreaseMonkey (an
extension), see http://johnbokma.com/greasemonkey-tmp.png (note the monkey
in the right bottom of the window).

I changed some of the green URLs into pink

The other effect is what the script originally does (I added the pink
stuff), and I think it's quite useful, although it has some limitations
(in the script, which I should fix). Another thing I want this script to
do is number each result.

--
John Perl SEO tools: http://johnbokma.com/perl/
or have them custom made
Experienced (web) developer: http://castleamber.com/


Reply With Quote
  #8  
Old   
Stacey
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-14-2005 , 06:33 PM



"John Bokma" <john (AT) castleamber (DOT) com> wrote

Quote:
"Stacey" <stacey (AT) staceyssimplestuff (DOT) com> wrote:

[ green URLs in Google ]
Yeah, I was thinking this person might want to scrape so I just
ignored it. Can you make the URL's non-green? :-)

Yes, if you use Firefox you can install something called GreaseMonkey (an
extension), see http://johnbokma.com/greasemonkey-tmp.png (note the monkey
in the right bottom of the window).

I changed some of the green URLs into pink
Hmm, I have firefox on my other computer...not this one it is the laptop.

Quote:
The other effect is what the script originally does (I added the pink
stuff), and I think it's quite useful, although it has some limitations
(in the script, which I should fix). Another thing I want this script to
do is number each result.
Yeah, that would be helpful. I don't know why they don't put #'s on them. It
would make it so much easier when you are looking at 100 results at a
time.:-) That way it is easier to see that you are #15 instead of counting.
:-)

Stacey




Reply With Quote
  #9  
Old   
davidof
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-15-2005 , 05:29 AM



Stacey wrote:
Quote:
"John Bokma" <john (AT) castleamber (DOT) com> wrote in message

Yeah, I was thinking this person might want to scrape so I just ignored it.
If the OP wants to scrape then Green URLs are class=fl anchor elements
so it is pretty easy but obviously either Roy's ideas above or the
Google API are the way to go.

I wonder why the OP wants to do this?

----------------------
http://www.abcseo.com/


Reply With Quote
  #10  
Old   
Stacey
 
Posts: n/a

Default Re: Need help extracting green url's from google results pages - 12-15-2005 , 06:42 AM



"davidof" <david.george (AT) g-dumpthisbit-mail (DOT) com> wrote

Quote:
Stacey wrote:
"John Bokma" <john (AT) castleamber (DOT) com> wrote in message Yeah, I was thinking
this person might want to scrape so I just ignored it.

If the OP wants to scrape then Green URLs are class=fl anchor elements so
it is pretty easy but obviously either Roy's ideas above or the Google API
are the way to go.

I wonder why the OP wants to do this?
Don't know. I was thinking just listing the snippets without the green URL's
on a site is the plan. In other words using other people's info for content.
:-) And the question would have got info on how to go about doing this also.

Stacey




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.