HighDots Forums  

Web Scraping

Ruby On Rails Talk Ruby On Rails programming language mailing list


Discuss Web Scraping in the Ruby On Rails Talk forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Smit Shah
 
Posts: n/a

Default Web Scraping - 11-05-2009 , 01:34 AM






Hi all...

I want to implement the scraping for my rails application.

Any idea???

Thanks...
--
Posted via http://www.ruby-forum.com/.

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group.
To post to this group, send email to rubyonrails-talk (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe (AT) googlegroups (DOT) com
For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply With Quote
  #2  
Old   
Todd A. Jacobs
 
Posts: n/a

Default Re: Web Scraping - 11-05-2009 , 01:43 AM






On Thu, Nov 05, 2009 at 07:34:30AM +0100, Smit Shah wrote:

Quote:
I want to implement the scraping for my rails application.
Rails has nothing to do with scraping, except insofar as it's serving up
web pages. You should look at the WWW::Mechanize library instead.

--
"Oh, look: rocks!"
-- Doctor Who, "Destiny of the Daleks"


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group.
To post to this group, send email to rubyonrails-talk (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe (AT) googlegroups (DOT) com
For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply With Quote
  #3  
Old   
nas
 
Posts: n/a

Default Re: Web Scraping - 11-05-2009 , 02:23 AM



Have a look at ScrAPI. It uses css selectors for scraping and is quite
simple to use.

Ryan Bates has done a screencast as well
http://railscasts.com/episodes/173-screen-scraping-with-scrapi

On Nov 5, 6:34*am, Smit Shah <rails-mailing-l... (AT) andreas-s (DOT) net> wrote:
Quote:
Hi all...

I want to implement the scraping for my rails application.

Any idea???

Thanks...
--
Posted viahttp://www.ruby-forum.com/.
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group.
To post to this group, send email to rubyonrails-talk (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe (AT) googlegroups (DOT) com
For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply With Quote
  #4  
Old   
Smit Shah
 
Posts: n/a

Default Re: Web Scraping - 11-05-2009 , 05:32 AM



nas wrote:
Quote:
Have a look at ScrAPI. It uses css selectors for scraping and is quite
simple to use.

Ryan Bates has done a screencast as well
http://railscasts.com/episodes/173-screen-scraping-with-scrapi
Thanks for your reply..

I have seen that episode. But what if site have made change in css?
If it will change than I am no longer able to get the data...

Any dynamic solution?
--
Posted via http://www.ruby-forum.com/.

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group.
To post to this group, send email to rubyonrails-talk (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe (AT) googlegroups (DOT) com
For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.