HighDots Forums  

Roll your own search engine

Search Engine Optimization Discussion about SEO/Search Engine Optimization (alt.internet.search-engines)


Discuss Roll your own search engine in the Search Engine Optimization forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
gcooke
 
Posts: n/a

Default Roll your own search engine - 12-05-2005 , 10:37 PM






Is anyone here familiar with what might be some good software for a
niche search engine (crawling a subset of the web - say 10 million
pages). So far we've found ASPseek seems dead and apparently has issues
on new linux distros. We're playing wth nutch which is active, but
we're a lamp not a java shop and my developers been struggling with it
for a week or two to get it to really do much (I suspect it's just a
very powerful tool that's poorly documented). Ideally I'd like
something GPL'ed so I can monkey with the code as needed - for example
so I can specify how I define what sites match the niche.

Is there any software out there that might fit the bill?

Thanks in advance.

Reply With Quote
  #2  
Old   
simon-at-masidani
 
Posts: n/a

Default Re: Roll your own search engine - 12-07-2005 , 01:39 PM






There is a web crawler called Larbin which is under the GPL and written
in C++. Just do a google search for larbin.


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.