HighDots Forums  

Build this engine for me?

Search Engine Optimization Discussion about SEO/Search Engine Optimization (alt.internet.search-engines)


Discuss Build this engine for me? in the Search Engine Optimization forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
massive.entity@googlemail.com
 
Posts: n/a

Default Build this engine for me? - 10-10-2007 , 05:01 PM






Hi,
I want to set up a website with a search engine that allows user to
enter certain criteria and the search engine will search ceretain
specific sites and return the results.
The sites I want to search are free but sometimes requirre a user to
log in.
Am I allowed to take their content and return it to the searcher?
Second question, is there such a thing as a search engine template
that I can adapt to this project or does it have to be built from
scratch?


Reply With Quote
  #2  
Old   
Mike
 
Posts: n/a

Default Re: Build this engine for me? - 10-11-2007 , 07:33 AM







Quote:
The sites I want to search are free but sometimes requirre a user to
log in.
Am I allowed to take their content and return it to the searcher?
No.

Quote:
Second question, is there such a thing as a search engine template
that I can adapt to this project or does it have to be built from
scratch?
Google has the tools for you.






Reply With Quote
  #3  
Old   
mark r
 
Posts: n/a

Default Re: Build this engine for me? - 10-11-2007 , 10:28 AM



On Oct 11, 12:33 pm, "Mike" <m... (AT) nospam (DOT) com> wrote:
Quote:
The sites I want to search are free but sometimes requirre a user to
log in.
Am I allowed to take their content and return it to the searcher?

No.

Second question, is there such a thing as a search engine template
that I can adapt to this project or does it have to be built from
scratch?

Google has the tools for you.
SCRAPE!

mark
www.neue.co.uk



Reply With Quote
  #4  
Old   
massive.entity@googlemail.com
 
Posts: n/a

Default Re: Build this engine for me? - 10-11-2007 , 11:27 AM



So if a site requires you to make an account (even for free) then
login... all their content cannot be searchable to the public?


Reply With Quote
  #5  
Old   
Andrew Heenan
 
Posts: n/a

Default Re: Build this engine for me? - 10-12-2007 , 05:00 AM



<massive.entity (AT) googlemail (DOT) com> wrote

Quote:
So if a site requires you to make an account (even for free) then
login... all their content cannot be searchable to the public?
If an SE spider cannot access your pages, then the SE cannot index them.

Spiders are stopped by the same barriers as people. But they cannot
register - and won't buy registration.

There are ways of making your content available to SEs, but that's up to
you. If you block access to a page, then you block spiders in the 'normal'
routine.
--

Andrew
http://www.seo2seo.com/
http://www.sick-site-syndrome.com/
First things first - but not necessarily in that order.

The video that makes YouTube worthwhile:
Charlie The Unicorn - http://www.youtube.com/watch?v=Q5im0Ssyyus




Reply With Quote
  #6  
Old   
mariol
 
Posts: n/a

Default Re: Build this engine for me? - 10-12-2007 , 05:15 AM



On 10 oct, 17:01, massive.ent... (AT) googlemail (DOT) com wrote:
Quote:
Hi,
I want to set up a website with a search engine that allows user to
enter certain criteria and the search engine will search ceretain
specific sites and return the results.
The sites I want to search are free but sometimes requirre a user to
log in.
Am I allowed to take their content and return it to the searcher?
Second question, is there such a thing as a search engine template
that I can adapt to this project or does it have to be built from
scratch?
A few months ago I found a code that gave me, at last, the possibility
to create an internal site engine powered by Google. I put it on every
one of my sites and it works !. Here is the code:

<form method=get action=http://www.google.com/custom
class="google_form">
<div align="center">
<input class="google_box" type=text name=q maxlength="50"
value="" />
<input name="submit" type="submit" value="Rechercher" />
<input type=hidden name=domains value="http://
www.dicocf.ca" />
<input type=hidden name=sitesearch value="http://
www.dicocf.ca" checked />
<input type=hidden name=meta value="lr=lang_fr" />
</div>
</form>

You could check on one of my site where it is very usefull: http://www.dicocf.ca

Enjoy !



Reply With Quote
  #7  
Old   
Andrew Heenan
 
Posts: n/a

Default Re: Build this engine for me? - 10-12-2007 , 06:17 AM



"mariol" <histoire.du.quebec (AT) gmail (DOT) com> wrote:
Quote:
A few months ago I found a code that gave me, at last, the possibility
to create an internal site engine powered by Google. I put it on every
one of my sites and it works !. Here is the code:
You'd be most unwise to use code from anywhere except Google itself, as it
will break their TOS - especially if it has been altered from the official
code.

It's really not sensible to place on your site - the one you want Google to
index - some code that will upset Google.

Think about it ;o)
--

Andrew
http://www.seo2seo.com/
http://www.sick-site-syndrome.com/
First things first - but not necessarily in that order.

The video that makes YouTube worthwhile:
Charlie The Unicorn - http://www.youtube.com/watch?v=Q5im0Ssyyus




Reply With Quote
  #8  
Old   
massive.entity@googlemail.com
 
Posts: n/a

Default Re: Build this engine for me? - 10-12-2007 , 08:24 AM



OK, what if I have a spider that can access the site via an account
(or number of accts) then i create copy of their data on my server,
which my searchers will access. If possible is this somehow illegal?



On Oct 12, 5:00 am, "Andrew Heenan" <andr... (AT) heenan (DOT) net> wrote:
Quote:
massive.ent... (AT) googlemail (DOT) com> wrote in message

news:1192116446.720590.38480 (AT) o80g2000hse (DOT) googlegroups.com...

So if a site requires you to make an account (even for free) then
login... all their content cannot be searchable to the public?

If an SE spider cannot access your pages, then the SE cannot index them.

Spiders are stopped by the same barriers as people. But they cannot
register - and won't buy registration.

There are ways of making your content available to SEs, but that's up to
you. If you block access to a page, then you block spiders in the 'normal'
routine.
--

Andrewhttp://www.seo2seo.com/http://www.sick-site-syndrome.com/
First things first - but not necessarily in that order.

The video that makes YouTube worthwhile:
Charlie The Unicorn -http://www.youtube.com/watch?v=Q5im0Ssyyus



Reply With Quote
  #9  
Old   
Andrew Heenan
 
Posts: n/a

Default Re: Build this engine for me? - 10-12-2007 , 11:17 AM



<massive.entity (AT) googlemail (DOT) com> wrote...
Quote:
... then i create copy of their data on my server,
...is this somehow illegal?
Not if you have their permission to copy their stuff
But if spiders can reach it, so can people.

Plus the URLs will be pretty useless.

Why would you want to spider stuff people cannot see (as that seems to be
your intention)? All they'll get is deadlinks or a 404 page telling them to
register - which usually puts people off for life.

Unless, of course, you are The New York Times?
--

Andrew
http://www.seo2seo.com/
http://www.sick-site-syndrome.com/
First things first - but not necessarily in that order.

The video that makes YouTube worthwhile:
Charlie The Unicorn - http://www.youtube.com/watch?v=Q5im0Ssyyus




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.