HighDots Forums  

determine if my site can be crawled

Search Engine Optimization Discussion about SEO/Search Engine Optimization (alt.internet.search-engines)


Discuss determine if my site can be crawled in the Search Engine Optimization forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Steven
 
Posts: n/a

Default determine if my site can be crawled - 08-08-2003 , 09:49 AM






Hi,

I am wondering if there are any tools on the net which can check if my
website is spider-friendly. That is it can be crawled by the various search
engine bots and the design site is not preventing them from indexing my
site.

thanks in advance.
Steve.


--
-----------------------------------------------------------------
Holidays in Berchtesgaden, Germany:
http://www.sonnenkoepfl.de
http://unterkunft-berchtesgaden.de
http://pension-berchtesgaden.de



Reply With Quote
  #2  
Old   
Brothermark
 
Posts: n/a

Default Re: determine if my site can be crawled - 08-08-2003 , 11:00 AM






follow guidelines contained within articles at the following site:

www.webworkshop.net

and the spiders will have no problems with your site.



Reply With Quote
  #3  
Old   
ort
 
Posts: n/a

Default Re: determine if my site can be crawled - 08-08-2003 , 01:03 PM



XENU works very well, and is free

http://www.viz.co.nz/exit.php?url=ho.../xenulink.html

Ort



Reply With Quote
  #4  
Old   
Brothermark
 
Posts: n/a

Default Re: determine if my site can be crawled - 08-09-2003 , 07:22 AM




excellent tool
thansk john




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.