 | |
Site map used so google will index all pages
Search Engine Optimization Discussion about SEO/Search Engine Optimization (alt.internet.search-engines)
 |
| | Thread Tools | Display Modes |
#1
 
| |||
| |||
|
Site map used so google will index all pages -
06-08-2005
, 06:24 AM
#2
| |||
| |||
|
|
I am building my website from about 200 pages now, to a goal of 1,000 pages of reasonable good quality. These pages are not spam, they actually say something intelligent. However the purpose is also to attract new visitor to my site on various topics. How do I construct a site map (not for navigation purposes, but for spider purposes) so Google will index these pages? I think Google will only index so many of the links on the map and then give up? I have a free sitemap maker, by coffee cup software that makes a simple map for me. Is Google limit based on the number of links? Size of the file? Should I construct a multi-tiered map? Or does Google also give up following links when they become too many clicks from your home page? |
sitemap (won't do any harm either). As long as every page can be found
through standard text or image links (no javascript for example) and
you don't have barriers like frames or session IDs the site can
potentially be fully spidered.
I've found a good way to link a site is as a hierarchy.
Home page (level 1) links to most important pages (level 2), which
link to deeper content pages (level 3). If the site is particularly
large there might be a need for a 4th and 5th level where level 3
pages link to level 4 etc....
The number of clicks (levels) away from the home page isn't a major
factor, though the harder it is for a search engine spider to find a
page less likely in will rank highly. For this reason link to THE most
important pages from the home page.
If you have an ~10,000 page site.
Level 1 links to 30 level 2 pages.
Level 2 links to 900 level 3 pages (that's each level 2 page linking
to 30 level 3 pages).
Level 3 links to 9000 level 4 pages (that's each level 3 page linking
to 10 level 4 pages).
Alternatively-
Level 1 links to 10 level 2 pages.
Level 2 links to 100 level 3 pages (that's each level 2 page linking
to 10 level 3 pages).
Level 3 links to 1000 level 4 pages (that's each level 3 page linking
to 10 level 4 pages).
Level 4 links to 9000 level 5 pages (that's each level 4 page linking
to 9 level 5 pages).
You also link from every page to the home page and THE most important
pages.
You get the idea.
With a structure like this and a reasonable number links to the home
page and other important pages these linking structures would result
in the entire site spidered long term with most benefit going to the
first levels (level 1 and 2). No one page has too many links from it
and so the bots will easily handle these.
If you want to do a site map for sites with the structures above you
could link to the main pages mostly (you don't have to link to every
page of a site). I've successfully added 1,000 links from a page that
will be fully spidered by Google
http://www.classic-literature.co.uk/...literature.asp though I
wouldn't generally do that for a sitemap (the above wasn't needed
really, added it because I could). Those 1,000 inks give the bots
access to every main page of the literature network which is well over
100,000 pages in (so the sitemap links to less than 1% of pages).
As long as all pages are spiderable (as described earlier) there is no
reason to link to every page on the site from the sitemap. Link to the
pages that will give the spiders access to the entire site easily,
with a 1,000 page site a couple of hundred links should easily do it.
If you want to add a multi level sitemap there's no reason not to.
I've done that before and themed the links (each sitemap page links to
the same type of pages) and gained some good SERPs with the site map
:-) Sticking to ~200 links a page with a main sitemap page linking to
the top pages would give you a 6 page sitemap.
Quote:
|
Thanks, Mark |
--
Free Search Engine Optimization Tutorial
http://www.seo-gold.com/tutorial/
#3
| |||
| |||
|
|
I am building my website from about 200 pages now, to a goal of 1,000 pages of reasonable good quality. These pages are not spam, they actually say something intelligent. However the purpose is also to attract new visitor to my site on various topics. |
http://www.google.com/webmasters/sit.../protocol.html
David
----------------------
http://www.abcseo.com/
#4
| |||
| |||
|
|
I am building my website from about 200 pages now, to a goal of 1,000 pages of reasonable good quality. These pages are not spam, they actually say something intelligent. However the purpose is also to attract new visitor to my site on various topics. How do I construct a site map (not for navigation purposes, but for spider purposes) so Google will index these pages? I think Google will only index so many of the links on the map and then give up? I have a free sitemap maker, by coffee cup software that makes a simple map for me. Is Google limit based on the number of links? Size of the file? Should I construct a multi-tiered map? |
Make sure that at least the site map validates.
BB
--
www.kruse.co.uk/ seo (AT) kruse (DOT) demon.co.uk
seo that watches the river flow...
--
#5
| |||
| |||
|
| I've found a good way to link a site is as a hierarchy. Home page (level 1) links to most important pages (level 2), which link to deeper content pages (level 3). If the site is particularly large there might be a need for a 4th and 5th level where level 3 pages link to level 4 etc.... The number of clicks (levels) away from the home page isn't a major factor, though the harder it is for a search engine spider to find a page less likely in will rank highly. For this reason link to THE most important pages from the home page. If you have an ~10,000 page site. Level 1 links to 30 level 2 pages. Level 2 links to 900 level 3 pages (that's each level 2 page linking to 30 level 3 pages). Level 3 links to 9000 level 4 pages (that's each level 3 page linking to 10 level 4 pages). Alternatively- Level 1 links to 10 level 2 pages. Level 2 links to 100 level 3 pages (that's each level 2 page linking to 10 level 3 pages). Level 3 links to 1000 level 4 pages (that's each level 3 page linking to 10 level 4 pages). Level 4 links to 9000 level 5 pages (that's each level 4 page linking to 9 level 5 pages). You also link from every page to the home page and THE most important pages. You get the idea. With a structure like this and a reasonable number links to the home page and other important pages these linking structures would result in the entire site spidered long term with most benefit going to the first levels (level 1 and 2). No one page has too many links from it and so the bots will easily handle these. If you want to do a site map for sites with the structures above you could link to the main pages mostly (you don't have to link to every page of a site). I've successfully added 1,000 links from a page that will be fully spidered by Google http://www.classic-literature.co.uk/...literature.asp though I wouldn't generally do that for a sitemap (the above wasn't needed really, added it because I could). Those 1,000 inks give the bots access to every main page of the literature network which is well over 100,000 pages in (so the sitemap links to less than 1% of pages). As long as all pages are spiderable (as described earlier) there is no reason to link to every page on the site from the sitemap. Link to the pages that will give the spiders access to the entire site easily, with a 1,000 page site a couple of hundred links should easily do it. If you want to add a multi level sitemap there's no reason not to. I've done that before and themed the links (each sitemap page links to the same type of pages) and gained some good SERPs with the site map :-) Sticking to ~200 links a page with a main sitemap page linking to the top pages would give you a 6 page sitemap. Thanks, Mark David -- Free Search Engine Optimization Tutorial http://www.seo-gold.com/tutorial/ |
#6
| |||
| |||
|
|
On 8 Jun 2005 03:24:34 -0700, markbiernat (AT) yahoo (DOT) com wrote: I am building my website from about 200 pages now, to a goal of 1,000 pages of reasonable good quality. These pages are not spam, they actually say something intelligent. However the purpose is also to attract new visitor to my site on various topics. How do I construct a site map (not for navigation purposes, but for spider purposes) so Google will index these pages? I think Google will only index so many of the links on the map and then give up? I have a free sitemap maker, by coffee cup software that makes a simple map for me. Is Google limit based on the number of links? Size of the file? Should I construct a multi-tiered map? Yes, one category per tier. Keep it down to around 100 links per tier. Make sure that at least the site map validates. BB -- www.kruse.co.uk/ seo (AT) kruse (DOT) demon.co.uk seo that watches the river flow... |
contain about 2000+ links each. Both pages have been cached by google
and both are around 210k (compacted)
One is a PR2, the other is a PR3 (Site is also PR3)
I think google have moved on from the 100 limit IMO
plh
Paul
http://www.newsfeeds.com The #1 Newsgroup Service in the World! 120,000+ Newsgroups
----= East and West-Coast Server Farms - Total Privacy via Encryption =----
#7
| |||
| |||
|
|
On 8 Jun 2005 03:24:34 -0700, markbiernat (AT) yahoo (DOT) com wrote: I've found a good way to link a site is as a hierarchy. Home page (level 1) links to most important pages (level 2), which link to deeper content pages (level 3). If the site is particularly large there might be a need for a 4th and 5th level where level 3 pages link to level 4 etc.... The number of clicks (levels) away from the home page isn't a major factor, though the harder it is for a search engine spider to find a page less likely in will rank highly. For this reason link to THE most important pages from the home page. If you have an ~10,000 page site. Level 1 links to 30 level 2 pages. Level 2 links to 900 level 3 pages (that's each level 2 page linking to 30 level 3 pages). Level 3 links to 9000 level 4 pages (that's each level 3 page linking to 10 level 4 pages). Alternatively- Level 1 links to 10 level 2 pages. Level 2 links to 100 level 3 pages (that's each level 2 page linking to 10 level 3 pages). Level 3 links to 1000 level 4 pages (that's each level 3 page linking to 10 level 4 pages). Level 4 links to 9000 level 5 pages (that's each level 4 page linking to 9 level 5 pages). You also link from every page to the home page and THE most important pages. You get the idea. |
now and get great results.
Another thing is, once the level 2 and level 3 pages are established well
enough, you can start removing links from the home page without having
any negative effect.
This then gives you the option to point links from your homepage to more
internal pages and efetively keep growing and growing a strong site.
#8
| |||
| |||
|
|
On Wed, 08 Jun 2005 19:16:53 GMT, Big Bill <kruse (AT) cityscape (DOT) co.uk wrote: On 8 Jun 2005 03:24:34 -0700, markbiernat (AT) yahoo (DOT) com wrote: I am building my website from about 200 pages now, to a goal of 1,000 pages of reasonable good quality. These pages are not spam, they actually say something intelligent. However the purpose is also to attract new visitor to my site on various topics. How do I construct a site map (not for navigation purposes, but for spider purposes) so Google will index these pages? I think Google will only index so many of the links on the map and then give up? I have a free sitemap maker, by coffee cup software that makes a simple map for me. Is Google limit based on the number of links? Size of the file? Should I construct a multi-tiered map? Yes, one category per tier. Keep it down to around 100 links per tier. Make sure that at least the site map validates. BB -- www.kruse.co.uk/ seo (AT) kruse (DOT) demon.co.uk seo that watches the river flow... Well, due to the size of one of my sites, I have 2 site maps, both contain about 2000+ links each. Both pages have been cached by google and both are around 210k (compacted) One is a PR2, the other is a PR3 (Site is also PR3) I think google have moved on from the 100 limit IMO |
lately.
BB
--
www.kruse.co.uk/ seo (AT) kruse (DOT) demon.co.uk
seo that watches the river flow...
--
#9
| |||
| |||
|
|
Dave, have you ever tested to find out what the minimum amount of pages it would take for a site to give it a boost in google? In other words would a 100 pages site give any kind of boost at all? It's hard to imagine doing a 10,000 page site let alone 50,000 or higher. Would I just be wasting my time creating a site with 100 pages? Any idea what the minimum would be in order to get a boost and how would that compare with a 50,000 page site? Thanks, Carl |
linking strategy would come into play. I'd say with a bigger but
relevant site you have more potential to work with for sure. Depends
hiow you use it to a large degree though..
BB
--
www.kruse.co.uk/ seo (AT) kruse (DOT) demon.co.uk
seo that watches the river flow...
--
#10
| |||
| |||
|
|
On Wed, 08 Jun 2005 15:32:15 -0500, Paul Burke <fakespam (AT) fakespam (DOT) com wrote: On Wed, 08 Jun 2005 19:16:53 GMT, Big Bill <kruse (AT) cityscape (DOT) co.uk wrote: On 8 Jun 2005 03:24:34 -0700, markbiernat (AT) yahoo (DOT) com wrote: |
Quote:
|
Well, due to the size of one of my sites, I have 2 site maps, both contain about 2000+ links each. Both pages have been cached by google and both are around 210k (compacted) One is a PR2, the other is a PR3 (Site is also PR3) I think google have moved on from the 100 limit IMO I'm beginning to think so as I'm hearing it from a couple of places lately. BB -- www.kruse.co.uk/ seo (AT) kruse (DOT) demon.co.uk seo that watches the river flow... |
Here are the URL's in question
http://www.firstpeople.us/FP-Html-Wisdom/sitemap.html PR2
http://www.firstpeople.us/FP-Html-Wi...c-sitemap.html PR3
HTH
plh
Paul
http://www.newsfeeds.com The #1 Newsgroup Service in the World! 120,000+ Newsgroups
----= East and West-Coast Server Farms - Total Privacy via Encryption =----
|
« Previous Thread
|
Next Thread »
| Thread Tools | |
| Display Modes | |
Linear Mode
| |
Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.