So what's this about dynamic urls then?

http://www.seochat.com/c/a/Search-En...bsite-Ranking/

BB
--
www.kruse.co.uk SEO (AT) kruse (DOT) demon.co.uk
home of SEO that's shiny!
--

Big Bill wrote:

http://www.seochat.com/c/a/Search-En...bsite-Ranking/

like much on the Web it is a bit out of date and gives half the picture.
Google can handle dynamic URLs so long as they are consistent and
mod-rewrite isn't going to help with those that are not.

e.g.

www.news-site.com?story=123456&lang=en

pulls story keyed by 123456 out of the db and displays the page. Google
will not have a problem with this but they claim they spider such sites
more slowly so as not put a load on the web server.

Yahoo doesn't seem to have to much problem with dynamic such URLs
either, for example

guardian.ifyouski.com/community/Vote?template=vote%26ObjectID=147036

at least for a single parameter in the query string.

On Thu, 18 Nov 2004 11:33:40 +0100, David Off
<david.off_dumpthisbit_ (AT) voila (DOT) fr> wrote:

Big Bill wrote:
http://www.seochat.com/c/a/Search-En...bsite-Ranking/


like much on the Web it is a bit out of date and gives half the picture.

I thought that a bit actually.

Google can handle dynamic URLs so long as they are consistent and
mod-rewrite isn't going to help with those that are not.

e.g.

www.news-site.com?story=123456&lang=en

pulls story keyed by 123456 out of the db and displays the page. Google
will not have a problem with this but they claim they spider such sites
more slowly so as not put a load on the web server.

I don't know that I entirely believe them there. Just a feeling.

Yahoo doesn't seem to have to much problem with dynamic such URLs
either, for example

guardian.ifyouski.com/community/Vote?template=vote%26ObjectID=147036

Yes but breadcrumbs again; can engines go deeper in?

BB


--
www.kruse.co.uk SEO (AT) kruse (DOT) demon.co.uk
home of SEO that's shiny!
--

Big Bill wrote:

On Thu, 18 Nov 2004 11:33:40 +0100, David Off
david.off_dumpthisbit_ (AT) voila (DOT) fr> wrote:

[...]

Yahoo doesn't seem to have to much problem with dynamic such URLs
either, for example

guardian.ifyouski.com/community/Vote?template=vote%26ObjectID=147036

Yes but breadcrumbs again; can engines go deeper in?

Can you give an example?


Also, instead of using the QUERY_STRING, you can use PATH_INFO, e.g.

http://example.invalid/foo/bar?id=666&pid=333&cid=777

You can use:

http://example.invalid/foo/bar/666/333/777

In both cases bar is a script, in the second one the /666/333/777 ends
up in PATH_INFO.

You can split the info on the /, and get the individual elements. It's
less self documenting compared to the QUERY_STRING method, which shows
what is what.

I read somewhere that Google has "problems" with very long URLs, as in:
spiders them less frequent. I have no idea if that is indeed the case.

--
John -> http://johnbokma.com/ MexIT: http://johnbokma.com/mexit/
Perl & Google/WWW: http://johnbokma.com/perl/
Experienced programmer and SEO available: PR7 http://castleamber.com/
Happy Customers: http://castleamber.com/testimonials.html

On 18 Nov 2004 19:05:31 GMT, John Bokma <postmaster (AT) castleamber (DOT) com>
wrote:

Big Bill wrote:

On Thu, 18 Nov 2004 11:33:40 +0100, David Off
david.off_dumpthisbit_ (AT) voila (DOT) fr> wrote:

[...]

Yahoo doesn't seem to have to much problem with dynamic such URLs
either, for example

guardian.ifyouski.com/community/Vote?template=vote%26ObjectID=147036

Yes but breadcrumbs again; can engines go deeper in?

Can you give an example?

i think maybe I do mean path info. Possibly. Everyone has different
names for everything.
Main products>ancillaryproducts>redproducts>redproducts withknobson.htm

Like that. How deep into links or paths/whatever will get spidered if
they're dynamically created?

BB
--
www.kruse.co.uk SEO (AT) kruse (DOT) demon.co.uk
home of SEO that's shiny!
--

On 18 Nov 2004 19:05:31 GMT, John Bokma
<postmasterSP (AT) AMcastleamber (DOT) com> wrote:

Yes but breadcrumbs again; can engines go deeper in?

Can you give an example?

I think Bill is misunderstanding the problem of spiders having
problems with URLs with multiple variables and a bot following the
navigation system through multiple dynamic pages. Is a link from a
dynamic page followed and how deep.

Breadcrumbs tends to refer to a bunch of links showing the path you
took (or likely took) to get to a page.

So if as part of the navigation system page A links to page B which
links to page C which links to page D, page D will have links to page
A, B and C usually near the top of the page in a line (breadcrumbs of
where you have been).

I think what Bill is asking is if the pages above are dynamic can
spiders follow the deeper links, page B to page C etc... and the
answer is yes as long as they can understand the URL.

The real question is what type of dynamic URL can Google spider and
the answer (the last time I checked) was ones with 2 or less
variables.

So these are OK-

domain.com/index.php?variable1=stuff
domain.com/index.php?variable1=stuff&variable2=stuff2

but this isn't-

domain.com/index.php?variable1=stuff&variable2=stuff2&variabl e3=stuff3

So two variables are fine, three aren't.

David
--
http://www.search-engine-optimization-services.co.uk/

SEO Dave wrote:

but this isn't-

domain.com/index.php?variable1=stuff&variable2=stuff2&variabl e3=stuff3

Not spidered at all? I just thougth slower.

--
John -> http://johnbokma.com/ MexIT: http://johnbokma.com/mexit/
Perl & Google/WWW: http://johnbokma.com/perl/
Experienced programmer and SEO available: PR7 http://castleamber.com/
Happy Customers: http://castleamber.com/testimonials.html

Big Bill wrote:

On 18 Nov 2004 19:05:31 GMT, John Bokma <postmaster (AT) castleamber (DOT) com
wrote:

Big Bill wrote:

On Thu, 18 Nov 2004 11:33:40 +0100, David Off
david.off_dumpthisbit_ (AT) voila (DOT) fr> wrote:

[...]

Yahoo doesn't seem to have to much problem with dynamic such URLs
either, for example

guardian.ifyouski.com/community/Vote?template=vote%26ObjectID=147036

Yes but breadcrumbs again; can engines go deeper in?

Can you give an example?

i think maybe I do mean path info. Possibly. Everyone has different
names for everything.

PATH_INFO is the path "after a script". There is no other name for that
afaik. The part after the ? is QUERY_STRING

Main products>ancillaryproducts>redproducts>redproducts withknobson.htm

Like that. How deep into links or paths/whatever will get spidered if
they're dynamically created?

Google can't see if they are dynamically created or not, and uses
heuristics to guess. So make Google guess wrong, and you have no
problem. Exception, some people think that Google spiders long URIs
slower. I have no idea.

So in the above:

/products/ancillaryproducts/redproducts/redproductswithknobson.html

is ok.

If you use a script as follows

/cgi-bin/script.cgi?cat1=products&cat2=ancillaryproducts&.. ...etc.

you might end up with Google spidering more slow as far as I know.

By changing it to:

/cgi-bin/script.cgi/products/..../redproductswithknobson.html

You improve things as far as I know. If you have this situation, with
mod_rewrite you can turn it into:

/products/..../redproductswithknobson.html

Doesn't look dynamic to me, nor to Google, as far as I know :-D

--
John -> http://johnbokma.com/ MexIT: http://johnbokma.com/mexit/
Perl & Google/WWW: http://johnbokma.com/perl/
Experienced programmer and SEO available: PR7 http://castleamber.com/
Happy Customers: http://castleamber.com/testimonials.html

"John Bokma" <postmaster (AT) castleamber (DOT) com> wrote

SEO Dave wrote:

but this isn't-

domain.com/index.php?variable1=stuff&variable2=stuff2&variabl e3=stuff3

Not spidered at all? I just thougth slower.

Sometime doesn't the bot get hung with those long variables and then leaves?

On Thu, 18 Nov 2004 20:30:31 GMT, SEO Dave
<seodave (AT) search-engine-optimization-services (DOT) co.uk> wrote:

On 18 Nov 2004 19:05:31 GMT, John Bokma
postmasterSP (AT) AMcastleamber (DOT) com> wrote:

Yes but breadcrumbs again; can engines go deeper in?

Can you give an example?

I think Bill is misunderstanding the problem of spiders having
problems with URLs with multiple variables and a bot following the
navigation system through multiple dynamic pages. Is a link from a
dynamic page followed and how deep.

Breadcrumbs tends to refer to a bunch of links showing the path you
took (or likely took) to get to a page.

So if as part of the navigation system page A links to page B which
links to page C which links to page D, page D will have links to page
A, B and C usually near the top of the page in a line (breadcrumbs of
where you have been).

I think what Bill is asking is if the pages above are dynamic can
spiders follow the deeper links, page B to page C etc... and the
answer is yes as long as they can understand the URL.

The real question is what type of dynamic URL can Google spider and
the answer (the last time I checked) was ones with 2 or less
variables.

So these are OK-

domain.com/index.php?variable1=stuff
domain.com/index.php?variable1=stuff&variable2=stuff2

but this isn't-

domain.com/index.php?variable1=stuff&variable2=stuff2&variabl e3=stuff3

So two variables are fine, three aren't.

David

I appreciate the input but now wait for 6 disagreements.

BB
--
www.kruse.co.uk SEO (AT) kruse (DOT) demon.co.uk
home of SEO that's shiny!
--