 | |
#1
 
| |||
| |||
|
Web Page Downloader -
05-08-2008
, 06:13 PM
#2
| |||
| |||
|
|
I want to write a program that downloads web pages and replaces all the relative URLs with absolute ones EX. files/banner.jpg gets Replaced by http://www.mysite.com/files/banner.jpg Where are the locations in which I would have to look to find a url that needs to be replaced? |
can do it often by S & R by targeting any href=" that does not have
after the " a http://
--
dorayme
#3
| |||
| |||
|
|
In article 50b24a1a-cdef-4a0a-aa70-575af5d3f53d...oglegroups.com>, Chase Preuninger <chasepreuninger (AT) gmail (DOT) com> wrote: I want to write a program that downloads web pages and replaces all the relative URLs with absolute ones EX. files/banner.jpg gets Replaced by http://www.mysite.com/files/banner.jpg Where are the locations in which I would have to look to find a url that needs to be replaced? Good question, I don't know if there is a general answer. I know that I can do it often by S & R by targeting any href=" that does not have after the " a http:// |
--
Ed Jay (remove 'M' to respond by email)
#4
| |||
| |||
|
|
dorayme scribed: In article 50b24a1a-cdef-4a0a-aa70-575af5d3f53d...oglegroups.com>, Chase Preuninger <chasepreuninger (AT) gmail (DOT) com> wrote: I want to write a program that downloads web pages and replaces all the relative URLs with absolute ones EX. files/banner.jpg gets Replaced by http://www.mysite.com/files/banner.jpg Where are the locations in which I would have to look to find a url that needs to be replaced? Good question, I don't know if there is a general answer. I know that I can do it often by S & R by targeting any href=" that does not have after the " a http:// Or do a universal search and replace on files/*.jpg. |
--
dorayme
#5
| |||
| |||
|
|
In article <0t6724t8h3gebjnd5dul9itg151k17j74o (AT) 4ax (DOT) com>, Ed Jay <edMbj (AT) aes-intl (DOT) com> wrote: dorayme scribed: In article 50b24a1a-cdef-4a0a-aa70-575af5d3f53d...oglegroups.com>, Chase Preuninger <chasepreuninger (AT) gmail (DOT) com> wrote: I want to write a program that downloads web pages and replaces all the relative URLs with absolute ones EX. files/banner.jpg gets Replaced by http://www.mysite.com/files/banner.jpg Where are the locations in which I would have to look to find a url that needs to be replaced? Good question, I don't know if there is a general answer. I know that I can do it often by S & R by targeting any href=" that does not have after the " a http:// Or do a universal search and replace on files/*.jpg. No, the question was more general Ed. |
--
Ed Jay (remove 'M' to respond by email)
#6
| |||
| |||
|
|
dorayme scribed: In article <0t6724t8h3gebjnd5dul9itg151k17j74o (AT) 4ax (DOT) com>, Ed Jay <edMbj (AT) aes-intl (DOT) com> wrote: dorayme scribed: In article 50b24a1a-cdef-4a0a-aa70-575af5d3f53d...oglegroups.com>, Chase Preuninger <chasepreuninger (AT) gmail (DOT) com> wrote: I want to write a program that downloads web pages and replaces all the relative URLs with absolute ones EX. files/banner.jpg gets Replaced by http://www.mysite.com/files/banner.jpg Where are the locations in which I would have to look to find a url that needs to be replaced? Good question, I don't know if there is a general answer. I know that I can do it often by S & R by targeting any href=" that does not have after the " a http:// Or do a universal search and replace on files/*.jpg. No, the question was more general Ed. Then do a general search and replace? :-) |
this. You have to be specific. Hence the problem. I am not meaning to be
awkward here Ed, it just comes naturally. <g>
--
dorayme
#7
| |||
| |||
|
|
In article <50c724t05ckoak2v8fqqa7sbnetmlkaib6 (AT) 4ax (DOT) com>, Ed Jay <edMbj (AT) aes-intl (DOT) com> wrote: dorayme scribed: In article <0t6724t8h3gebjnd5dul9itg151k17j74o (AT) 4ax (DOT) com>, Ed Jay <edMbj (AT) aes-intl (DOT) com> wrote: dorayme scribed: In article 50b24a1a-cdef-4a0a-aa70-575af5d3f53d...oglegroups.com>, Chase Preuninger <chasepreuninger (AT) gmail (DOT) com> wrote: I want to write a program that downloads web pages and replaces all the relative URLs with absolute ones EX. files/banner.jpg gets Replaced by http://www.mysite.com/files/banner.jpg Where are the locations in which I would have to look to find a url that needs to be replaced? Good question, I don't know if there is a general answer. I know that I can do it often by S & R by targeting any href=" that does not have after the " a http:// Or do a universal search and replace on files/*.jpg. No, the question was more general Ed. Then do a general search and replace? :-) No, this is not right either because there is no such thing as a general this. You have to be specific. Hence the problem. I am not meaning to be awkward here Ed, it just comes naturally. <g |
--
Ed Jay (remove 'M' to respond by email)
#8
| |||
| |||
|
|
dorayme scribed: In article <50c724t05ckoak2v8fqqa7sbnetmlkaib6 (AT) 4ax (DOT) com>, Ed Jay <edMbj (AT) aes-intl (DOT) com> wrote: Or do a universal search and replace on files/*.jpg. No, the question was more general Ed. Then do a general search and replace? :-) No, this is not right either because there is no such thing as a general this. You have to be specific. Hence the problem. I am not meaning to be awkward here Ed, it just comes naturally. <g You awkwardly missed my smiley. ;-) <----- winky |
--
dorayme
#9
| |||
| |||
|
|
I want to write a program that downloads web pages and replaces all the relative URLs with absolute ones EX. files/banner.jpg gets Replaced byhttp://www.mysite.com/files/banner.jpg Where are the locations in which I would have to look to find a url that needs to be replaced? |
http://www.gnu.org/software/wget/
Use the -k option without the -p option.
HTH
viza
#10
| |||
| |||
|
 |
« Previous Thread
|
Next Thread »
| Thread Tools | |
| Display Modes | |
Linear Mode
| |
Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.