Website Downloader + URL Change

[shakes1]

Hi guys

We maintain a website where content is constantly changing. The URLS have a consistant naming sequence, example:
www.example.co.za/folder/page1.html
www.example.co.za/folder/page2.html
www.example.co.za/folder/page3.html
etc...

I am looking for a piece of software that will copy the existing website and automatically changes the URL.

What I mean is, I'd like to tell the software to download the website www.example.co.za/folder/ starting from www.example.co.za/folder/page1.html and ending at www.example.co.za/folder/page999.html

Any ideas?

PS: The source website and back-end is being backed up, I am just trying an idea.

Thanks all!

 

[guest2013-1]

Just ssh into the server and copy all the files to the new folder?

 

[agentrfr]

You could combine a java script and Internet Download Manager's site grabber. Have access to the directory listing allowed and have IDM download everything from there.

 

[Sysem]

http://www.httrack.com/

I've used this before and it works like a dream.

 

[CrazYmonkeY159]

wget?

 

[battletoad]

You could combine a java script and Internet Download Manager's site grabber. Have access to the directory listing allowed and have IDM download everything from there.

iirc there is a batch file downloader in IDM (internet download manager) where you can specify a website, OP's www.example.co.za/folder/page[x].html, with the addition of a range for [x], OP's 1-999.

alternatively download wget, and run the following code in command prompt:

for /l %n in (1,1,999) do wget www.example.co.za/folder/page%n.html

 

[shakes1]

Man, you guys rock. Trying them out now, will give feedback soon. Thanks!

 

[shakes1]

iirc there is a batch file downloader in IDM (internet download manager) where you can specify a website, OP's www.example.co.za/folder/page[x].html, with the addition of a range for [x], OP's 1-999.

alternatively download wget, and run the following code in command prompt:

IDM worked perfectly with some fine tuning of the wildcards. Thank you!

 

[battletoad]

IDM worked perfectly with some fine tuning of the wildcards. Thank you!

hey that's what we do here on mybb enjoy