Download an entire website.

[ghostdog]

hi there
Ciao tutti.


You know sometimes you will need to download an entire website, to study its structors to find some voulnerabilities, then you get online to it and exploit it. like for instance you need the FTP informations, you gonna be looking for " ws_ftp.ini " file that contains the FTP authentications to the server, exc.......

For this, all you need is : Backbox , a large storage ( depends on how big is the website) and " wget ".

* open your comand shell and type :  wget â€"random-wait -r -p -e robots=off -U mozilla http://www.downloadthiswebsite.com

Ps: change downloadthiswebsite.com to your desired target website.

*** explanation:
-p parameter tells wget to include all files, including images.

-e robots=off you don’t want wget to obey by the robots.txt file

-U mozilla as your browsers identity.

â€"random-wait to let wget chose a random number of seconds to wait, avoid get into black list.

Other Useful wget Parameters:

â€"limit-rate=20k limits the rate at which it downloads files.

-b continues wget after logging out.

-o $HOME/wget_log.txt logs the output

Happy hacking
GD