Download Recursive Entire Site

Using WGET on Windows:
set http_proxy=http://proxy:8080
wget -d -v -x -U “Mozilla” –proxy=on –proxy-user=user –proxy-passwd=pass –spider –recursive –level=2

In linux:
export http_proxy=”http://${user}:${pass}@proxy:8080″
wget -d -v -x -U “Mozilla” –proxy=on –recursive

–spider will not save files locally
–level=2 will only get untill two subfolders of the parent

Remembers some proxy will not allow such connection

Leave a Reply

Your email address will not be published. Required fields are marked *