Home > HowTo, Linux > Download Recursive Entire Site

Download Recursive Entire Site

January 26th, 2010 Leave a comment Go to comments

Using WGET on Windows:
set http_proxy=http://proxy:8080
wget -d -v -x -U “Mozilla” –proxy=on –proxy-user=user –proxy-passwd=pass –spider –recursive –level=2  http://www.yahoo.com/

In linux:
export http_proxy=”http://${user}:${pass}@proxy:8080″
wget -d -v -x -U “Mozilla” –proxy=on –recursive http://www.yahoo.com/

–spider will not save files locally
–level=2 will only get untill two subfolders of the parent

Remembers some proxy will not allow such connection

Categories: HowTo, Linux Tags: , , , ,
  1. No comments yet.
  1. No trackbacks yet.