Recursive wget

From HeepyWiki
Revision as of 21:19, 12 November 2014 by Morris (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

How to wget something recursively without pulling lots of unnecessary crud

-r means descend recursively

-np means never follow a link upward

-nH means don't put everything in a hostname subdir

 wget -nH -r -np http://blah.blah.com/blah

add -N to turn on timestamping, so files already stored locally will not be downloaded again unless changed.

add '-A suffix' to download only files with suffix 'suffix'

wget -nH -r -np -A gif,jpg -N http://blah.blah.com/blah