45
3
wget normally stops when it gets a HTTP error, e.g. 404 or so. Is there an option to make wget to download the page content regardless of the HTTP code?
lilydjwg
Posted 2011-03-06T08:46:58.857
Reputation: 817
How to use wget to download HTTP error pages?
Answers
70
Parameter: --content-on-error, available from wget 1.14:
If this is set to on, wget will not skip the content when the server responds with a http status code that indicates error.
Nowaker
Posted 2011-03-06T08:46:58.857
Reputation: 1 348
1--content-on-error seems not to be working in case of 401 response. See also this. – Joe – 2017-09-21T23:56:30.960
1
@lilydjwg interestingly the option --content-on-error is not on here http://www.gnu.org/software/wget/manual/wget.html#Wgetrc-Commands - but is on man wget ftp://ftp.connect.org.uk/hpux/Gnu/wget-1.14/wget-1.14.man.html
– barlop – 2013-12-17T20:52:08.4902
@barlop that's because the first link you linked is for wget 1.13.4, and the latter is for wget 1.14. --content-on-error was added at 1.14.
@lilydjwg well, if the online manual is going to be a man page, one would think they should update it to the latest man page. – barlop – 2013-12-18T13:48:15.840
1The linked manual is now the 1.15 one, which includes the mentioned option. – Paŭlo Ebermann – 2014-04-17T16:12:31.410
4You can use
curlinstead. – Daniel Beck – 2011-03-06T08:49:01.057