How to retrieve a complete directory from a URL

0

Is there a method on Windows or Linux for downloading all files* within an online directory, specifically:

http://download.opensuse.org/tumbleweed/

so I have a local repository I can work on? Any browser or command-line solutions would be fine, and I am willing to download any browser.

*recursively

What's in a Google Search

Posted 2016-04-15T08:57:53.420

Reputation: 340

Question was closed 2016-04-26T18:29:28.293

Not a duplicate of the question, since I asked what to do about downloading the files, not how to use the syntax of wget. Though they may share a single common solution the questions are very much not the same e.g. there are possibly other solutions not involving wget. – What's in a Google Search – 2016-04-15T09:30:19.097

The question doesn't ask for software recommendations, it asks for a solution. If people suggest software that's up to them, but if you read the question that's not what it's doing. – What's in a Google Search – 2016-04-15T09:33:56.350

No it's not. Not all solutions involve software recommendations. – What's in a Google Search – 2016-04-15T09:59:53.367

There is no currently available comment regarding google searchability. Suggest moving to chat or meta to resolve as this doesn't appear to be a constructive dialogue at this point. – What's in a Google Search – 2016-04-15T10:20:05.920

Let us continue this discussion in chat.

– What's in a Google Search – 2016-04-15T17:02:38.243

Answers

1

wget has a feature specifically designed for this need. The command you need would be:

wget --no-parent -r http://download.opensuse.org/tumbleweed/

-r means recursive.
--no-parent would skip the "Parent directory" link. Without this, the siblings of tumbleweed will also get downloaded.

David Dai

Posted 2016-04-15T08:57:53.420

Reputation: 2 833

Weirdly, I keep getting a '404' error for some of the files but I don't understand how that's possible. Surely wget should only be attempting to get the files that are actually in the directory? It seems to be reattempting, but something doesn't feel quite right... – What's in a Google Search – 2016-04-15T20:47:46.380