Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [wget]

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

Its features include recursive download, conversion of links for offline viewing of local HTML, support for proxies, and much more. It appeared in 1996, coinciding with the boom of popularity of the Web, causing its wide use among Unix users and distribution with most major GNU/Linux based distributions. Written in portable C, Wget can be easily installed on any Unix-like system.

Source: wikipedia

Man page

287 questions
253
votes
6 answers

how to download the ssl certificate from a website?

I want to download the ssl certificate from, say https://www.google.com, using wget or any other commands. Any unix command line? wget or openssl?
RainDoctor
  • 4,162
  • 3
  • 22
  • 25
86
votes
9 answers

Making `wget` not save the page

I'm using the wget program, but I want it not to save the html file I'm downloading. I want it to be discarded after it is received. How do I do that?
Ram Rachum
  • 5,011
  • 6
  • 33
  • 44
53
votes
4 answers

Is there a built-in command-line tool under Windows like wget/curl?

I come from a Linux/Unix background and I have been wondering if Windows has a binary that can download files from the console. I would like to automate a certain process and one of my requirements it to not install much software, but use the…
carlspring
  • 693
  • 1
  • 7
  • 12
50
votes
5 answers

Piping wget output to /dev/null in cron

I am running the following command every 5 minutes in my crontab to keep Phusion Passenger alive. */5 * * * * wget mysite.com > /dev/null 2>&1 When I run this it performs a wget on the site url routes STDOUT/STDERR to /dev/null. When I run this…
nulltek
  • 1,171
  • 3
  • 13
  • 22
37
votes
6 answers

wget to print errors, but nothing otherwise

How can I have wget print errors, but nothing otherwise? In the default behavior, it shows a progress bar and lots of stuff. In the --no-verbose version still prints one line per downloaded file, this I don't want. The --quiet option causes it to be…
Pablo
  • 7,249
  • 25
  • 68
  • 83
36
votes
6 answers

How do I pipe a downloaded file to standard output in bash?

How is it possible to pipe out wget's downloaded file? If not what alternatives should I use?
Alex
  • 2,287
  • 5
  • 32
  • 41
35
votes
6 answers

Wget a script and run it

I want to download a script from: http://dl.dropbox.com/u/11210438/flockonus-stack.sh and execute it. My guess is, to use wget renaming it, chmod it, and execute. What are the commands for doing that on Ubuntu?
Fabiano Soriani
  • 465
  • 1
  • 5
  • 7
24
votes
4 answers

Why wget doesn't verify SSL certificates?

I have a problem with my Fedora 8 installation. It looks that wget doesn't know how to verify SSL certificates any more. It's strange because I have another Fedora 8 box which I believe has the same configuration and it works! How can I make it…
tomazy
  • 433
  • 1
  • 5
  • 8
23
votes
4 answers

Execute curl requests in parallel in bash

What is the best way to execute 5 curl requests in parallel from a bash script? I can't run them in serial for performance reasons.
Justin
  • 5,008
  • 19
  • 58
  • 82
23
votes
3 answers

Wget: Is there a way to pass username and password from a file?

Is there a way to pass the username and password from a file instead of the command line via --user and --password? Background: I want to run wget via cron and don't want the username/password show up in process view
casper
  • 499
  • 2
  • 5
  • 12
19
votes
6 answers

Why the discrepancy between Speedtest and Wget?

My customer complains about low internet speeds. When measured with Speedtest.net speeds are acceptable. Periodic measured downloads are 10% to 30% of the nominal speed. I cannot explain that. Some background. The problematic connection is on one of…
Johannes Linkels
  • 307
  • 1
  • 2
  • 7
19
votes
4 answers

Why is wget hanging?

wget to a single specific url from one of my servers keeps getting timeouts. All other urls from this box work fine. This url works OK from any other boxes I have. Here's the output: wget -T 10 http://www.fcc-fac.ca --2011-07-14 14:44:29-- …
Szczepan
  • 293
  • 1
  • 2
  • 5
18
votes
5 answers

Why is only one wget command working in my crontab?

I wish to fetch content from a PHP script on my server two times a day, altering a query variable lang to set what language we want, and save this content in two language specific files. This is my crontab: */15 * * * * ~root/apache.sh >…
Alexander Wallin
  • 283
  • 1
  • 2
  • 7
17
votes
3 answers

How to exclude certain directories while using wget?

I'd like to download a directory from a FTP, which contains some source codes. Initially, I did this: wget -r ftp://path/to/src Unfortunately, the directory itself is a result of a SVN checkout, so there are lots of .svn directories, and crawling…
anta40
  • 321
  • 1
  • 4
  • 6
14
votes
5 answers

WGET can't resolve host

I've got 2 machines on the same sub-net running Debian 5.0. They use the same DNS (/etc/resolv.conf), they route to the same gateway (#route) and they have the same iptables settings (#iptables -L). I can ping from both of them, both to IP…
Maggi Trymbill
1
2 3
…
19 20