wget
Download files from the Web.
Supports HTTP, HTTPS, and FTP.
More information: https://www.gnu.org/software/wget.
- Download the contents of a URL to a file (named "foo" in this case):
wget https://example.com/foo
- Download the contents of a URL to a file (named "bar" in this case):
wget --output-document bar https://example.com/foo
- Download a single web page and all its resources with 3-second intervals between requests (scripts, stylesheets, images, etc.):
wget --page-requisites --convert-links --wait=3 https://example.com/somepage.html
- Download all listed files within a directory and its sub-directories (does not download embedded page elements):
wget --mirror --no-parent https://example.com/somepath/
- Limit the download speed and the number of connection retries:
wget --limit-rate=300k --tries=100 https://example.com/somepath/
- Download a file from an HTTP server using Basic Auth (also works for FTP):
wget --user=username --password=password https://example.com
- Continue an incomplete download:
wget --continue https://example.com
- Download all URLs stored in a text file to a specific directory:
wget --directory-prefix path/to/directory --input-file URLs.txt