How to wget a list of URLs in a text file

Question

Let s say I have a text file of hundreds of URLs in one location  e g   http   url file to download1 gz http   url file to download2 gz http   url file to download3 gz http   url file to download4 gz http   url file to download5 gz        What is the correct way to download each of these files with wget  I suspect there s a command like wget -flag -flag text file txt

User · Accepted Answer

Quick man wget gives me the following        -i file --input-file file Read URLs from a local or external file  If - is specified as file  URLs are read from the standard input   Use   - to read from a file literally named -   If this function is used  no URLs need be present on the command line  If there are URLs both on the command line and in an input file  those on the command lines will be the first ones to be retrieved  If --force-html is not specified  then file should consist of a series of URLs  one per line        So  wget -i text file txt

User · Answer

If you re on OpenWrt or using some old version of wget which doesn t gives you -i option      bin bash input  text file txt  while IFS  read -r line do   wget  line done  lt    input    Furthermore  if you don t have wget  you can use curl or whatever you use for downloading individual files

User · Answer

try   wget -i text file txt    check man wget

User · Answer

Run it in parallel with   cat text file txt   parallel --gnu  wget

User · Answer

If you also want to preserve the original file name  try with   wget --content-disposition --trust-server-names -i list of urls txt

[text] How to `wget` a list of URLs in a text file?

Examples related to text

Examples related to wget