How to use wget to download tar file

The option to run a check on files is --spider. In circumstances such as this, you will usually have a file with the list of files to download inside. An example of how this command will look when checking for a list of files is:. If you want to copy an entire website you will need to use the --mirror option. As this can be a complicated task there are other options you may need to use such as -p , -P , --convert-links , --reject and --user-agent.

It is always best to ask permission before downloading a site belonging to someone else and even if you have permission it is always good to play nice with their server. If you want to download a file via FTP and a username and password is required, then you will need to use the --ftp-user and --ftp-password options.

If you are getting failures during a download, you can use the -t option to set the number of retries. Such a command may look like this:. If you want to get only the first level of a website, then you would use the -r option combined with the -l option.

It has many more options and multiple combinations to achieve a specific task. You can also find the wget manual here in webpage format. Post as a guest Name. Email Required, but never shown. The Overflow Blog. Podcast An oral history of Stack Overflow — told by its founding team. Millinery on the Stack: Join us for Winter Summer? Bash, ! Featured on Meta. New responsive Activity page.

Visit chat. Not a member of Pastebin yet? Sign Up , it unlocks many cool features! Let's start with something simple. Copy the URL for a file you'd like to download in your browser. Now head back to the Terminal and type wget. Download and save the TAR file to your computer. Turns out the only difference is that you are combining what most of us do in two steps into one. Oh you were being literal. I thought this was something else.

Maybe make a tutorial on pipes instead? It is not any thing new, but i just described some of the possible and easy ways to save time while downloading TAR archives with wget and curl commands.

I know this can be helpful to newbies. Have a question or suggestion? Please leave a comment to start the discussion. Please keep in mind that all comments are moderated and your email address will NOT be published.