When working remotely or even locally, you often may need to obtain content from an external source. To get such content, especially when you don't have any other options, you will want to use command line tools to get the job done.
In this article, we are going to review some of the most widely used tools for downloading content via the command line. Autotune for fl studio 12 download.
Read Also: 9 Most Popular GUI Download Managers for Linux
Linux Lite makes the transition to a linux based operating system by offering a full, Microsoft compatible Office suite, familiar software like Firefox, Chrome, Teamviewer, VLC as well as full system back up tools. Below you'll find links that lead directly to the download page of 25 popular Linux distributions.
Wget
We are going to start with one of the most popular tools called wget. It's a network utility that can be used to download content over HTTP, HTTPS and FTP. Wget can be used in both background and foreground, which makes it useful if you need to leave a download running, even when you are logged off.
This tool comes with plenty of options, that allow you to do an authenticated downloads, recursive downloads with level limits, accepts regular expressions for URLs, allows excludes, accepts URL inputs from a file and many others. The options for wget are really a lot and it is highly recommended to review the tool's help page by simply running.
Some useful examples of wget command are:The most basic download example of wget is:
Example of downloading from URLs listed in a file. First here is the list of our file:
Then you can run the download with:
To run a download in a background you can use:
If you want to use wget with FTP to download a single file.
A more useful example of this would be to use background and recursive mode so you can obtain all files and folders within a directory.
Wget is preinstalled on many of the modern Linux distros, but if you need to install it, you can use:
Curl
A curl is a tool that can be used to transfer data from or to a server. It supports multiple protocols. According to its man page, the following protocols are supported DICT, FILE, FTP, FTPS, GOPHER, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, POP3, POP3S, RTMP, RTSP, SCP, SFTP, SMB, SMBS, SMTP, SMTPS, TELNET, and TFTP.
As you can imagine, you can do a lot with these. As you probably figured it out, curl supports proxies, user authentication, FTP upload/download, file transfer resume and many many more.
Here are some examples of using curl:Download a file:
To resume an interrupted download you can use:
You can check more useful curl examples here: 15 Tips on how to use curl in Linux.
To install curl, you can use:
Aria2
Aria is another multi-protocol download tool. Aria supports HTTP/HTTPS, FTP/SFTP BitTorrent and Metalink. Some of the features that make it different compared to others are that it supports the download of files from multiple locations at the same time, magnet links and is fully featured BitTorrent client.
As a BitTorrent client, it supports DHT, PEX, encryption, Magnet URI, web seeding, selective downloads, and local peer discovery.
Linux Download Tool For Windows 7
Feel free to review the Aria2 download manager article for more detailed usage. Below you can see few examples of aria2 basic usage
Here are some examples of using Aria2:
Download a torrent file:
Download, using URLs listed in a text file:
Resume incomplete download:
Download from password protected site:
To install Aria2, you can use the following commands:
Axel
The fourth download utility in our list is Axel, attempts to improve the downloading process by using multiple connections for one file. It can use multiple download locations for one download. According to the developers, Axel can increase the download speed of your downloads by 60% and it supports protocols: HTTP/HTTPS, FTP, and FTPS.
We have reviewed Axel in a separate article, which you can find here: How to use Axel as download accelerator to speed up FTP and HTTP downloads in Linux.
In the above article, you can check some download time comparisons between wget, HTTP download, and Axel.
Here are some examples of using Axel:To perform a simple download with Axel, you can use the following command:
You can set maximum download speed with the corresponding option --max-speed
or short option -s
. The value is set in bytes per second:
To save the file with different name, you can use the -o
option to specify the file name:
If you want to install Axel on your Linux system use the appropriate from the commands below:
Conclusion
This was our list of some of the most widely used download utilities in Linux. Which ones do you use? Why do you prefer those? Share your opinion in the comment section below.
So far, we have downloaded, and installed our Kali Linux virtual machine and we have installed updates and taken some measures to secure our Kali image. We are almost ready to start firing off scans, popping some shells and cracking some passwords. But before we do that, there is one more thing we should go over before we get started. We are going to go over how to install some tools on Kali Linux.
Kali Linux contains several penetration testing tools installed by default as well as some that are pre-installed. However, there are some really good tools that are do not come installed in the image. We are going to install some of them to give you a feel on how to do this when you find a tool you want to use in your Kali Linux image. There are a couple methods we can use to install these tools.
- Using the apt-get install command. The advancedpackage tool (apt) allows you to install tools and their dependencies veryquickly.
- Using git clone and downloading it from GitHub.Git clone is a git command that creates a clone of a target tool repository
Now that we know what we are going to use, let's startdownloading some tools!
The first tool we are going to install is the Discover script. Discover is a script that automates several passive and active penetration testing tasks. The Discover script was created by Lee Baird. Installation is a simple process. Open a command terminal in Kali Linux and do the following:
- Type 'sudo apt-get update && apt-get upgrade
- Type 'sudo git clone https://github.com/leebaird/discover.git'
- Navigate to the discover folder with the command cd discover
- Run the command ./update.sh. If you run into any errors, you may need to run the command as an elevated user. Try sudo ./update.sh again
- Several tools will install but when it is complete, type ./discover.sh
The next tool we are going to install isn't necessarily a tool, it is more of a resource. Cracking passwords and performing fuzzing techniques are very crucial skills to know in penetration testing. However, these skills and tools will never be successful without the proper lists to assist in the process. Kali Linux does come with some wordlists already installed, but there are several more you can find over the internet.
One of the more popular wordlists is Daniel Miessler's SecLists. We are going to download this wordlist the same way we downloaded the Discover script using the git clone command. However, this time we are going to direct where we want the file to download which will be the wordlist folder. Open a new command terminal or type 'clear' in your existing terminal to clear the screen. Then do the following:
- Type 'sudo apt-get update && apt-get upgrade
- Type 'sudo git clone https://github.com/danielmiessler/SecLists.git /usr/share/wordlists/seclists'. What we just did was clone the file, but we created a folder named 'seclists' in the wordlists folder
- List contents of wordlists folder with the command 'ls /usr/share/wordlists'
- Confirm seclists folder is there.
Finally, we are going to download and install the OpenVas scanner. OpenVas is an open source vulnerability scanner developed by the team at Greenbone Networks. To install this, we need to do the following steps:
- Type 'sudo apt-get update && apt-get upgrade
- Type 'sudo apt-get install -y openvas
- Once it downloads, type 'openvas-setup'. This will take a while to install.
However, once it does, make a note of the password (copy and paste it to a document) and url address given to you to launch and login to the scanner.
- Log in to OpenVas site (https://127.0.0.1:9392) with your username of admin and your password. (You may need to add a security exception to access the site.
Linux Operating System Download 64 Bit
- Go to the Administration tab and select 'Users'. Find your 'admin' username and click the 'Edit User' button on the right side (blue with a wrench).
- Go to the Authentication section and enter the password you want to use to log into this scanner. Click save.
We have now installed some tools for our Kali Linux machine. However, these tools barely scratch the surface of what you can install and use in the wild. There are several more tools and resources out there that can be useful on your journey. You can find many of them on Github, other websites or with a good Google search. You can also find them in several books (like the ones I mention here) or you can even write your own scripts and tools!
However, you must be be careful and make sure the sources you are downloading from are trusted. There are some malicious attackers out there who put malware in their apps and tools and trick users into downloading them. Find and create some great, safe tools and Happy Hacking!
To run a download in a background you can use:
If you want to use wget with FTP to download a single file.
A more useful example of this would be to use background and recursive mode so you can obtain all files and folders within a directory.
Wget is preinstalled on many of the modern Linux distros, but if you need to install it, you can use:
Curl
A curl is a tool that can be used to transfer data from or to a server. It supports multiple protocols. According to its man page, the following protocols are supported DICT, FILE, FTP, FTPS, GOPHER, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, POP3, POP3S, RTMP, RTSP, SCP, SFTP, SMB, SMBS, SMTP, SMTPS, TELNET, and TFTP.
As you can imagine, you can do a lot with these. As you probably figured it out, curl supports proxies, user authentication, FTP upload/download, file transfer resume and many many more.
Here are some examples of using curl:Download a file:
To resume an interrupted download you can use:
You can check more useful curl examples here: 15 Tips on how to use curl in Linux.
To install curl, you can use:
Aria2
Aria is another multi-protocol download tool. Aria supports HTTP/HTTPS, FTP/SFTP BitTorrent and Metalink. Some of the features that make it different compared to others are that it supports the download of files from multiple locations at the same time, magnet links and is fully featured BitTorrent client.
As a BitTorrent client, it supports DHT, PEX, encryption, Magnet URI, web seeding, selective downloads, and local peer discovery.
Linux Download Tool For Windows 7
Feel free to review the Aria2 download manager article for more detailed usage. Below you can see few examples of aria2 basic usage
Here are some examples of using Aria2:
Download a torrent file:
Download, using URLs listed in a text file:
Resume incomplete download:
Download from password protected site:
To install Aria2, you can use the following commands:
Axel
The fourth download utility in our list is Axel, attempts to improve the downloading process by using multiple connections for one file. It can use multiple download locations for one download. According to the developers, Axel can increase the download speed of your downloads by 60% and it supports protocols: HTTP/HTTPS, FTP, and FTPS.
We have reviewed Axel in a separate article, which you can find here: How to use Axel as download accelerator to speed up FTP and HTTP downloads in Linux.
In the above article, you can check some download time comparisons between wget, HTTP download, and Axel.
Here are some examples of using Axel:To perform a simple download with Axel, you can use the following command:
You can set maximum download speed with the corresponding option --max-speed
or short option -s
. The value is set in bytes per second:
To save the file with different name, you can use the -o
option to specify the file name:
If you want to install Axel on your Linux system use the appropriate from the commands below:
Conclusion
This was our list of some of the most widely used download utilities in Linux. Which ones do you use? Why do you prefer those? Share your opinion in the comment section below.
So far, we have downloaded, and installed our Kali Linux virtual machine and we have installed updates and taken some measures to secure our Kali image. We are almost ready to start firing off scans, popping some shells and cracking some passwords. But before we do that, there is one more thing we should go over before we get started. We are going to go over how to install some tools on Kali Linux.
Kali Linux contains several penetration testing tools installed by default as well as some that are pre-installed. However, there are some really good tools that are do not come installed in the image. We are going to install some of them to give you a feel on how to do this when you find a tool you want to use in your Kali Linux image. There are a couple methods we can use to install these tools.
- Using the apt-get install command. The advancedpackage tool (apt) allows you to install tools and their dependencies veryquickly.
- Using git clone and downloading it from GitHub.Git clone is a git command that creates a clone of a target tool repository
Now that we know what we are going to use, let's startdownloading some tools!
The first tool we are going to install is the Discover script. Discover is a script that automates several passive and active penetration testing tasks. The Discover script was created by Lee Baird. Installation is a simple process. Open a command terminal in Kali Linux and do the following:
- Type 'sudo apt-get update && apt-get upgrade
- Type 'sudo git clone https://github.com/leebaird/discover.git'
- Navigate to the discover folder with the command cd discover
- Run the command ./update.sh. If you run into any errors, you may need to run the command as an elevated user. Try sudo ./update.sh again
- Several tools will install but when it is complete, type ./discover.sh
The next tool we are going to install isn't necessarily a tool, it is more of a resource. Cracking passwords and performing fuzzing techniques are very crucial skills to know in penetration testing. However, these skills and tools will never be successful without the proper lists to assist in the process. Kali Linux does come with some wordlists already installed, but there are several more you can find over the internet.
One of the more popular wordlists is Daniel Miessler's SecLists. We are going to download this wordlist the same way we downloaded the Discover script using the git clone command. However, this time we are going to direct where we want the file to download which will be the wordlist folder. Open a new command terminal or type 'clear' in your existing terminal to clear the screen. Then do the following:
- Type 'sudo apt-get update && apt-get upgrade
- Type 'sudo git clone https://github.com/danielmiessler/SecLists.git /usr/share/wordlists/seclists'. What we just did was clone the file, but we created a folder named 'seclists' in the wordlists folder
- List contents of wordlists folder with the command 'ls /usr/share/wordlists'
- Confirm seclists folder is there.
Finally, we are going to download and install the OpenVas scanner. OpenVas is an open source vulnerability scanner developed by the team at Greenbone Networks. To install this, we need to do the following steps:
- Type 'sudo apt-get update && apt-get upgrade
- Type 'sudo apt-get install -y openvas
- Once it downloads, type 'openvas-setup'. This will take a while to install.
However, once it does, make a note of the password (copy and paste it to a document) and url address given to you to launch and login to the scanner.
- Log in to OpenVas site (https://127.0.0.1:9392) with your username of admin and your password. (You may need to add a security exception to access the site.
Linux Operating System Download 64 Bit
- Go to the Administration tab and select 'Users'. Find your 'admin' username and click the 'Edit User' button on the right side (blue with a wrench).
- Go to the Authentication section and enter the password you want to use to log into this scanner. Click save.
We have now installed some tools for our Kali Linux machine. However, these tools barely scratch the surface of what you can install and use in the wild. There are several more tools and resources out there that can be useful on your journey. You can find many of them on Github, other websites or with a good Google search. You can also find them in several books (like the ones I mention here) or you can even write your own scripts and tools!
However, you must be be careful and make sure the sources you are downloading from are trusted. There are some malicious attackers out there who put malware in their apps and tools and trick users into downloading them. Find and create some great, safe tools and Happy Hacking!
To see what will be using these tools against and why, check out my article on my experience with the OSCP.
There are also several books and equipment I recommend to help you on your way learning hacking skills and techniques.
Finally, check out my previous article about how I related the phases of a penetration test to the Infinity Stones from 'The Avengers: Endgame'
Enter your email address to subscribe to this blog and receive notifications of new posts by email. Ubuntu download page.