How to Download a Remote Directory Recursively with wget

How to Download a Remote Directory Recursively with wget

How to Download Folders and Files Recursively within a Remote Directory with wget, Issue command:

$ wget -e robots=off --cut-dirs=3 --reject="index.html*" --no-parent --recursive --relative --level=1 --no-directories "https://url-here/path-to-folder"



Download Flash Videos from Video Streaming Sites like youtube with Linux Command Line Apps

Download Flash Videos from Video Streaming Sites like youtube with Linux Command Line Apps


1.) with youtube-dl:

$ youtube-dl -cit "youtube.com/url-here" 

- optional to download an entire playlist or channel, go to the desired playlist list or channel, and grab the url then paste in terminal:

$ youtube-dl -cit "youtube.com/playlist_url-here"

- optional to download a custom list of video files, create a plain text/txt file and place all the YouTube links that you wish to download there, for example yt_foo_list.txt

$ youtube-dl -a yt_foo_list.txt

- optional to download the sound/music of the video to mp3 only:

$ youtube-dl -cit --extract-audio --audio-format mp3 "youtube.com/url-here"

- optional to download a video in certain file type/resoluton format, use option "–list-formats" with the command

$ youtube-dl –list-formats "youtube.com/url-here" 

- it will show you a list of formats with a corresponding video/resolution format code, that you can download in, choose from them, then to download a preferred file format from the list, use the option "-f", if flv was in the list and you want to save the file in that format, you then issue command

$ youtube-dl -f 34 "youtube.com/url-here"

- where 34 is the video/resolution format code of flv, it will say in the available video formats list or the resolutions available of the same format, code will be mentioned at the left most side

- optional to download video in all available formats, issue command

 $ youtube-dl –all-formats "youtube.com/url-here" 


2.) with get-flash-videos:

$ get-flash-videos "youtube.com/url-here"


3.) with cclive:

$ cclive "youtube.com/url-here"


4.) with movgrab:

$ movgrab "youtube.com/url-here"

5.) with you-get

$ you-get "youtube.com/url-here"

- Display the information of a video without downloading:

$ you-get "youtube.com/url-here"

- Download multiple videos:

$ you-get "youtube.com/url-here/A" "youtube.com/url-here/B"

-  Force Re-download vidoes (This will overwrite any existing video or temporary file):
 
$ you-get -f "youtube.com/url-here/"

- Set the output directory for downloaded files:

$ you-get -o ~/Downloads you-get -f "youtube.com/url-here/"

- Use a specific HTTP Proxy for Downloading
(use this -y proxy.uku.im:8888 as option and proxy for downloading from youku.com):

$ you-get -x 127.0.0.1:8087 "youtube.com/url-here/"

- Disable any proxy use  --no-proxy:

$ you-get --no-proxy "youtube.com/url-here/"

- Watch a video in your own video players of choice, like vlc and mplayer, to avoid uneccessary Ads.

$ you-get -p vlc "youtube.com/url-here/"

/or

$ you-get -p mplayer "youtube.com/url-here/"


Notes:
- To use any of the mentioned apps, they must be installed first
- youtube-dl, get-flash-videos, cclive, movgrab and you-get work in other sites as well not just youtube, for instance youtube-dl actually supports video download from several other sites like Dailymotion, Google Video, Photobucket, Facebook, Yahoo, Metacafe, Depositfiles and few more similar sites
- To upgrade youtube-dl do: $ youtube-dl -U
- youtube-dl can download from chinese websites like youku.com, tudou.com but if it doesnt work try to upgrade it first, if it doesn't work, you can use the you-get console app instead which supports alot of websites including chinese websites and even including japanese websites like niconico