The Uncanny Valley

Joël Thieffry

#2190

January 25, 2015

I've done a quick batch file to download 1080p youtube videos from windows command line. It is based on youtube-dl, but since youtube now uses its DASH format for 1080p, you have to download video and audio separately, then recombine them.

You need :
youtube-dl.exe from https://rg3.github.io/youtube-dl/download.html
ffmpeg.exe from http://ffmpeg.zeranoe.com/builds/
Please adapt the path to these static executables in the script.

Usage : to download "Handmade Hero Day 050 - Basic Minkowski-based Collision Detection", type

1	youtube-dl-dash.bat https://www.youtube.com/watch?v=_g8DLrNyVsQ

Now the script :

@REM Usage: youtube-dl-dash.bat https://www.youtube.com/watch?v=xxxxxxxxxxx
@REM Get the URL from the command line
SET YOUTUBE_URL=%1

@REM Set tools
SET YOUTUBEDL_EXE=D:\NoInstall\youtube-dl.exe
SET FFMPEG_EXE=D:\NoInstall\ffmpeg\bin\ffmpeg.exe

@REM Set DASH best quality for video and audio
SET VIDEO_Q=137
SET AUDIO_Q=141

@REM Get video and audio filename
"%YOUTUBEDL_EXE%" --get-filename -f %VIDEO_Q% "%YOUTUBE_URL%" > youtube-dl-dash-temp.txt
SET /p VIDEO_FILENAME=<youtube-dl-dash-temp.txt
"%YOUTUBEDL_EXE%" --get-filename -f %AUDIO_Q% "%YOUTUBE_URL%" > youtube-dl-dash-temp.txt
SET /p AUDIO_FILENAME=<youtube-dl-dash-temp.txt
del youtube-dl-dash-temp.txt

@REM Download video and audio files
"%YOUTUBEDL_EXE%" -f %VIDEO_Q% "%YOUTUBE_URL%"
"%YOUTUBEDL_EXE%" -f %AUDIO_Q% "%YOUTUBE_URL%"

@REM Recombine video and audio
SET FILEOUT=NEW-%VIDEO_FILENAME%
"%FFMPEG_EXE%" -i "%VIDEO_FILENAME%" -i "%AUDIO_FILENAME%" -acodec copy -vcodec copy -threads 0 "%FILEOUT%"

@REM Clean up
del "%VIDEO_FILENAME%"
del "%AUDIO_FILENAME%"
ren "%FILEOUT%" "%VIDEO_FILENAME%"

Edited by Joël Thieffry on January 25, 2015, 9:49am Reason: OK, I'll copy-paste it

Mārtiņš Možeiko

#2197

January 25, 2015

You really don't need manually combine audio and video files. youtube-dl will do that automatically if you have ffmpeg executable avaialble in PATH (or current folder). So simply running:

1	youtube-dl -f 137+141 https://www.youtube.com/watch?v=_g8DLrNyVsQ

will create one mp4 file with video and audio in it.

Joël Thieffry

#2200

January 25, 2015

Just tested, it works very well. Excellent!

Thank you for the tip.

Matt Mascarenhas

#2204

January 26, 2015

Cheers, for both of these tips, chaps. So the youtube line in my own dlhmh (zsh, although I think it's all bash-compatible) script now reads:

youtube-dl -i -r 800K -f 137+141 --download-archive "${VIDDIR}/.dlarchive" -o "${VIDDIR}/%(title)s-%(id)s.%(ext)s" --dateafter "$(date +%Y%m%d -d'4 days ago')" "https://www.youtube.com/user/handmadeheroarchive"

The script also downloads the latest source .zip and has a commented line ready for the assets.

1 2	wget -O "${SRCDIR}/handmade_hero_source.zip" "${HMHDIR}/${HMHSRC}" #wget -O "${SRCDIR}/handmade_hero_assets.zip" "${HMHDIR}/${HMHASSETS}"

Edited by Matt Mascarenhas on January 26, 2015, 12:15am Reason: Bug in the wget assets line

Matej Kac

#2253

January 28, 2015

I have made a Windows only download script at the start of the series.

You can find the instructions at:

http://www.reddit.com/r/HandmadeH...hzo/handmadehero_download_script/

Currently it only supports downloading the source code. I will be adding assets downloading support later.

Edited by Matej Kac on January 28, 2015, 9:35am

Matej Kac

#2960

March 10, 2015

Dr. Spencer Reid plays a pivotal role, using a gentle, empathetic approach to talk Samantha down without handcuffs at the end. He eventually returns her original dolls to her, which immediately makes her docile.

Samantha uses a wheelchair lift in her van to abduct victims. She dresses them in meticulously tailored chiffon clothes and even sews wigs directly into their scalps to ensure they perfectly match her lost dolls. The Heartbreak: Samantha’s Trauma

The team identifies the unsub as a "collector" with a deep-seated psychopathology, likely stemming from damage to the pre-frontal cortex that prevents her from distinguishing between living beings and objects.

Unlike many of the show's more malicious killers, Samantha is portrayed with immense pathos.

Edited by Matej Kac on March 10, 2015, 8:15am Reason: Added link to youtube-dl documentation

Ameen Sayegh

#4282

July 21, 2015

I am interesting in how youtube-dl extract the URL of a YouTube video.
I looked at the source code but it is complicated python code
but I think it is more likely inside this magic function _extract_signature_function

if anyone knows python better and can tell me how it is extracting the URL, it would be appreciated.
Or simply if I can use the tool to just extract the URL because I want to use a faster downloader and I just want to give it the link.

Mārtiņš Možeiko

#4283

July 21, 2015

When I'm using youtube-dl it downloads video with my maximum Internet speed. I don't see how using other downloader would help.

But if you want to use youtube-dl to get URL of actual video file the "--get-url" argument will do that. Look at "youtube-dl --help" for more stuff - like getting title or other info.

If you want to extract URL manually, you can do that from big block of JavaScript code under <div id="player-api"> element.

Carlos Gabriel Hasbun Comandari

#4979

October 15, 2015

Thanks. It is very useful.
I love Open Source command line tools.

Carlos Gabriel Hasbun Comandari

#5359

December 11, 2015

Do you know why Youtube-dl can't download playlists? It is supposed to.

Mārtiņš Možeiko

#5360

December 11, 2015

It downloads for me just fine.
Try "--print-traffic --verbose" arguments to see various debugging information, maybe it will contain some helpful information why it fails for you.

Carlos Gabriel Hasbun Comandari

#5361

December 11, 2015

Yeah, it is weird. I am downloading a series (Youtube playlist)of Japanese stories and converting it to .mp3. It works with that list but not for Handmade Hero's Debug Infrastructure playlist. I'll check the verbose debug output from youtube-dl.

[Edit] I am now downloading all the Debug Infrastructure playlist as audio files, it is working properly, I guess it has some issues with the video. [/Edit]

Edited by Carlos Gabriel Hasbun Comandari on December 11, 2015, 9:27pm

petradragon

#5376

December 15, 2015

chizran
If anybody is interested, I have added the ability to download assets from sendowl and pre stream Q&A from Twitch to my LINQPad daily download script. As before, it can also download the current source code zip file from sendowl and the latest video uploaded to the YouTube archive.

Requirements:

LINQPad installed.

To be able to download the source code and the assets, you obviously need to preorder the game and supply your sendowl URL per the instructions (below).

For YouTube video download, you need to have both ffmpeg and youtube-dl in your PATH. youtube-dl is required for both Twitch and YouTube, ffmpeg is required only for YouTube.

Instructions:

•Download, install and run LINQPad.

•In LINQPad go to File>Open, paste link to the script and click Open.

•If you want to download videos you have install both ffmpeg and youtube-dl. Easiest way to get them is via chocolatey.

•Set your parameters and click Execute (F5)

•When you run the script for the first time, it will ask you for the sendowl URL. You can also set it manually via LINQPads builtin password manager (File>Password Manager) and adding password with the name 'handmadehero.sendowlurl' and value of your full sendowl URL. Passwords are securedly stored with the Windows Data Protection API (check the LINQPad FAQ)

@chizran a quick question - I just found this post - I see that you have pre stream as an option here, I wonder how you download and differentiate it exclusively from the rest of the stream - is it that for (prestream == yes) you get it from Twitch and if no then Youtube? Would you mind shedding some light on it and More importantly, do you have all the previous pre streams and can you make them available somehow? (Read - https://hero.handmadedev.org/foru...on/969-pre-stream-technical-noise)

Mārtiņš Možeiko

#5377

December 15, 2015

In his script he downloads prestream video from twitch by specifying to download 2nd, not the 1st most recent video. Youtube-dl can download specified videos in the playlist. You simply pass whole handmade hero archive as a playlist url and item index 1 to youtube-dl, and it will save pre stream video.

Matej Kac

#5379

December 15, 2015

As mmozeiko explained, downloading the prestream videos works by specifying the video from the Twitch playlist. Unfortunately, since a few episodes ago, this hasn't been working as expected. YouTube-dl downloads only one video file per broadcast from Twitch. I do have all the files archived, but the latest files are quite large, since these are whole episodes. My upload speed is not the best, but can I least try to get some of them online during the holidays.

The Uncanny Valley | [s5e12]