Page 1 of 1
Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 4:04 am
by jast
Depending on what software you have available, downloading a fight (e.g. for reviewing) is fairly tedious: in the worst case, you have to download each file individually. No, wait:
had to. Because now there are ZIP files.
- Complete: all fights ever published on songfight.org! (Currently 32 GB worth of data)
- Simple: each title as a single ZIP file!
- No fluff: each ZIP file has nothing but the songs, with not a single bit changed!
- No limits: download as much and as often as you want! The ZIP files are hosted in a place where that doesn't bother anyone. (The amount directly downloadable per month is limited, but even after that you can still download to your heart's content – you'll just be routed through a simple download page and there's a timer if you download multiple files in a row.)
ZIP files are available on:
http://jk.gs/songfight-download/
If there are any problems, let me know.
PS. want to link to ZIP files from your own site? Stable links look like this: //jk.gs/songfight-download/gimme.php/<fight key>.zip
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 7:14 am
by Lunkhead
Pretty cool! Mind if I link to these from the Jukebox?
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 7:38 am
by roymond
This is sweet. I use iDownloader on iPhone for downloading and listening and this is the perfect solution.
Will new fights appear magically once posted?
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 8:36 am
by jast
@Lunkhead: not at all.
@roymond: no, but there's a link you can click to make it create a new archive. Usually takes less than two minutes.
PS. I changed the code for grabbing the current fight, after downloading the one that's currently current (language fails me...), so the next one may or may not work properly (though I think it's probably fine). If it doesn't, let me know.
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 11:10 am
by Niveous
Wow, I wish you would've announced this a few days ago, before i downloaded the entire 32GBs song by song.
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 12:49 pm
by fluffy
This is pretty useful for people who don't want to set up a download manager themselves.
Niveous: Did you really manually download every single link? There are plenty of other ways of downloading things en masse. I generally use wget, which is a commandline tool.
Code: Select all
wget -m http://www.songfight.org/ -A mp3
will download all of the mp3s on the site, and
Code: Select all
wget -r -l 1 http://www.songfight.org/ -A mp3
will only download the ones currently on the front page.
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 1:10 pm
by jb
gee, wonder why the data transfer on .org spiked
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 1:52 pm
by Niveous
fluffy wrote:Niveous: Did you really manually download every single link?
I used Firefox's Down the All. One click and blam, it was done 4 hours later.
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 3:49 pm
by jast
Niveous wrote:I used Firefox's Down the All. One click and blam, it was done 4 hours later.
So it wasn't actually worse than downloading the ZIP files...
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 3:54 pm
by jast
PS. PHP is such a horrible language. array_merge() keeps string keys intact but recounts numeric keys. If a string happens to look like a number... it's a number. That's why, until just now, the title '501' wasn't handled properly. Fortunately the workhorse of the download site is written in shell script – that's much saner.
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 7:29 pm
by fluffy
jast wrote:PS. PHP is such a horrible language. array_merge() keeps string keys intact but recounts numeric keys. If a string happens to look like a number... it's a number. That's why, until just now, the title '501' wasn't handled properly. Fortunately the workhorse of the download site is written in shell script – that's much saner.
sigh
motherfucking data typing, how does it work
Re: Announcing: download fights as ZIP files
Posted: Wed Jun 19, 2013 8:41 pm
by Lunkhead
Funny, I never had issues like that in Java.
Anyway, jb, care to elaborate with any info/stats at all about normal songfight.org bandwidth usage compared to the recent spike?
Re: Announcing: download fights as ZIP files
Posted: Thu Jun 20, 2013 12:47 am
by jast
Lunkhead wrote:Funny, I never had issues like that in Java.
Funny, I don't like writing 5000 lines of code and adding three frameworks when 100 LoC and no framework would do.
Re: Announcing: download fights as ZIP files
Posted: Thu Jun 20, 2013 8:35 am
by Lunkhead
I don't get your point.
Re: Announcing: download fights as ZIP files
Posted: Thu Jun 20, 2013 9:00 am
by roymond
Please stand by...I am preparing my geek postering post...
Re: Announcing: download fights as ZIP files
Posted: Mon Mar 31, 2014 8:42 am
by josh
I take it this is no longer happening? Anyway, I can confirm "DownThemAll" does the job in Firefox.
Re: Announcing: download fights as ZIP files
Posted: Wed Apr 02, 2014 1:02 am
by jast
Crap... apparently a recent power failure destroyed (part of) the database. I'll try and get it rebuilt soonish.
Re: Announcing: download fights as ZIP files
Posted: Wed Apr 02, 2014 1:06 am
by jast
Well, that was easier than I thought... fixed