 
paraka: A baby wearing headphones and holding a mic (Default)
[personal profile] paraka posting in [community profile] amplificathon
Has everyone been missing the Audiofic Archive as much as I have? As we've all probably noticed by now, there are a lot of dead links on the archive. I was really hoping we'd have results from the backups by now, but since we haven't had a status update in a while and since I know archivists have been quietly trying to upload what they can of the backlog, I thought it would be useful to approach it in an organized fashion.

To start off, the amazing [profile] kronos999 wrote a script that went through the AA and tested all the links that linked to a .zip file. This produced a list of about 20K missing files.

Now there are ways of transferring files from server to server without having to download the file in between. This won't work with most file sharing sites like box or mediafire, but works perfectly for people who host on ParakaProductions. Of those 20K missing files, about 9.5K are podfics by podficcers who host with ParakaProductions.

I've created a Google Doc with this info.

If you're an archivist
If you're an archivist interested in uploading some of the missing files, the best use of your time would be to upload the files in the "Missing Files (not on PP)" tab. These files are going to have to be manually uploaded (unless the restores come through).

If you're not an archivist
If you're not an archivist you can still help! You can:
  • Help track down PP links. In order to transfer the file from server to server, I need to match an active link from ParakaProductions to the missing .zip file. It would save me a ton of time if people could help me gather that info. Go to the "PP to Transfer" tab, pick a podficcer (they're arranged alphabetically by podficcer) and go through their AO3/LJ/Amplificathon posts and match the download links to the podfic. There's an empty column (H) at the end of each row, just put the link in there.

  • Upload Files.
  • If you have podfics in the "Missing Files (not on PP)" tab, and you already have hosting with me, create a temporary folder, upload the podfic, and drop me a link, I'll transfer it to the AA and will let you know to delete it from your server.
    If you don't have hosting with me, but feel comfortable using an FTP, email me, and I'll send you a temporary place to upload them to ParakaProductions so we can get them transferred.

    My email is parakaproductions at gmail dot com


Note: I've been moving files to the "Done" tab once they're uploaded, but even if others don't, I've set up the first column of both lists of missing files to be a check against a list of files that I pull down periodically (about once a day) of the files in the audfile folder on the AA. If the file has been uploaded, the start of the row will read "Done" otherwise it'll read #N/A.

(no subject)

Date: 2016-12-06 10:32 pm (UTC)
luzula: a Luzula pilosa, or hairy wood-rush (Default)
From: [personal profile] luzula
A lot of my podfics are on the "Missing Files (not on PP)" tab, but luckily I have backups of everything (as mp3:s, if not m4b:s). I'm sure I can figure out the FTP thing, so please do get me somewhere to upload them. I'm going away tomorrow and won't get back until Monday, though, so no hurry.

And you are awesome for doing this!

(no subject)

From: [personal profile] luzula - Date: 2016-12-07 07:16 am (UTC) - Expand

(no subject)

Date: 2016-12-10 12:24 am (UTC)
podfic_lover: (Default)
From: [personal profile] podfic_lover
Hi Luz, I´m happy to help with the m4b audiobooks of your podfics. I should have most of them, especially the ones I made for you.

(no subject)

From: [personal profile] luzula - Date: 2016-12-13 08:11 pm (UTC) - Expand

(no subject)

From: [personal profile] podfic_lover - Date: 2016-12-13 10:50 pm (UTC) - Expand

(no subject)

From: [personal profile] luzula - Date: 2016-12-14 11:03 am (UTC) - Expand

(no subject)

From: [personal profile] podfic_lover - Date: 2016-12-14 10:24 pm (UTC) - Expand

(no subject)

From: [personal profile] luzula - Date: 2016-12-15 07:02 am (UTC) - Expand

(no subject)

From: [personal profile] podfic_lover - Date: 2016-12-15 10:17 pm (UTC) - Expand

(no subject)

From: [personal profile] podfic_lover - Date: 2017-01-04 08:03 pm (UTC) - Expand

(no subject)

From: [personal profile] luzula - Date: 2017-01-04 10:14 pm (UTC) - Expand

(no subject)

Date: 2016-12-06 10:47 pm (UTC)
desireearmfeldt: (Default)
From: [personal profile] desireearmfeldt
Have pinged you via email. Thanks for doing this!

(no subject)

Date: 2016-12-07 01:27 am (UTC)
susan_voight: lantern against blue sky and tree branches (Default)
From: [personal profile] susan_voight
I asked that my podfics be taken off the archive quite a while ago, so please, don't restore my stuff! If you could take it off the missing tab that would be great, even. Thanks!

(no subject)

From: [personal profile] susan_voight - Date: 2016-12-07 03:56 am (UTC) - Expand

(no subject)

From: [personal profile] susan_voight - Date: 2016-12-07 03:43 pm (UTC) - Expand

(no subject)

From: [personal profile] susan_voight - Date: 2016-12-07 03:44 pm (UTC) - Expand

(no subject)

From: [personal profile] susan_voight - Date: 2016-12-07 05:53 pm (UTC) - Expand

(no subject)

Date: 2016-12-07 02:02 am (UTC)
From: [personal profile] kitsuneheart
Woah...this is...amazing.

What's going to be our policy on modified stuff? For example, my personal podfic collection is vast, but I've converted everything to 32kbps, so I could store more. Still go looking for originals, or should I just upload what I have?

(no subject)

Date: 2016-12-07 02:07 am (UTC)
fire_juggler: (Default)
From: [personal profile] fire_juggler
Second this. I have a ton of podfic, but I've converted everything I have to m4b for my personal collection if it was originally mp3. And some I've added some (really crappy covers to, so I can find them easily). I could re-convert them to mp3, but there is probably some loss of quality.
Edited Date: 2016-12-07 02:10 am (UTC)

(no subject)

From: [personal profile] kitsuneheart - Date: 2016-12-07 02:29 am (UTC) - Expand

(no subject)

From: [personal profile] fire_juggler - Date: 2016-12-07 03:03 am (UTC) - Expand

(no subject)

From: [personal profile] kitsuneheart - Date: 2016-12-07 04:36 am (UTC) - Expand

(no subject)

Date: 2016-12-07 03:17 am (UTC)
opalsong: (Default)
From: [personal profile] opalsong
I said this on twitter but I'll say it here so everyone can see it: I have all of my podfics (including any multi-voice ones I was a main part (see 1 of 3 people) of or produced). I'm also an archivist so I'll handle everything of mine.

(no subject)

Date: 2016-12-07 11:06 am (UTC)
anatsuno: a women reads, skeptically (drawing by Kate Beaton) (Default)
From: [personal profile] anatsuno
I probably have all of my podfic - will look into it next week (after my work deadline). I grabbed and copied all the lines about my podfics from the "missing files (not on PP)" tabs for now to help me gather everything listed. I feel comfortable using FTP to upload them to you for transfer so I'll email to ask for instructions.

If I'm not mistaken, the best for you would be that every podfic I find and mean to upload to you be first zipped and and the zip renamed to correspond to the zip file name listed for that podfic in the google spreadsheet, yeah?

thank you for this push, it's an amazing effort! <33

(no subject)

Date: 2017-01-14 10:28 am (UTC)
momo: (Default)
From: [personal profile] momo
I'd like a to know about the zipping as well? I've already uploaded a bunch of fics and commented on the spreadsheet with the links. I still have a bunch of files to go through and I'd rather know beforehand if they needed to be zipped with the correct file name, or if the "bare" files were enough? Since it wasn't mentioned in your post, paraka, that files need to be re-zipped. Since you asked to have other PP files tracked down and linked, and those definitely weren't zipped with the corresponding archive file name, I'm assuming you have an "easy" way of re-zipping and renaming the files once you have a PP link?

I'm hoping this theory proves correct, because, as I've said, I've already uploaded a bunch, and still have more to come. If you did want them pre-zipped, since I'm uploading them form my hard drive anyway, let me know asap, please! I'll be sure to zip whatever I haven't uploaded by then yet (or repeat the whole process with anything that's already up).

(no subject)

From: [personal profile] anatsuno - Date: 2017-01-14 12:10 pm (UTC) - Expand

(no subject)

From: [personal profile] momo - Date: 2017-01-14 12:11 pm (UTC) - Expand

(no subject)

From: [personal profile] anatsuno - Date: 2017-01-14 12:29 pm (UTC) - Expand

(no subject)

From: [personal profile] momo - Date: 2017-01-14 12:32 pm (UTC) - Expand

(no subject)

From: [personal profile] momo - Date: 2017-01-14 02:50 pm (UTC) - Expand

(no subject)

Date: 2016-12-07 02:47 pm (UTC)
ayremis: (Default)
From: [personal profile] ayremis
I'd like to help and I have some of the "Missing Files (not on PP)". I have sent you an e-mail.

Thank you for doing this :)

(no subject)

Date: 2016-12-07 08:41 pm (UTC)
podfic_lover: (Default)
From: [personal profile] podfic_lover
I´m also happy to use the FTP option for my various missing podfics and I'm going to email you next.

Thank you for organizing!

(no subject)

Date: 2016-12-08 07:19 pm (UTC)
pennyplainknits: image of yarn and laptop (Default)
From: [personal profile] pennyplainknits
There's no way I have all of my podfics though I know several friends have chunks of them, and the kind listeners in this post http://amplificathon.dreamwidth.org/3061255.html have more

I have to say this whole thing has really put me off ever making podfic again-- just the thought of all that is lost is so demoralising

(no subject)

Date: 2017-01-14 09:57 am (UTC)
momo: (Default)
From: [personal profile] momo
Noooooo, don't stop! I love your podfics D:

Think of all that is saved!

From: [personal profile] eileenlufkin - Date: 2017-02-05 08:43 pm (UTC) - Expand

(no subject)

Date: 2016-12-08 08:02 pm (UTC)
thilia: (Default)
From: [personal profile] thilia
I have all of my own mp3 podfics (most of which are on the missing list) on my computer and on dropbox. I can upload them... would the FTP thing make things much easier or should I submit them the regular way with my dropbox links? If so, I'll try to figure out the FTP thing this weekend or sometime next week!

I also have like, probably 80ish % of all the Teen Wolf podfics in original quality (mostly mp3s) that are on AO3 with only the "iTunes info" of the files slightly modified, so I guess I'll wait for the original podficcers to upload them themselves and if they're not up after a while, I'll start submitting those?

Also, if you're still looking for archivists, I think I'll have some time now, so... I volunteer! :D (or I guess I should do that in one of the posts that are actually about becoming an archivist :p)

(no subject)

Date: 2016-12-16 05:38 pm (UTC)
juniperphoenix: Fire in the shape of a bird (Default)
From: [personal profile] juniperphoenix
My podfics are on the Missing Files (not on PP) list. A while back I sent a message through the archive contact form letting the archivists know where they can get my files. Should I do this too? Sorry to be obtuse; I'm just not sure how this overlaps with existing efforts, and I don't want to duplicate work for anyone.

(no subject)

From: [personal profile] juniperphoenix - Date: 2016-12-21 04:34 pm (UTC) - Expand

(no subject)

Date: 2016-12-24 03:04 pm (UTC)
aethel: (Default)
From: [personal profile] aethel
BTW, I uploaded most of my files to the archive, plus a smattering of others from the not-on-PP list that I had on hand. Um, I didn't mark them as done though, and I noticed some of the others from that list had already been uploaded. Are you refreshing that list programmatically? I have more that could be uploaded, but wanted to work off a clean list (plus, I mostly have the mp3s and not the m4bs).
Edited Date: 2016-12-24 03:11 pm (UTC)
From: [personal profile] kitsuneheart
1) I pick a prolific podficcer to focus on. I have a spreadsheet here, with everyone listed by number of fics needed and a link to their reader page. https://docs.google.com/spreadsheets/d/1AmPQW23BRgHbjHj1fNfYKZ6J5_AHkgvUa_yR1poX0sA/edit?usp=sharing

2) After picking someone, I go to Paraka's spreadsheet, on a different window. One window has the podficcer's posts, the other the spreadsheet, and I just go through, new-tab-opening the "link to podficcer" bit of each post, until I've reached the end (or my computer complains about RAM).

3) I go through those opened tabs and get whatever downloads I can. To make this easier, I use the Chrono Sniffer extension (https://chrome.google.com/webstore/detail/chrono-download-manager/mciiogijehkdemklbdcbfkefimifhecn?hl=en) so I can pull any direct links automatically, and I went into my Chrome settings to change it so I don't get asked where things will be saved for every download (Settings>Show Advanced Settings>Downloads>Unclick the check mark about asking where to save). It also seems to make downloading from MediaFire less onerous!

4) If there's m4a, m4b, or other files needed, I run them through Freemake Audio Converter. (http://www.freemake.com/free_audio_converter/) This will get me from mp3 to m4a or m4a to mp3.
a) It's not quite the same as the original m4b files, but those are pretty much all gone, since the podficcers generally didn't make the early m4b files themselves, it was done by archivers. I opt for "optimal quality" in my conversions, so the converted files are still very good.

5) Freemake only makes m4a files. M4b files are the same file as an m4a file, just with the extension changed. To get m4b files, I run a command line script in the folder where the files are being kept.
a) To have JUST m4b files at the end, run: rename *.m4a *.m4b
b) For m4b AND m4a files, run: xcopy *.m4a *.m4b

6) Sort mp3, m4a, and m4b files into separate folders. This is important for the zipping, do not skip. Also, put already-zipped files into a folder, so they don't get re-zipped.

7) For zipping, I use 7-zip (http://www.7-zip.org/download.html), which allows me to use a script to zip everything at once. It is: for %i IN (*.*) DO "c:\Program Files\7-Zip\7z.exe" a "%~ni.zip" "%i"
a) If you install 7-zip elsewhere on your computer, you'll need to change the location in the above script.
b) Again, if you have not sorted out the files, files with the same name (ignoring suffixes) will be put into the same zipped file or just overwritten. So your mp3, m4a, and m4b versions will all be in the same zipped file, or just be left out.

8) Zip up folders, since the script doesn't do folders.

9) Go back to original spreadsheet and proceed to rename all the zipped files with the appropriate archive name.

10) For whatever is left, contact the podficcer to see if they have copies. After a week of them looking or of no communication, I'll upload my versions of the fics (which have metadata changed, so they're less-optimal, but still better than nothing).




....WHEW. It's all a lot faster than it sounds from typing.

So...anyone else have tools they use to go faster? I only discovered most of these BECAUSE of re-archiving things, so I'm curious what more tech-savvy people might be using.
glittertine: cheeky girl (girl - crazy - by the_muppet)
From: [personal profile] glittertine
<3 thanks for sharing your methodology!

(no subject)

Date: 2017-01-01 04:01 pm (UTC)
arabiana: Signs - Pink Figure Slasher (Default)
From: [personal profile] arabiana
Hi paraka! I did a lot of work on the PP transfer file tab yesterday. I think maybe 500 links? I just wanted to make sure that everything I had done was correct? If you could maybe take a look I would appreciate it!

(no subject)

From: [personal profile] arabiana - Date: 2017-01-02 04:11 am (UTC) - Expand

(no subject)

Date: 2017-01-02 01:28 am (UTC)
glovered: (Default)
From: [personal profile] glovered
Hi I'd love to help with this

(no subject)

Date: 2017-01-02 01:30 am (UTC)
glovered: (Default)
From: [personal profile] glovered
Whoops, it sent before I'd finished the comment. I'd love to help with this but I want to make sure I'm finding the right links. The links people seem to be adding to the spreadsheet start with the podficcer's name, ie http://cantarina.parakaproductions.com/... whereas the ones I'm finding on AO3 are http://parakaproductions.com/audio/TSCC-The%20Once%20and%20Future%20King%20by%20indiefic-cantarina,paraka.mp3

Does that link look correct? I want to make sure before doing a bunch!

(no subject)

From: [personal profile] glovered - Date: 2017-01-02 01:42 am (UTC) - Expand

(no subject)

From: [personal profile] glovered - Date: 2017-01-02 05:01 pm (UTC) - Expand

I have some

Date: 2017-01-02 05:35 pm (UTC)
From: [personal profile] vamous
I saw something from glovered that said you were looking for lost podfic. I pretty much downloaded anything that was Sam/Dean or Jensen/Jared, or anything with Jensen in it. I've already found a few that are on your list that I have. I'm afraid I'm not very computer literate, so don't quite know what all your upload things mean, but happy to upload anything I have that is on your list if you want to send me a link I can use.


(no subject)

Date: 2017-01-22 10:04 am (UTC)
podfic_lover: (Default)
From: [personal profile] podfic_lover
Thank you for the fast reply, helens!

Your personal archive was very helpful for collecting the missing files.

We´re looking for the m4b podbook versions of the remaining four recordings though, which were probably created by the original AA archivist. If you don´t have backups of these, we´re going to try to find them via crowd sourcing or recreate them from your mp3 versions.

(no subject)

Date: 2017-01-31 08:44 pm (UTC)
originally_dw: (Default)
From: [personal profile] originally_dw
Hi all,

Sorry I'm late. I only just saw this post after I got mentioned in a (what seemed to me) really weird tweet from paraka about uploading my podfic, haha. If there's anything of mine missing, let me know. I will probably have it. There's an index of my podfic folder here (I sent it in to the archive when this first happened but I guess that email never got read).

belated offer

Date: 2017-02-05 09:06 pm (UTC)
From: [personal profile] eileenlufkin
I have a folder with around 300 podfic files that were on the missing list as of 1/27. I would be happy to upload them. I think I sent you an email; I can resend it.

Updated list?

Date: 2017-04-17 12:25 pm (UTC)
From: [personal profile] vamous
Hi there

I do have a lot of podfics, all SPN or J2. Is there an updated list that I can look at to see if I have any of the ones you need?

Viki

Profile

amplificathon: (Default)
amplificathon

Most Popular Tags

September 2017

S M T W T F S
      12
3 45 6 789
10 11121314 1516
17 18 1920212223
24252627282930

Expand Cut Tags

No cut tags
http://amplificathon.dreamwidth.org/3076668.html
amplificathon.dreamwidth.org
crawl=CC-MAIN-2017-39
212156
application/http; msgtype=response
sha1:TLTQIISP3OT3AKZSNCVVDWERWN4UBZMA
<urn:uuid:a634df5a-5457-442b-a174-1f7922c89add>
2017-09-22T20:35:05Z
104.20.52.115
text/html
sha1:SJ63UXI5LFC66NKPCNN64V6K7C57DHGK
<urn:uuid:07ac341a-d3f2-4f68-9b72-a5b70525697e>
http://amplificathon.dreamwidth.org/3076668.html
response
<urn:uuid:51d93711-ecba-4bb8-811c-66076b868acc>
robots: classic
hostname: ip-10-181-87-197.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2017-39
operator: Common Crawl Admin
description: Wide crawl of the web for September 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf