Sam's notebook

CFB Folder 1 done November 26th, 2017, 9AM

Open content

The first folder of the C.F. Barker Archives’ material is done: finished scanning and initial entry into ArchivesWiki. This is my attempt to use MediaWiki as a digital archive platform for physical records (and digitally-created ones, although they don’t feature as much in the physical folders). It’s reasonably satisfactory so far, although there’s lots that’s […]

[No comments] [Keywords: , , , , ] [Permanent link]

What goes Where on the Web May 7th, 2014, 9AM

Open content

Every now and then I recap on where and what I store online. Today I do so again, while I’m rather feeling that there should be discrete and specific tools for each of the things. Firstly there are the self-hosted items: WordPress for blogging (where photo and file attachments should be customized to the exact […]

[No comments] [Keywords: , , , , , , , , , ] [Permanent link]

forking wikis May 28th, 2013, 9AM

Open content Programming

I wish wikis were less collaborative! I wish they were more like software projects, where if one wants to modify anything, one gets one’s own copy and does anything at all to it. No, I’m not really saying that there should be fewer centralised places of communal effort, these things are great… I just want […]

[No comments] [Keywords: , , , , , , , ] [Permanent link]

Don't Write Code (write descriptions of things) November 12th, 2012, 4PM

Open content Programming

I wish I didn’t know how to code. For a programmer, the solution to every problem is to write more code. But sometimes, all that is needed is to write proper words. To explain things and explore them through prose. Not to remove oneself to the meta-realm of trying to understand the general structure of […]

[No comments] [Keywords: , , , , , , , , ] [Permanent link]

Digital Permanence July 27th, 2012, 11AM

Programming

Manton Reececited wrote some sensible words about the permanence of material on the Internet, and Dave Winercited followed suit shortly after (and then againcited). It’s an important topic. We need places — secure, digital, permanent places — to store things. It’s not a particularly difficult problem, at least to attempt to solve. (Of course, we […]

[No comments] [Keywords: , , , , , ] [Permanent link]

Archiving a password-protected site with wget July 23rd, 2012, 3PM

Programming

The combination of wget and the Export Cookies add-on for Firefox is useful for creating offline, complete, static archives of websites that are only accessible with a password: First log in to the site and export cookies.txt, Then run wget \ –recursive \ –no-clobber \ –page-requisites \ –html-extension \ –convert-links \ –restrict-file-names=windows \ –domains example.com […]

[No comments] [Keywords: , , , , , , ] [Permanent link]
https://samwilson.id.au/tag/archiving/
samwilson.id.au
crawl=CC-MAIN-2017-51
72164
application/http; msgtype=response
sha1:MVEJNGTXGU3NNR5GFAINWL7P4VIAGRLW
<urn:uuid:a1eca41b-5210-4de8-938c-fa71dac9c77d>
2017-12-18T22:18:53Z
138.68.3.113
text/html
sha1:HENYQ6W2BP5IHRNRG6MZTFHTXLYRJLZH
<urn:uuid:5a0e384e-eae5-4852-832b-95dd1c400602>
https://samwilson.id.au/tag/archiving/
response
<urn:uuid:fa284e5a-6d1b-4ce2-afb1-c7caec505ffa>
robots: classic
hostname: ip-10-101-239-49.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2017-51
operator: Common Crawl Admin
description: Wide crawl of the web for December 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf