Monthly Archives: December 2012

The Archive Project


December 4, 2012 at 1:34 pm (One Comment)

Ideas are funny things.  Some are fleeting: You’ll be reading your twitter stream, one will pop into your head, and two tweets further it’s gone.  Sometimes you can backtrack, reconstruct your experience and get it back.  Sometimes it’s gone forever.  Other ideas stick with you.  They nestle into your brain and make a home for themselves, popping up when you read something tangentially related, or when you’re staring at the blank sheet of a new project.

For me, The Archive is that idea.

Prologue

As a kid I really loved anecdotal stories.  One of my favorites were a series of sermons told in the form of the life story of a missionary named Otto Koning, relating the lessons he learned working with a tribe in New Guinea.  Otto is a masterful storyteller, and I probably listened to the tapes dozens of times.  Hearing him describe his experiences almost made you feel like you were there, and gave a really unique insight into a time and place that would have otherwise been undocumented.

Chad and the San Marcos dialup stack (circa early 1996).

When I started working my first internet job at a small ISP in San Marcos, Texas in 1995, I began to spend a lot of time riding shotgun on tech support house calls with Chad Neff.  By now Chad has probably fixed half of the computers in San Marcos, but before he became the town’s resident Internet Guy, he had an entire career as an artist and printmaker.  You still see his work popping up on eBay, and his prints as set dressing on movies and TV shows, especially Star Trek: The Next Generation.  Chad also did a stint in the Army, in signals intelligence, plus a bunch of years in the Mounted Park Patrol and Police Reserve.  Needless to say, Chad has a lot of stories.

When Chad wasn’t telling stories, we’d brainstorm the big idea that was going to make us internet millionaires (back then being a millionaire was an impressive thing). One of the ideas that we had, probably on the way to one of San Marcos’s funeral homes (Chad designed the awning over the entrance to one of them), was the Permanent Internet Memorial.  The internet has the unique ability, compared to traditional headstones, of actually telling you something about a person that’s longer than a few sentences.  We knew back then that storage and bandwidth were just going to get cheaper, so it seemed like a logical idea: Start a company designed to last forever, and charge a one-time fee to create a permanent memorial on the web.

Needless to say, the idea didn’t go any further than that ride, but the core concept of extended longevity on the internet, mashed up with the explosion in self publishing and data driven explorable sites eventually coalesced into the idea for The Archive Project.  These ideas solidified in early 2000, and this is the concept as I had it then:

The Idea

The Archive Project is a web database for personal stories, index-able by place, theme, time, person and object.  The building block of The Archive is the story, a personal anecdote about something that happened to you.  Once you’ve created a story, you tell the system where it happened, when it happened, and you can tag other people in it.

There’s a great story behind these shoes, but the flickr page only tells a little bit of it.

Users would be able to tag people in stories that may or may not be users.  Eventually if a user signed up, they could claim all those people tags as themselves, assuming the original author validated it was really them.

I think I was designing this system before geocoders were as prevalent as they are now, because I actually requested and received a burned DVD copy of the USGS’s global gazetteer.  The idea was you’d be able to type a place name like Austin, Texas into the system and the site would be able to drop the story on a map, which you could then make precision modifications to.  With Open Street Map this is really easy, but at the time it was still something of an unknown.

When pinning a story in time, you’d be able to say broad things like The Early 50′s or Spring 1976, or burrow down to specific dates.  You’d be able to put together strands of memories into an overall story, like Our Year In Paris.

My goal was to create a site where people would be able to publish their life story, like the vanity autobiography publishers of yesteryear.  By wrapping the anecdotes that make up a life story in semantic data, you’d be able to surf through the system in what I hoped would be really interesting ways.  You’d be able to explore stories from people who lived in San Francisco in the 60s, or who migrated from the midwest to New York in the 70s, read about what it was like from an adult point of view when you were growing up.  You could read stories by people who travelled great distances when they were young, or from people who stayed in the same place their whole lives.  You’d be able to read stories about sewing machines in New York or stories about cars in Arizona.  You’d be able to find a narrative across all kinds of contexts.

Let’s record some stories.

Some stories would have associated media, photos or audio recordings or video.  It would be like a museum for the human race, the opportunities for interesting curation would be enormous.

For the authors, the people who contributed content to the site, they would know that The Archive existed solely to serve as a caretaker for their stories.  Like Wikipedia it wouldn’t be sold, and their kids and grandkids and great-grandkids could add new stories to theirs, and their contribution would be part of a permanent family history.

There’s even an opportunity to have a Real and Fictional versions of the Archive, where fans could assemble consolidated versions of their favorite stories or characters lives.  For instance, on December 18th, 2009 in Colorado, Jeff Winger had a fight with some fly dancers, and was rescued by his friends.

Imagine the mobile possibilities: You could be standing in a random location, open an Archive browser app, and read stories that happened there before.  There’s nothing stopping museums, or a place like Mount Vernon from creating stories from George Washington’s life.

The Archive Project never got beyond dreams and some rough architecture diagrams.  I knew what I wanted to build, but the scope was large and I knew it would be difficult to promote.  It would be way too easy to fail, and once you accepted your first story from a user, you would be honor bound to host the thing forever.

Present Tense

Things are a little different now.  It’s become possible to host vanity projects, even at a reasonable size, for not that much money.  Creating socially conscious organizations is easier than it was, and there’s more support.  Most importantly, though, over the last dozen years we’ve gotten really good at creating database centric social web sites without reinventing the wheel.  Personally, I learned a lot of lessons from building Specialized Bicycle Components social network, the Riders Club.  Specifically, features don’t matter if they aren’t easy to use, and in the end you’re really there to enable their use of the site, they’re not there to populate your dream.

Privacy was always a sticky wicket with the archive project.  It could be a gold mine for identity theft, mostly in enabling spear phishing social engineering, but these days the risk is less, I think, because people realize that so much of their lives are already available to people who want to know.  The reward from publishing your memories is greater than the risk of someone doing something bad with them.

Aaron Cope’s talk at the New Zealand National Digital Forum sparked some interesting thoughts about The Archive, since it’s essentially a catalog of memories.  The idea of assigning artisinal integers to each memory, and building the entire thing in a way that it can be human shardable (something I’m going to write a blog post about soon), makes a lot of sense.  Having the system be able to collate data from both a centrally hosted repository and a network of individual Archive sites that individuals could run themselves or for a group would be really powerful, and act as protection against the collapse of the central site.

I think you could prototype a version of The Archive pretty quickly these days, and I may spend part of early next year doing just that.  I think the idea is still valid, and if things like Storify have shown us anything, it’s that people crave narrative.

Conclusion

The Archive is one of those things I want to exist.  If Wikimedia had something like this already that wasn’t a wiki (I don’t think people should be able to edit others stories unless they have permission), I’d put this idea to bed.  But it hasn’t happened, and it needs to.

Interviewing my parents on video. Not everyone has this chance.

We have the technology to record and share our experiences.  We could hold on to our history, but we’re letting it slip through our fingers.  The best stories get passed on to the kids, and maybe to the grand kids, but a few generations out the person is just an entry on a family tree.  I’ve interviewed my parents on video about their lives, but I don’t have a place to put it, or best practices on how to turn it into something other people could learn from, so the project has stalled.  Individual communities have started story archiving projects, and there are Best Of or focused media collections like StoryCorps, but nobody’s taken this to the web, to make it easy for everyone.

So let’s make it happen.  If you’re interested in working on The Archive, if you have thoughts or ideas, or if you know of a project like it that already exists, drop me a line.

 

Future Cool


December 2, 2012 at 1:50 pm (No Comments)

Nassim Taleb, author of The Black Swan and former derivatives trader, is doing a tour for his new book Antifragile: Things That Gain From Disorder.  As part of that tour he has an excerpt up on Salon entitled The Future Will Not Be Cool.  Go read it, I’ll wait.

I have some issues with the Salon piece, though I think it’s being spun as something it isn’t, and probably makes more sense in the context of the book.  The central thesis is that the future we see in films and sci-fi books is not the future we get, and having attended a bunch of TED style events, Mr. Taleb wants us to remember that in the end the future looks a lot like the present, just with things taken away.

The arguments Mr. Taleb makes are fair, but he may be overstating the problem, and he may not be in a position to see the more exotic future he’s arguing against.

When people write science fiction, come up with TED talks or make movies, they’re looking for a hook, an idea that fires the imagination.  If Jules Verne had written about the washing machine, people would not have been slack-jawed, but you can’t deny the impact that it has had on society.  The fact that the waitress, hostess or even chef at the restaurant mentioned in the excerpt might have been a minority mother of young children attests to the fact that things have changed considerably for a lot of people.

The thing that Nassim Taleb and I have in common is that we’re privileged non-repressed-minority men.  For us, things have generally been good for a while, and radical change hasn’t presented in our lives.  If you can afford to send your kids to a good school, Khan Academy and Wikipedia aren’t as big of an innovation as if you’re working two jobs and can barely afford to keep food on the table.  Perhaps the future is the privileged past, more evenly distributed.  For people it impacts, that future is pretty cool, and more cool than robotic butlers or flying cars.

I accept Mr. Taleb’s argument that people should pay more attention to the past, but to be fair, Mr. Taleb’s grandfathers were deputy prime ministers, his parents were academics, and he went to the University of Paris and The Wharton School.  My parents were missionaries and I went to public school in Texas, but had access to the Internet and a computer.  One of us has the ability to appreciate and understand literature and literary culture and one of us has the ability to appreciate technological innovation and create a little bit of that future.

I’d love to be more aware of literary culture, but I can’t go from where I’m at directly to Plato and Homer and appreciate it like I can appreciate a new Charles Stross, Neal Stephenson or William Gibson book.  To be totally honest, I’ve even had a hard time appreciating some of Bruce Sterling’s recent work.  Maybe what I need is a Code Academy or Khan Academy for Plato or Phidias, and maybe in the next few years that will happen.  If the kids down on the block are comparing graffiti tags to Canova, maybe that will be the future Mr. Taleb’s looking for.

My copy of Antifragile is on it’s way from Amazon, and I’m sure I’ll appreciate it as much as I did The Black Swan and Fooled By Randomness.  Hopefully this excerpt will make more sense in context.
http://www.jeffkramer.com/2012/12/
www.jeffkramer.com
crawl=CC-MAIN-2014-23
47831
application/http; msgtype=response
sha1:VDKTAO6MRYV7QIZ7KCTCTCZS7M2X2ZBE
<urn:uuid:9e69d318-c9d5-455b-baac-fb4907837c57>
2014-07-24T22:57:55Z
198.58.99.114
sha1:M65J7ZZOEQ4XNVZE5Q3YVF2KUYSNPV4L
<urn:uuid:2eac6e47-0ad6-4bd7-955c-1c4eafe0dc72>
http://www.jeffkramer.com/2012/12/
length
response
<urn:uuid:c5d4424a-e626-4f45-93b3-a4bb6e8f5591>
robots: classic
hostname: ip-10-33-131-23.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-23
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for July 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf