The Library of Congress Will No Longer Archive Your Garbage Tweets

Where the bad tweets are housed.

The Library of Congress announced today that it is changing the way that it archives tweets, which it has been doing since 2010. Yes, in case you didn’t know, the LOC reached an agreement with Twitter a few years ago to create an archive of every tweet ever posted since the site’s inception. But now, that system is coming to an end, and instead, the Library will archive tweets selectively. In other words, tweets from our Fox News–addict president will probably make the cut, tweets from your Fox News–addict uncle probably won’t.

There are three primary reasons, as outlined by the LOC. Firstly, there are a lot more tweets being posted now than there were in 2010 when the agreement with Twitter was reached. That increases storage and bandwidth costs considerably. Twitter doubling its character length presumably exacerbates this issue.

Secondly, the Library doesn’t save multimedia, only text. So important videos and images posted to the service don’t go to the archive, just the “pic.twitter.com/blahblahblah” media URL, which is next to useless.

The final reason is that the dragnet Twitter collection policy doesn’t really fall in line with the Library’s general, more selective policy. “Given the unknown direction of social media when the gift was first planned, the Library made an exception for public tweets. With social media now established, the Library is bringing its collecting practice more in line with its collection policies,” the agency wrote.

You can’t access the archive yet because the Library has not yet figured out how to do so. It must take into account “respect [for] the intent of the producers of the content; honor donor (Twitter) access requirements; and manage taxpayer-provided resources wisely.” There is no timetable for enabling access.

The good news is that you no longer have to worry about your horrible jokes being preserved by the federal government for all eternity. The bad news is that starting on January 1, 2018, you can no longer get tweets like “I love pee pee poo poo” preserved by the federal government for all eternity, which is really funny to think about.

The Government Will No Longer Archive Your Bad Tweets
http://nymag.com/selectall/2017/12/the-government-will-no-longer-archive-your-bad-tweets.html
nymag.com
crawl=CC-MAIN-2018-34
733009
application/http; msgtype=response
sha1:3MKFKMRTUCKBV6PMCNVMHXJSBMTMXQ2O
<urn:uuid:c6720474-aa03-4d23-a962-f702d7a33614>
2018-08-14T20:02:14Z
151.101.64.70
text/html
sha1:RHLOFZE2HPMHIAQTJXWGQKF735BRHW52
<urn:uuid:3de2f5b3-98f7-42aa-b97c-05ad08f54870>
http://nymag.com/selectall/2017/12/the-government-will-no-longer-archive-your-bad-tweets.html
response
<urn:uuid:c06f6f0c-a460-461a-921a-fe970ab444f8>
isPartOf: CC-MAIN-2018-34
publisher: Common Crawl
description: Wide crawl of the web for August 2018
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-65-78-181.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/