tMoA

Would you like to react to this message? Create an account in a few clicks or log in to continue.
tMoA

~ The only Home on the Web You'll ever need ~

    Government to receive archive of every tweet ever sent...

    Carol
    Carol
    Admin
    Admin


    Posts : 30168
    Join date : 2010-04-07
    Location : Hawaii

    Government to receive archive of every tweet ever sent... Empty Government to receive archive of every tweet ever sent...

    Post  Carol Tue Dec 06, 2011 2:44 pm

    Government to receive archive of every tweet ever sent... 4dbbb1ee0bc5231b000f6a7067003af3
    http://www.federalnewsradio.com/?nid=247&sid=2658996
    Government to receive archive of every tweet ever sent...
    Library of Congress to receive entire Twitter archive - Tweets, emails and other electronic communications can be considered "government documents" and must be preserved. The National Archives handles official government materials, while the Library of Congress' mandate is to deal with anything that may have long-term historical interest.

    "We're basically in the same situation as the National Archives, only on a much larger scale," said Bill Lefurgy, digital initiatives program manager at the Library of Congress national digital information infrastructure and preservation program. "We tend to have a much larger perspective in terms of what we collect." He joined the Federal Drive with Tom Temin and Amy Morris Tuesday morning to talk about the library's digital mission.

    But how much digital information are we talking about? How about all of the tweets from Twitter's archives?

    "We have an agreement with Twitter where they have a bunch of servers with their historic archive of tweets, everything that was sent out and declared to be public," Lefurgy said. The archives don't contain tweets that users have protected, but everything else — billions and billions of tweets — are there."

    Using new technical processes it has developed, Twitter is moving a large quantity of electronic data from one electronic source to another. "They've had to do some pretty nifty experimentation and invention to develop the tools and a process to be able to move all of that data over to us," Lefurgy said.

    The Library of Congress has long been the repository of important, historical documents and the Twitter library, as a whole, is something historic in itself.

    "We were excited to be involved with acquiring the Twitter archives because it's a unique record of our time," Lefurgy said. "It's also a unique way of communication. It's not so much that people are going to be interested in what you or I had for lunch, which some people like to say on Twitter."

    Researchers would be able to look at the Twitter archive as a complete set of data, which they could then data-mine for interesting information.

    "There have been studies involved with what are the moods of the public at various times of the day in reaction to certain kinds of news events," Lefurgy said. "There's all these interesting kinds of mixing and matching that can be done using the tweets as a big set of data."

    One benefit for the Library of Congress in receiving this large data set is that it's been forced to stretch itself technologically.

    "It's been difficult at times," Lefurgy said. "But we firmly believe that we have to do this kind of thing because we anticipate that we'll be bringing in large data sets again into the future. We don't know specifically what, but certainly there's no sign of data getting smaller or less complicated or less interesting."

    RELATED STORIES http://www.federalnewsradio.com/?nid=247&sid=2658996

    NARA to lay out steps for digital archives

    Agencies have 120 days to start getting e-records in shape




    _________________
    What is life?
    It is the flash of a firefly in the night, the breath of a buffalo in the wintertime. It is the little shadow which runs across the grass and loses itself in the sunset.

    With deepest respect ~ Aloha & Mahalo, Carol

      Current date/time is Wed May 31, 2023 7:20 pm
https://mistsofavalon.forumotion.com/t3573-government-to-receive-archive-of-every-tweet-ever-sent
mistsofavalon.forumotion.com
CC-MAIN-2023-23
52624
application/http; msgtype=response
sha1:FKQDOUFXD6Y4IMHG5FVDMCW7QPS22JPZ
<urn:uuid:34a62eba-a103-45e9-b7e3-3cb8fb15d477>
2023-06-01T00:20:29Z
178.33.44.177
text/html
sha1:BZ732YSHBLHAVAI5IR5MGTMCNVBHZ3LF
<urn:uuid:466c5668-0947-4915-a53d-e532b8a83676>
https://mistsofavalon.forumotion.com/t3573-government-to-receive-archive-of-every-tweet-ever-sent
response
<urn:uuid:6a614756-d27c-430b-acdc-ae19496346a6>
isPartOf: CC-MAIN-2023-23
publisher: Common Crawl
description: Wide crawl of the web for May/June 2023
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-140
software: Apache Nutch 1.19 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.4-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/