Part 4: Who’s Talking About The Future Of Newspapers?

In which we answer the question – what are they saying?

I’ve split the tweets up into two types – at replies, and not at replies, and a third which contains all tweets. I’ve created wordles of each one, for each of the 20 people we were following.

If you haven’t – check out wordle.net. It’s awesome.

There’s debate as to whether wordles are good ways to analyze text – definitely there are better ways (possibly to be explored in a future post) however I think they’re cool and here they have some utility. Note, though, that sizes of word are relative to the number of words in the data set for that individual, which are of varying size (see Part 1, Part 2, Part 3).

I don’t want to tread on Caitlin’s analysis (I’m just the data junkie), but some things you can see, aside from topics of discussion:

  • People who make a point of thanking others (most likely for retweets or similar)
  • People who retweet things that others have said about them
  • Where RT is conspicuous by it’s absence
  • Specific websites that get tweeted a lot

My personal favorite is Dave Winer’s all tweets! Let me know what you think.

Programming-wise, the code is trivial because wordle accepts free text. But, before I realized that the guy who wrote wordle was much smarter than me, I tried to be clever an optimize it by using a LinkedHashSet. I chose this data structure on the basis that – I wanted O(1) random access (the hash) because I would find the same words repeated, only one instance of each word (the set) and a nice quick iteration (the linked) so I could output a key, value table at the end. And then I discovered that there was no get() or elementAt() method – and stopped trying to be a smart-alec!

4 thoughts on “Part 4: Who’s Talking About The Future Of Newspapers?

  1. Yeah, I would totally just HashMap with a conditional creating new Integer entries if the key isn’t in there yet, and then just iterate over entrySet() at the end. You’ll be putting data into the hash much more frequently than iterating through it, anyway. =)

    Also, did you manually copy and paste, POST, or do some other funky hack for generating multiple Wordles?

    1. You are so right, I just wanted to use a LinkedHashSet. One day! In the end free text worked best and that’s what I needed for this week’s thing too.

      I C+P’d which was a pain. POST would have been better but I didn’t want to save stuff to a gallery because it can’t be deleted. Making public data more public is a privacy issue I’m conscious of :-s

Leave a Reply to Sacha Chua Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.
https://cate.blog/2010/08/18/part-4-who%E2%80%99s-talking-about-the-future-of-newspapers/?replytocom=876
cate.blog
crawl=CC-MAIN-2020-29
165650
application/http; msgtype=response
sha1:FTS6UMSTAONAONRN2GGTT42SVFFIKLXL
<urn:uuid:5f4ed44d-a776-4fc2-aad6-40dff6bb48ab>
2020-07-11T01:14:34Z
199.16.172.8
text/html
sha1:IZPP6QFEPHDVIX4HNWS5YBX63QIME2FW
<urn:uuid:043a7f58-9195-40b4-8bd5-aa295636fff5>
https://cate.blog/2010/08/18/part-4-who%E2%80%99s-talking-about-the-future-of-newspapers/?replytocom=876
response
<urn:uuid:27fbda5a-fc4f-4cf5-9fd9-89c5c8699240>
isPartOf: CC-MAIN-2020-29
publisher: Common Crawl
description: Wide crawl of the web for July 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-234.ec2.internal
software: Apache Nutch 1.17 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/