Crowdsourcing the analysis of scholarly tweets

In December Euan Adie and I started the CrowdoMeter project, an analysis of the semantic content of tweets linking to scholarly papers. Because classifying almost 500 tweets is a lot of work, we turned this into a crowdsourcing project. We got help from 36 people, who did 953 classifications, and we discussed the preliminary results (available here) at the ScienceOnline2012 conference.

There is no reason to stop the crowdsourcing here, so we have uploaded the result set to figshare and invite everybody to help us with the data analysis. For this purpose I have created a public repository on Github which contains not only the source code for the CrowdoMeter website, but also all data – the same dataset made available on figshare. I have written a first R script that produces the following pie chart:

The figure doesn’t look all that exciting, but there is some calculation involved. There are different numbers of classifications per tweet and sometimes there is disagreement: true means at least 50% of classifications were true. It would be great if we find people willing to help with data analysis, preferably using R and contributing their scripts to the Github repository. Please send me an email or contact me via Twitter if you need write access to the repository.

Related Posts Plugin for WordPress, Blogger...
This entry was posted in Conferences, Interviews, Presentations, Recipes, ResearchBlogging, Reviews, Snippets, Thoughts and tagged , , . Bookmark the permalink.

One Response to Crowdsourcing the analysis of scholarly tweets

  1. Pingback: PLoS Article-Level Metrics: Interview with Martin Fenner | Gobbledygook
http://blogs.plos.org/mfenner/2012/02/19/crowdsourcing-the-analysis-of-scholarly-tweets/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+plos%2Fblogs%2Fmfenner+%28Blogs+-+Gobbledygook%29
blogs.plos.org
crawl=CC-MAIN-2014-35
67780
application/http; msgtype=response
sha1:FAVIPZCYHMUOEJZ7C4IS244P4QOAVAEC
<urn:uuid:81c75b4c-3198-40cc-af15-0a622660b998>
2014-08-20T18:30:09Z
149.20.69.12
sha1:7JCNII7MCA3HSLYROG46HWQZ2CR3IKE5
<urn:uuid:814f096f-46e6-4245-a29d-77c180ed0620>
http://blogs.plos.org/mfenner/2012/02/19/crowdsourcing-the-analysis-of-scholarly-tweets/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+plos%2Fblogs%2Fmfenner+%28Blogs+-+Gobbledygook%29
response
<urn:uuid:fbac8cf5-2f0a-4cf4-8dd5-20c1695c3b88>
robots: classic
hostname: ip-10-180-136-8.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-35
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for August 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf