Software Open Access

count-love/protest-data: Data through 01/31/2021

Nathan Perkins; Tommy Leung

This is an annotated dataset of news article URLs that potentially contain reports about protest events in the United States between January 2017 and January 2021. These URLs were collected (1) automatically, via a crawler that searched local news and metro section homepages for the protest stem words "rally," "march," "protest," or "demonstration;" and (2) manually, via web searches for known missing reports (such as missing news articles about planned protests as part of a national march).

Files (9.9 MB)
Name Size
count-love/protest-data-2021-01-31.zip
md5:270b64942e816fc70bded536c3f586d4
9.9 MB Download
118
5
views
downloads
All versions This version
Views 11815
Downloads 53
Data volume 40.7 MB29.6 MB
Unique views 10415
Unique downloads 53

Share

Cite as
https://zenodo.org/record/4485243
zenodo.org
crawl=CC-MAIN-2022-21
32633
application/http; msgtype=response
sha1:U3JOBPWUZQSK2GEHBHMA5CP5JEKLTBDE
<urn:uuid:b159e7c5-d62c-4e1c-9daa-ab520b0a6dff>
2022-05-28T04:59:40Z
137.138.76.77
text/html
sha1:HDUYIGK5MFG36VWGY5MIC7SZD2QNGRDH
<urn:uuid:f64428d6-b78f-4e52-aa7c-59c7a6e9f112>
https://zenodo.org/record/4485243
response
<urn:uuid:14908e46-96b0-46b5-a3ee-6cc98cfcf31a>
isPartOf: CC-MAIN-2022-21
publisher: Common Crawl
description: Wide crawl of the web for May 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-55
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.3-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/