Research Datasets

To help promote research transparency and replicability, we make available the raw datasets collected and used in our research projects. These datasets are provided with no guarantee of completeness or accuracy.  No fees are charged for use of our datasets. If you do use our datasets in your research, please acknowledge the authors of the original study in any related publication, and cite the work in which the dataset was first used.

Heading 1

01

Comment Mining Dataset

This dataset was first used in:

I. Yahav, O. Shehory and D. Schwartz, "Comments Mining With TF-IDF: The Inherent Bias and Its Removal," in IEEE Transactions on Knowledge and Data Engineering, vol. 31, no. 3, pp. 437-450, 1 March 2019.

SocIntLab

Social Information Technologies for a Better World

© 2014, 2015, 2016, 2017, 2018 

By David G. Schwartz
https://www.socialintelligencelab.org/research-datasets
www.socialintelligencelab.org
crawl=CC-MAIN-2021-04
177049
application/http; msgtype=response
sha1:ZMNZXCOX5RAT3L65NVONJVIMBGDKF6BO
<urn:uuid:38dc2d54-4ea1-4848-823b-5456f014e74c>
2021-01-26T15:17:33Z
185.230.60.102
text/html
sha1:MW7YJDBEMIPZK6O65XOVWWOT66DCYRT5
<urn:uuid:cac9f167-67d6-4ef3-8d7c-397eec07e728>
https://www.socialintelligencelab.org/research-datasets
response
<urn:uuid:6657bf17-d382-4e95-b2f9-8c0f5c66a0d9>
isPartOf: CC-MAIN-2021-04
publisher: Common Crawl
description: Wide crawl of the web for January 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-33.ec2.internal
software: Apache Nutch 1.17 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/