Dataset Open Access

Pilot study: Ranking of textual snippets based on the writing style

Andi Rexha; Mark Kröll; Hermann Ziak; Roman Kern

In this pilot study, we tried to capture humans' behavior when identifying authorship of text snippets. At first, we selected textual snippets from the introduction of scientific articles written by single authors. Later, we presented to the evaluators a source and four target snippets, and then, ask them to rank the target snippets from the most to the least similar from the writing style.

The dataset is composed by 66 experiments manually checked for not having any clear hint during the ranking for the evaluators. For each experiment, we have evaluations from three different evaluators.

We present each experiment in a single line (in the CSV file), where, at first we present the metadata of the Source-Article (Journal, Title, Authorship, Snippet), and the metadata for the 4 target snippets (Journal, Title, Authorship, Snippet, Written From the same Author, Published in the same Journal) and the ranking given by each evaluator. This task was performed in the open source platform, Crowd Flower. 

The headers of the CSV are self-explained. In the TXT file, you can find a human-readable version of the experiment. 

For more information about the extraction of the data, please consider reading our paper: "Extending Scientific Literature Search by Including the Author’s Writing Style" @BIR: http://www.gesis.org/en/services/events/events-archive/conferences/ecir-workshops/ecir-workshop-2017 

Acknowledgements: The Know-Center is funded within the Austrian COMET Program under the auspices of the Austrian Ministry of Transport, Innovation and Technology, the Austrian Ministry of Economics and Labour and by the State of Styria. COMET is managed by the Austrian Research Promotion Agency FFG.
Files (510.8 kB)
Name Size
result-pilot-study.csv
md5:3b2932a6c36c025878b2c1c252f83d20
225.6 kB Download
result-pilot-study.txt
md5:21a724476e9101a492e51c45fdfcc6c1
285.3 kB Download
712
224
views
downloads
All versions This version
Views 712713
Downloads 224224
Data volume 53.0 MB53.0 MB
Unique views 701702
Unique downloads 197197

Share

Cite as
https://zenodo.org/record/437461
zenodo.org
crawl=CC-MAIN-2021-21
37824
application/http; msgtype=response
sha1:46EBYFGABFJSGNE4XS6G5Y45NIL4CWXS
<urn:uuid:b3a3b668-5046-4a15-ae05-34654d15665c>
2021-05-15T15:25:47Z
137.138.76.77
text/html
sha1:Y2KETECJOSJHMVUPZNGESCUP3H2KNTN2
<urn:uuid:b240ee3b-f62b-4fca-a828-2f39e1fc44ae>
https://zenodo.org/record/437461
response
<urn:uuid:fad63d3a-fd1c-42c8-82a6-43a9b62e83c2>
isPartOf: CC-MAIN-2021-21
publisher: Common Crawl
description: Wide crawl of the web for May 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-101.ec2.internal
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/