The Open UniversitySkip to content
 

Do citations and readership identify seminal publications?

Herrmannova, Drahomira; Patton, Robert M.; Knoth, Petr and Stahl, Christopher G. (2018). Do citations and readership identify seminal publications? Scientometrics (Early Access).

Full text available as:
Full text not publicly available (Accepted Manuscript)
Due to publisher licensing restrictions, this file is not available for public download until 10 February 2019
Click here to request a copy from the OU Author.
DOI (Digital Object Identifier) Link: https://doi.org/10.1007/s11192-018-2669-y
Google Scholar: Look up in Google Scholar

Abstract

This work presents a new approach for analysing the ability of existing research metrics to identify research which has strongly influenced future developments. More specifically, we focus on the ability of citation counts and Mendeley reader counts to distinguish between publications regarded as seminal and publications regarded as literature reviews by field experts. The main motivation behind our research is to gain a better understanding of whether and how well the existing research metrics relate to research quality. For this experiment we have created a new dataset which we call TrueImpactDataset and which contains two types of publications, seminal papers and literature reviews. Using the dataset, we conduct a set of experiments to study how citation and reader counts perform in distinguishing these publication types, following the intuition that causing a change in a field signifies research quality. Our research shows that citation counts work better than a random baseline (by a margin of 10%) in distinguishing important seminal research papers from literature reviews while Mendeley reader counts do not work better than the baseline.

Item Type: Journal Item
Copyright Holders: 2018 Akadémiai Kiadó
ISSN: 1588-2861
Keywords: information retrieval; scholarly communication; publication datasets; data mining; research evaluation; bibliometrics; altmetrics
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Related URLs:
Item ID: 53639
Depositing User: Petr Knoth
Date Deposited: 26 Feb 2018 10:05
Last Modified: 26 Feb 2018 10:05
URI: http://oro.open.ac.uk/id/eprint/53639
Share this page:

Metrics

Altmetrics from Altmetric

Citations from Dimensions

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU
http://oro.open.ac.uk/53639/
oro.open.ac.uk
crawl=CC-MAIN-2018-17
32077
application/http; msgtype=response
sha1:EBDJVFUIFWFWPD5GXOE6KI2N6VFHGQJV
<urn:uuid:9cc1eda6-e77a-44a0-b289-e58e88fefe29>
2018-04-25T23:59:33Z
137.108.200.18
application/xhtml+xml
sha1:YXJK6LXYFPL2LY326FUUWBV57XFHM54L
<urn:uuid:7545da4c-b621-45d3-b523-7125c1198f3f>
http://oro.open.ac.uk/53639/
length
response
<urn:uuid:012f147a-3305-4be7-877e-f0aa16fbfaea>
robots: classic
hostname: ip-10-109-231-228.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2018-17
operator: Common Crawl Admin
description: Wide crawl of the web for April 2018
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf