Abstract

Citation indices are tools used by the academic community for research and research evaluation which aggregate scientific literature output and measure impact by collating citation counts. Citation indices help measure the interconnections between scientific papers but fall short because they fail to communicate contextual information about a citation. The usage of citations in research evaluation without consideration of context can be problematic, because a citation that presents contrasting evidence to a paper is treated the same as a citation that presents supporting evidence. To solve this problem, we have used machine learning, traditional document ingestion methods, and a network of researchers to develop a “smart citation index” called scite, which categorizes citations based on context. Scite shows how a citation was used by displaying the surrounding textual context from the citing paper and a classification from our deep learning model that indicates whether the statement provides supporting or contrasting evidence for a referenced work, or simply mentions it. Scite has been developed by analyzing over 25 million full-text scientific articles and currently has a database of more than 880 million classified citation statements. Here we describe how scite works and how it can be used to further research and research evaluation.

Peer Review

https://publons.com/publon/10.1162/qss_a_00146

This content is only available as a PDF.
This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. For a full description of the license, please visit https://creativecommons.org/licenses/by/4.0/legalcode.

Article PDF first page preview

Article PDF first page preview
https://direct.mit.edu/qss/article/doi/10.1162/qss_a_00146/102990/scite-a-smart-citation-index-that-displays-the
direct.mit.edu
crawl=CC-MAIN-2021-31
98690
application/http; msgtype=response
sha1:SY2XWN7Q37LY7I4NZCV67JPWBMYJPVLM
<urn:uuid:4dc30d18-b3d6-4593-b512-d77bf1ca42eb>
2021-07-25T17:02:20Z
52.179.114.94
text/html
sha1:G6L2WYSK3EM5DEZLDWTSB34NYFCVNJBY
<urn:uuid:654f0aaf-6584-40c9-a018-503b1a09d60b>
https://direct.mit.edu/qss/article/doi/10.1162/qss_a_00146/102990/scite-a-smart-citation-index-that-displays-the
response
<urn:uuid:a259c55f-58ee-417f-bb11-bcd47a62ddf9>
isPartOf: CC-MAIN-2021-31
publisher: Common Crawl
description: Wide crawl of the web for July/August 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-204.ec2.internal
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/