e-space
Manchester Metropolitan University's Research Repository

Deep context of citations using machine‑learning models in scholarly full‑text articles

Hassan, Saeed-Ul, Imran, Mubashir, Iqbal, Sehrish, Aljohani, Naif Radi and Nawaz, Raheel (2018) Deep context of citations using machine‑learning models in scholarly full‑text articles. Scientometrics, 117 (3). ISSN 0138-9130

[img]
Preview

Download (1MB) | Preview

Abstract

Information retrieval systems for scholarly literature rely heavily not only on text matching but on semantic- and context-based features. Readers nowadays are deeply interested in how important an article is, its purpose and how influential it is in follow-up research work. Numerous techniques to tap the power of machine learning and artificial intelligence have been developed to enhance retrieval of the most influential scientific literature. In this paper, we compare and improve on four existing state-of-the-art techniques designed to identify influential citations. We consider 450 citations from the Association for Computational Linguistics corpus, classified by experts as either important or unimportant, and further extract 64 features based on the methodology of four state-of-the-art techniques. We apply the Extra-Trees classifier to select 29 best features and apply the Random Forest and Support Vector Machine classifiers to all selected techniques. Using the Random Forest classifier, our supervised model improves on the state-of-the-art method by 11.25%, with 89% Precision-Recall area under the curve. Finally, we present our deep-learning model, the Long Short-Term Memory network, that uses all 64 features to distinguish important and unimportant citations with 92.57% accuracy.

Impact and Reach

Statistics

Activity Overview
6 month trend
457Downloads
6 month trend
272Hits

Additional statistics for this dataset are available via IRStats2.

Altmetric

Actions (login required)

View Item View Item
https://e-space.mmu.ac.uk/621788/
e-space.mmu.ac.uk
crawl=CC-MAIN-2022-27
41771
application/http; msgtype=response
sha1:D64JDOBO3Q7M4WZV6FFDXF2WEBHNBUNZ
<urn:uuid:d1356c39-7cfa-4327-8537-51fbf42792e1>
2022-06-28T15:35:33Z
128.86.236.95
application/xhtml+xml
sha1:C6PJ5AGMKK442RKNWOO6TRXEINGTUA5B
<urn:uuid:759800ae-5561-45ff-97eb-8b4bc0fc539e>
https://e-space.mmu.ac.uk/621788/
response
<urn:uuid:1717c4f8-2fc7-4c86-b445-029a51e68c06>
isPartOf: CC-MAIN-2022-27
publisher: Common Crawl
description: Wide crawl of the web for June/July 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-153
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.3-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/