Using BibTeX to Automatically Generate Labeled Data for Citation Field ExtractionDownload PDF

14 Feb 2020 (modified: 09 Jun 2020)AKBC 2020 Conference Blind SubmissionReaders: Everyone
  • Keywords: sequence labeling, information extraction, auto-generated dataset
  • TL;DR: We propose a reliable way to generate citation field extraction dataset from BibTeX. Training models on our dataset achieves new SoTa on UMass CFE dataset.
  • Subject Areas: Information Extraction, Applications, Machine Learning
  • Archival Status: Archival
  • Abstract: Accurate parsing of citation reference strings is crucial to automatically construct scholarly databases such as Google Scholar or Semantic Scholar. Citation field extraction (CFE) is precisely this task---given a reference label which tokens refer to the authors, venue, title, editor, journal, pages, etc. Most methods for CFE are supervised and rely on training from labeled datasets that are quite small compared to the great variety of reference formats. BibTeX, the widely used reference management tool, provides a natural method to automatically generate and label training data for CFE. In this paper, we describe a technique for using BibTeX to generate, automatically, a large-scale 41M labeled strings), labeled dataset, that is four orders of magnitude larger than the current largest CFE dataset, namely the UMass Citation Field Extraction dataset [Anzaroot and McCallum, 2013]. We experimentally demonstrate how our dataset can be used to improve the performance of the UMass CFE using a RoBERTa-based [Liu et al., 2019] model. In comparison to previous SoTA, we achieve a 24.48% relative error reduction, achieving span level F1-scores of 96.3%.
9 Replies

Loading
https://openreview.net/forum?id=OnUd3hf3o3
openreview.net
crawl=CC-MAIN-2020-45
21835
application/http; msgtype=response
sha1:E75HVAWUWW2HRG4EGNZ3RWITRC67UFAE
<urn:uuid:09f6ee0b-2595-4acb-86d4-dc466c63c8fb>
2020-10-28T14:34:12Z
35.184.86.251
text/html
sha1:2FZFR23G3CK5NOQLQOSMURMAC2ZTOZZO
<urn:uuid:4933617f-68a6-4ed8-997e-d263aa48420d>
https://openreview.net/forum?id=OnUd3hf3o3
response
<urn:uuid:8037c6e2-a7f8-4f73-9e2c-661a34b68b0e>
isPartOf: CC-MAIN-2020-45
publisher: Common Crawl
description: Wide crawl of the web for October 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-248.ec2.internal
software: Apache Nutch 1.17 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/