Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Corpus Conversion Service: A Machine Learning Platform to Ingest
  Documents at Scale   Over the past few decades, the amount of scientific articles and technical
literature has increased exponentially in size. Consequently, there is a great
need for systems that can ingest these documents at scale and make the
contained knowledge discoverable. Unfortunately, both the format of these
documents (e.g. the PDF format or bitmap images) as well as the presentation of
the data (e.g. complex tables) make the extraction of qualitative and
quantitive data extremely challenging. In this paper, we present a modular,
cloud-based platform to ingest documents at scale. This platform, called the
Corpus Conversion Service (CCS), implements a pipeline which allows users to
parse and annotate documents (i.e. collect ground-truth), train
machine-learning classification algorithms and ultimately convert any type of
PDF or bitmap-documents to a structured content representation format. We will
show that each of the modules is scalable due to an asynchronous microservice
architecture and can therefore handle massive amounts of documents.
Furthermore, we will show that our capability to gather ground-truth is
accelerated by machine-learning algorithms by at least one order of magnitude.
This allows us to both gather large amounts of ground-truth in very little time
and obtain very good precision/recall metrics in the range of 99\% with regard
to content conversion to structured output. The CCS platform is currently
deployed on IBM internal infrastructure and serving more than 250 active users
for knowledge-engineering project engagements.

31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
26
The categories of this paper are: bayes-an
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
0
The categories of this paper are: hep-ph
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
12
The categories of this paper are: nucl-th
35
The categories of this paper are: mtrl-th
23
The categories of this paper are: solv-int