Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Neural Grammatical Error Correction System Built On Better
  Pre-training and Sequential Transfer Learning   Grammatical error correction can be viewed as a low-resource
sequence-to-sequence task, because publicly available parallel corpora are
limited. To tackle this challenge, we first generate erroneous versions of
large unannotated corpora using a realistic noising function. The resulting
parallel corpora are subsequently used to pre-train Transformer models. Then,
by sequentially applying transfer learning, we adapt these models to the domain
and style of the test set. Combined with a context-aware neural spellchecker,
our system achieves competitive results in both restricted and low resource
tracks in ACL 2019 BEA Shared Task. We release all of our code and materials
for reproducibility.

9
The categories of this paper are: nlin
7
The categories of this paper are: hep-th
31
The categories of this paper are: ao-sci
33
The categories of this paper are: plasm-ph
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph
6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
16
The categories of this paper are: stat
35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex