Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Corpora Generation for Grammatical Error Correction   Grammatical Error Correction (GEC) has been recently modeled using the
sequence-to-sequence framework. However, unlike sequence transduction problems
such as machine translation, GEC suffers from the lack of plentiful parallel
data. We describe two approaches for generating large parallel datasets for GEC
using publicly available Wikipedia data. The first method extracts
source-target pairs from Wikipedia edit histories with minimal filtration
heuristics, while the second method introduces noise into Wikipedia sentences
via round-trip translation through bridge languages. Both strategies yield
similar sized parallel corpora containing around 4B tokens. We employ an
iterative decoding strategy that is tailored to the loosely supervised nature
of our constructed corpora. We demonstrate that neural GEC models trained using
either type of corpora give similar performance. Fine-tuning these models on
the Lang-8 corpus and ensembling allows us to surpass the state of the art on
both the CoNLL-2014 benchmark and the JFLEG task. We provide systematic
analysis that compares the two approaches to data generation and highlights the
effectiveness of ensembling.

19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
33
The categories of this paper are: plasm-ph
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
3
The categories of this paper are: physics
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
6
The categories of this paper are: astro-ph
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th