Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Unified Strategy for Multilingual Grammatical Error Correction with
  Pre-trained Cross-Lingual Language Model   Synthetic data construction of Grammatical Error Correction (GEC) for
non-English languages relies heavily on human-designed and language-specific
rules, which produce limited error-corrected patterns. In this paper, we
propose a generic and language-independent strategy for multilingual GEC, which
can train a GEC system effectively for a new non-English language with only two
easy-to-access resources: 1) a pretrained cross-lingual language model (PXLM)
and 2) parallel translation data between English and the language. Our approach
creates diverse parallel GEC data without any language-specific operations by
taking the non-autoregressive translation generated by PXLM and the gold
translation as error-corrected sentence pairs. Then, we reuse PXLM to
initialize the GEC model and pretrain it with the synthetic data generated by
itself, which yields further improvement. We evaluate our approach on three
public benchmarks of GEC in different languages. It achieves the
state-of-the-art results on the NLPCC 2018 Task 2 dataset (Chinese) and obtains
competitive performance on Falko-Merlin (German) and RULEC-GEC (Russian).
Further analysis demonstrates that our data construction method is
complementary to rule-based approaches.

20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
32
The categories of this paper are: atom-ph
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
19
The categories of this paper are: eess
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
24
The categories of this paper are: dg-ga
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
2
The categories of this paper are: math