Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Original or Translated? A Causal Analysis of the Impact of
  Translationese on Machine Translation Performance   Human-translated text displays distinct features from naturally written text
in the same language. This phenomena, known as translationese, has been argued
to confound the machine translation (MT) evaluation. Yet, we find that existing
work on translationese neglects some important factors and the conclusions are
mostly correlational but not causal. In this work, we collect CausalMT, a
dataset where the MT training data are also labeled with the human translation
directions. We inspect two critical factors, the train-test direction match
(whether the human translation directions in the training and test sets are
aligned), and data-model direction match (whether the model learns in the same
direction as the human translation direction in the dataset). We show that
these two factors have a large causal effect on the MT performance, in addition
to the test-model direction mismatch highlighted by existing work on the impact
of translationese. In light of our findings, we provide a set of suggestions
for MT training and evaluation. Our code and data are at
https://github.com/EdisonNi-hku/CausalMT

0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
20
The categories of this paper are: acc-phys
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg
9
The categories of this paper are: nlin
3
The categories of this paper are: physics
19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
37
The categories of this paper are: supr-con
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org