Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Evaluating Machine Translation Performance on Chinese Idioms with a
  Blacklist Method   Idiom translation is a challenging problem in machine translation because the
meaning of idioms is non-compositional, and a literal (word-by-word)
translation is likely to be wrong. In this paper, we focus on evaluating the
quality of idiom translation of MT systems. We introduce a new evaluation
method based on an idiom-specific blacklist of literal translations, based on
the insight that the occurrence of any blacklisted words in the translation
output indicates a likely translation error. We introduce a dataset, CIBB
(Chinese Idioms Blacklists Bank), and perform an evaluation of a
state-of-the-art Chinese-English neural MT system. Our evaluation confirms that
a sizable number of idioms in our test set are mistranslated (46.1%), that
literal translation error is a common error type, and that our blacklist method
is effective at identifying literal translation errors.

20
The categories of this paper are: acc-phys
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
23
The categories of this paper are: solv-int
26
The categories of this paper are: bayes-an
24
The categories of this paper are: dg-ga
12
The categories of this paper are: nucl-th
14
The categories of this paper are: math-ph
31
The categories of this paper are: ao-sci
25
The categories of this paper are: patt-sol
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
29
The categories of this paper are: funct-an
10
The categories of this paper are: q-bio
13
The categories of this paper are: quant-ph
0
The categories of this paper are: hep-ph