Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: High Quality Rather than High Model Probability: Minimum Bayes Risk
  Decoding with Neural Metrics   In Neural Machine Translation, it is typically assumed that the sentence with
the highest estimated probability should also be the translation with the
highest quality as measured by humans. In this work, we question this
assumption and show that model estimates and translation quality only vaguely
correlate. We apply Minimum Bayes Risk (MBR) decoding on unbiased samples to
optimize diverse automated metrics of translation quality as an alternative
inference strategy to beam search. Instead of targeting the hypotheses with the
highest model probability, MBR decoding extracts the hypotheses with the
highest estimated quality. Our experiments show that the combination of a
neural translation model with a neural reference-based metric, BLEURT, results
in significant improvement in human evaluations. This improvement is obtained
with translations different from classical beam-search output: these
translations have much lower model likelihood and are less favored by surface
metrics like BLEU.

32
The categories of this paper are: atom-ph
27
The categories of this paper are: comp-gas
11
The categories of this paper are: hep-lat
20
The categories of this paper are: acc-phys
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
4
The categories of this paper are: cond-mat
19
The categories of this paper are: eess
10
The categories of this paper are: q-bio
12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin
2
The categories of this paper are: math