Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multimodal Compact Bilinear Pooling for Multimodal Neural Machine
  Translation   In state-of-the-art Neural Machine Translation, an attention mechanism is
used during decoding to enhance the translation. At every step, the decoder
uses this mechanism to focus on different parts of the source sentence to
gather the most useful information before outputting its target word. Recently,
the effectiveness of the attention mechanism has also been explored for
multimodal tasks, where it becomes possible to focus both on sentence parts and
image regions. Approaches to pool two modalities usually include element-wise
product, sum or concatenation. In this paper, we evaluate the more advanced
Multimodal Compact Bilinear pooling method, which takes the outer product of
two vectors to combine the attention features for the two modalities. This has
been previously investigated for visual question answering. We try out this
approach for multimodal image caption translation and show improvements
compared to basic combination methods.

12
The categories of this paper are: nucl-th
2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
25
The categories of this paper are: patt-sol
32
The categories of this paper are: atom-ph
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
22
The categories of this paper are: chao-dyn
18
The categories of this paper are: econ