Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Audio Visual Scene-Aware Dialog Generation with Transformer-based Video
  Representations   There have been many attempts to build multimodal dialog systems that can
respond to a question about given audio-visual information, and the
representative task for such systems is the Audio Visual Scene-Aware Dialog
(AVSD). Most conventional AVSD models adopt the Convolutional Neural Network
(CNN)-based video feature extractor to understand visual information. While a
CNN tends to obtain both temporally and spatially local information, global
information is also crucial for boosting video understanding because AVSD
requires long-term temporal visual dependency and whole visual information. In
this study, we apply the Transformer-based video feature that can capture both
temporally and spatially global representations more efficiently than the
CNN-based feature. Our AVSD model with its Transformer-based feature attains
higher objective performance scores for answer generation. In addition, our
model achieves a subjective score close to that of human answers in DSTC10. We
observed that the Transformer-based visual feature is beneficial for the AVSD
task because our model tends to correctly answer the questions that need a
temporally and spatially broad range of visual information.

25
The categories of this paper are: patt-sol
12
The categories of this paper are: nucl-th
26
The categories of this paper are: bayes-an
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin