Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Relational Graph Learning for Grounded Video Description Generation   Grounded video description (GVD) encourages captioning models to attend to
appropriate video regions (e.g., objects) dynamically and generate a
description. Such a setting can help explain the decisions of captioning models
and prevents the model from hallucinating object words in its description.
However, such design mainly focuses on object word generation and thus may
ignore fine-grained information and suffer from missing visual concepts.
Moreover, relational words (e.g., "jump left or right") are usual
spatio-temporal inference results, i.e., these words cannot be grounded on
certain spatial regions. To tackle the above limitations, we design a novel
relational graph learning framework for GVD, in which a language-refined scene
graph representation is designed to explore fine-grained visual concepts.
Furthermore, the refined graph can be regarded as relational inductive
knowledge to assist captioning models in selecting the relevant information it
needs to generate correct words. We validate the effectiveness of our model
through automatic metrics and human evaluation, and the results indicate that
our approach can generate more fine-grained and accurate description, and it
solves the problem of object hallucination to some extent.

8
The categories of this paper are: hep-ex
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph
32
The categories of this paper are: atom-ph
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
27
The categories of this paper are: comp-gas
0
The categories of this paper are: hep-ph
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
30
The categories of this paper are: q-alg