Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Scene Graph Reasoning for Visual Question Answering   Visual question answering is concerned with answering free-form questions
about an image. Since it requires a deep linguistic understanding of the
question and the ability to associate it with various objects that are present
in the image, it is an ambitious task and requires techniques from both
computer vision and natural language processing. We propose a novel method that
approaches the task by performing context-driven, sequential reasoning based on
the objects and their semantic and spatial relationships present in the scene.
As a first step, we derive a scene graph which describes the objects in the
image, as well as their attributes and their mutual relationships. A
reinforcement agent then learns to autonomously navigate over the extracted
scene graph to generate paths, which are then the basis for deriving answers.
We conduct a first experimental study on the challenging GQA dataset with
manually curated scene graphs, where our method almost reaches the level of
human performance.

11
The categories of this paper are: hep-lat
4
The categories of this paper are: cond-mat
31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
37
The categories of this paper are: supr-con
0
The categories of this paper are: hep-ph
13
The categories of this paper are: quant-ph
5
The categories of this paper are: gr-qc
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
20
The categories of this paper are: acc-phys