Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Grounding Complex Navigational Instructions Using Scene Graphs   Training a reinforcement learning agent to carry out natural language
instructions is limited by the available supervision, i.e. knowing when the
instruction has been carried out. We adapt the CLEVR visual question answering
dataset to generate complex natural language navigation instructions and
accompanying scene graphs, yielding an environment-agnostic supervised dataset.
To demonstrate the use of this data set, we map the scenes to the VizDoom
environment and use the architecture in \citet{gatedattention} to train an
agent to carry out these more complex language instructions.

18
The categories of this paper are: econ
37
The categories of this paper are: supr-con
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
33
The categories of this paper are: plasm-ph
5
The categories of this paper are: gr-qc
31
The categories of this paper are: ao-sci
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom