Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning Cooperative Visual Dialog Agents with Deep Reinforcement
  Learning   We introduce the first goal-driven training for visual question answering and
dialog agents. Specifically, we pose a cooperative 'image guessing' game
between two agents -- Qbot and Abot -- who communicate in natural language
dialog so that Qbot can select an unseen image from a lineup of images. We use
deep reinforcement learning (RL) to learn the policies of these agents
end-to-end -- from pixels to multi-agent multi-round dialog to game reward.
  We demonstrate two experimental results.
  First, as a 'sanity check' demonstration of pure RL (from scratch), we show
results on a synthetic world, where the agents communicate in ungrounded
vocabulary, i.e., symbols with no pre-specified meanings (X, Y, Z). We find
that two bots invent their own communication protocol and start using certain
symbols to ask/answer about certain visual attributes (shape/color/style).
Thus, we demonstrate the emergence of grounded language and communication among
'visual' dialog agents with no human supervision.
  Second, we conduct large-scale real-image experiments on the VisDial dataset,
where we pretrain with supervised dialog data and show that the RL 'fine-tuned'
agents significantly outperform SL agents. Interestingly, the RL Qbot learns to
ask questions that Abot is good at, ultimately resulting in more informative
dialog and a better team.

6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
30
The categories of this paper are: q-alg
17
The categories of this paper are: q-fin
19
The categories of this paper are: eess
4
The categories of this paper are: cond-mat
14
The categories of this paper are: math-ph
10
The categories of this paper are: q-bio
27
The categories of this paper are: comp-gas
12
The categories of this paper are: nucl-th
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat