Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Deep Compositional Framework for Human-like Language Acquisition in
  Virtual Environment   We tackle a task where an agent learns to navigate in a 2D maze-like
environment called XWORLD. In each session, the agent perceives a sequence of
raw-pixel frames, a natural language command issued by a teacher, and a set of
rewards. The agent learns the teacher's language from scratch in a grounded and
compositional manner, such that after training it is able to correctly execute
zero-shot commands: 1) the combination of words in the command never appeared
before, and/or 2) the command contains new object concepts that are learned
from another task but never learned from navigation. Our deep framework for the
agent is trained end to end: it learns simultaneously the visual
representations of the environment, the syntax and semantics of the language,
and the action module that outputs actions. The zero-shot learning capability
of our framework results from its compositionality and modularity with
parameter tying. We visualize the intermediate outputs of the framework,
demonstrating that the agent truly understands how to solve the problem. We
believe that our results provide some preliminary insights on how to train an
agent with similar abilities in a 3D environment.

26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph
24
The categories of this paper are: dg-ga
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
11
The categories of this paper are: hep-lat