Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Training neural networks to encode symbols enables combinatorial
  generalization   Combinatorial generalization - the ability to understand and produce novel
combinations of already familiar elements - is considered to be a core capacity
of the human mind and a major challenge to neural network models. A significant
body of research suggests that conventional neural networks can't solve this
problem unless they are endowed with mechanisms specifically engineered for the
purpose of representing symbols. In this paper we introduce a novel way of
representing symbolic structures in connectionist terms - the vectors approach
to representing symbols (VARS), which allows training standard neural
architectures to encode symbolic knowledge explicitly at their output layers.
In two simulations, we show that neural networks not only can learn to produce
VARS representations, but in doing so they achieve combinatorial generalization
in their symbolic and non-symbolic output. This adds to other recent work that
has shown improved combinatorial generalization under specific training
conditions, and raises the question of whether specific mechanisms or training
routines are needed to support symbolic processing.

36
The categories of this paper are: cmp-lg
23
The categories of this paper are: solv-int
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
2
The categories of this paper are: math
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
24
The categories of this paper are: dg-ga
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
3
The categories of this paper are: physics
30
The categories of this paper are: q-alg
17
The categories of this paper are: q-fin
28
The categories of this paper are: alg-geom