Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Towards self-organized control: Using neural cellular automata to
  robustly control a cart-pole agent   Neural cellular automata (Neural CA) are a recent framework used to model
biological phenomena emerging from multicellular organisms. In these systems,
artificial neural networks are used as update rules for cellular automata.
Neural CA are end-to-end differentiable systems where the parameters of the
neural network can be learned to achieve a particular task. In this work, we
used neural CA to control a cart-pole agent. The observations of the
environment are transmitted in input cells, while the values of output cells
are used as a readout of the system. We trained the model using deep-Q
learning, where the states of the output cells were used as the Q-value
estimates to be optimized. We found that the computing abilities of the
cellular automata were maintained over several hundreds of thousands of
iterations, producing an emergent stable behavior in the environment it
controls for thousands of steps. Moreover, the system demonstrated life-like
phenomena such as a developmental phase, regeneration after damage, stability
despite a noisy environment, and robustness to unseen disruption such as input
deletion.

33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
5
The categories of this paper are: gr-qc
25
The categories of this paper are: patt-sol
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
10
The categories of this paper are: q-bio