Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Design strategies for controlling neuron-connected robots using
  reinforcement learning   Despite the growing interest in robot control utilizing the computation of
biological neurons, context-dependent behavior by neuron-connected robots
remains a challenge. Context-dependent behavior here is defined as behavior
that is not the result of a simple sensory-motor coupling, but rather based on
an understanding of the task goal. This paper proposes design principles for
training neuron-connected robots based on task goals to achieve
context-dependent behavior. First, we employ deep reinforcement learning (RL)
to enable training that accounts for goal achievements. Second, we propose a
neuron simulator as a probability distribution based on recorded neural data,
aiming to represent physiologically valid neural dynamics while avoiding
complex modeling with high computational costs. Furthermore, we propose to
update the simulators during the training to bridge the gap between the
simulation and the real settings. The experiments showed that the robot
gradually learned context-dependent behaviors in pole balancing and robot
navigation tasks. Moreover, the learned policies were valid for neural
simulators based on novel neural data, and the task performance increased by
updating the simulators during training. These results suggest the
effectiveness of the proposed design principle for the context-dependent
behavior of neuron-connected robots.

11
The categories of this paper are: hep-lat
12
The categories of this paper are: nucl-th
5
The categories of this paper are: gr-qc
33
The categories of this paper are: plasm-ph
30
The categories of this paper are: q-alg
31
The categories of this paper are: ao-sci
16
The categories of this paper are: stat
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
7
The categories of this paper are: hep-th