Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Towards an Unified Structure for Reinforcement Learning: an Optimization
  Approach   Both the optimal value function and the optimal policy can be used to model
an optimal controller based on the duality established by the Bellman equation.
Even with this duality, no parametric model has been able to output both policy
and value function with a common parameter set. In this paper, a unified
structure is proposed with a parametric optimization problem. The policy and
the value function modelled by this structure share all parameters, which
enables seamless switching among reinforcement learning algorithms while
continuing to learn. The Q-learning and policy gradient based on the proposed
structure is detailed. An actor-critic algorithm based on this structure, whose
actor and critic are both modelled by the same parameters, is validated by both
linear and nonlinear control.

9
The categories of this paper are: nlin
3
The categories of this paper are: physics
22
The categories of this paper are: chao-dyn
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
2
The categories of this paper are: math
35
The categories of this paper are: mtrl-th
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
5
The categories of this paper are: gr-qc
23
The categories of this paper are: solv-int