Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Error Controlled Actor-Critic   On error of value function inevitably causes an overestimation phenomenon and
has a negative impact on the convergence of the algorithms. To mitigate the
negative effects of the approximation error, we propose Error Controlled
Actor-critic which ensures confining the approximation error in value function.
We present an analysis of how the approximation error can hinder the
optimization process of actor-critic methods.Then, we derive an upper boundary
of the approximation error of Q function approximator and find that the error
can be lowered by restricting on the KL-divergence between every two
consecutive policies when training the policy. The results of experiments on a
range of continuous control tasks demonstrate that the proposed actor-critic
algorithm apparently reduces the approximation error and significantly
outperforms other model-free RL algorithms.

15
The categories of this paper are: nucl-ex
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
2
The categories of this paper are: math
3
The categories of this paper are: physics
16
The categories of this paper are: stat
21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph