Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Implicit Distributional Reinforcement Learning   To improve the sample efficiency of policy-gradient based reinforcement
learning algorithms, we propose implicit distributional actor-critic (IDAC)
that consists of a distributional critic, built on two deep generator networks
(DGNs), and a semi-implicit actor (SIA), powered by a flexible policy
distribution. We adopt a distributional perspective on the discounted
cumulative return and model it with a state-action-dependent implicit
distribution, which is approximated by the DGNs that take state-action pairs
and random noises as their input. Moreover, we use the SIA to provide a
semi-implicit policy distribution, which mixes the policy parameters with a
reparameterizable distribution that is not constrained by an analytic density
function. In this way, the policy's marginal distribution is implicit,
providing the potential to model complex properties such as covariance
structure and skewness, but its parameter and entropy can still be estimated.
We incorporate these features with an off-policy algorithm framework to solve
problems with continuous action space and compare IDAC with state-of-the-art
algorithms on representative OpenAI Gym environments. We observe that IDAC
outperforms these baselines in most tasks. Python code is provided.

22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio
6
The categories of this paper are: astro-ph
4
The categories of this paper are: cond-mat
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
12
The categories of this paper are: nucl-th
28
The categories of this paper are: alg-geom