Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Count-Based Temperature Scheduling for Maximum Entropy Reinforcement
  Learning   Maximum Entropy Reinforcement Learning (MaxEnt RL) algorithms such as Soft
Q-Learning (SQL) and Soft Actor-Critic trade off reward and policy entropy,
which has the potential to improve training stability and robustness. Most
MaxEnt RL methods, however, use a constant tradeoff coefficient (temperature),
contrary to the intuition that the temperature should be high early in training
to avoid overfitting to noisy value estimates and decrease later in training as
we increasingly trust high value estimates to truly lead to good rewards.
Moreover, our confidence in value estimates is state-dependent, increasing
every time we use more evidence to update an estimate. In this paper, we
present a simple state-based temperature scheduling approach, and instantiate
it for SQL as Count-Based Soft Q-Learning (CBSQL). We evaluate our approach on
a toy domain as well as in several Atari 2600 domains and show promising
results.

31
The categories of this paper are: ao-sci
32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
19
The categories of this paper are: eess
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio