Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: {\epsilon}-BMC: A Bayesian Ensemble Approach to Epsilon-Greedy
  Exploration in Model-Free Reinforcement Learning   Resolving the exploration-exploitation trade-off remains a fundamental
problem in the design and implementation of reinforcement learning (RL)
algorithms. In this paper, we focus on model-free RL using the epsilon-greedy
exploration policy, which despite its simplicity, remains one of the most
frequently used forms of exploration. However, a key limitation of this policy
is the specification of $\varepsilon$. In this paper, we provide a novel
Bayesian perspective of $\varepsilon$ as a measure of the uniformity of the
Q-value function. We introduce a closed-form Bayesian model update based on
Bayesian model combination (BMC), based on this new perspective, which allows
us to adapt $\varepsilon$ using experiences from the environment in constant
time with monotone convergence guarantees. We demonstrate that our proposed
algorithm, $\varepsilon$-\texttt{BMC}, efficiently balances exploration and
exploitation on different problems, performing comparably or outperforming the
best tuned fixed annealing schedules and an alternative data-dependent
$\varepsilon$ adaptation scheme proposed in the literature.

18
The categories of this paper are: econ
29
The categories of this paper are: funct-an
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
8
The categories of this paper are: hep-ex
19
The categories of this paper are: eess
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
6
The categories of this paper are: astro-ph
33
The categories of this paper are: plasm-ph