Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Dynamic Programming Deconstructed: Transformations of the Bellman
  Equation and Computational Efficiency   Some approaches to solving challenging dynamic programming problems, such as
Q-learning, begin by transforming the Bellman equation into an alternative
functional equation, in order to open up a new line of attack. Our paper
studies this idea systematically, with a focus on boosting computational
efficiency. We provide a characterization of the set of valid transformations
of the Bellman equation, where validity means that the transformed Bellman
equation maintains the link to optimality held by the original Bellman
equation. We then examine the solutions of the transformed Bellman equations
and analyze correspondingly transformed versions of the algorithms used to
solve for optimal policies. These investigations yield new approaches to a
variety of discrete time dynamic programming problems, including those with
features such as recursive preferences or desire for robustness. Increased
computational efficiency is demonstrated via time complexity arguments and
numerical experiments.

8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
19
The categories of this paper are: eess
10
The categories of this paper are: q-bio
6
The categories of this paper are: astro-ph
0
The categories of this paper are: hep-ph
7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin
24
The categories of this paper are: dg-ga