Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Characterizing optimal hierarchical policy inference on graphs via
  non-equilibrium thermodynamics   Hierarchies are of fundamental interest in both stochastic optimal control
and biological control due to their facilitation of a range of desirable
computational traits in a control algorithm and the possibility that they may
form a core principle of sensorimotor and cognitive control systems. However, a
theoretically justified construction of state-space hierarchies over all
spatial resolutions and their evolution through a policy inference process
remains elusive. Here, a formalism for deriving such normative representations
of discrete Markov decision processes is introduced in the context of graphs.
The resulting hierarchies correspond to a hierarchical policy inference
algorithm approximating a discrete gradient flow between state-space trajectory
densities generated by the prior and optimal policies.

16
The categories of this paper are: stat
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
19
The categories of this paper are: eess
22
The categories of this paper are: chao-dyn
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
27
The categories of this paper are: comp-gas
5
The categories of this paper are: gr-qc
13
The categories of this paper are: quant-ph