Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning to Represent Action Values as a Hypergraph on the Action
  Vertices   Action-value estimation is a critical component of many reinforcement
learning (RL) methods whereby sample complexity relies heavily on how fast a
good estimator for action value can be learned. By viewing this problem through
the lens of representation learning, good representations of both state and
action can facilitate action-value estimation. While advances in deep learning
have seamlessly driven progress in learning state representations, given the
specificity of the notion of agency to RL, little attention has been paid to
learning action representations. We conjecture that leveraging the
combinatorial structure of multi-dimensional action spaces is a key ingredient
for learning good representations of action. To test this, we set forth the
action hypergraph networks framework -- a class of functions for learning
action representations in multi-dimensional discrete action spaces with a
structural inductive bias. Using this framework we realise an agent class based
on a combination with deep Q-networks, which we dub hypergraph Q-networks. We
show the effectiveness of our approach on a myriad of domains: illustrative
prediction problems under minimal confounding effects, Atari 2600 games, and
discretised physical control benchmarks.

22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
2
The categories of this paper are: math
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
29
The categories of this paper are: funct-an
28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci