Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Deep Reinforcement Learning Framework for Contention-Based Spectrum
  Sharing   The increasing number of wireless devices operating in unlicensed spectrum
motivates the development of intelligent adaptive approaches to spectrum
access. We consider decentralized contention-based medium access for base
stations (BSs) operating on unlicensed shared spectrum, where each BS
autonomously decides whether or not to transmit on a given resource. The
contention decision attempts to maximize not its own downlink throughput, but
rather a network-wide objective. We formulate this problem as a decentralized
partially observable Markov decision process with a novel reward structure that
provides long term proportional fairness in terms of throughput. We then
introduce a two-stage Markov decision process in each time slot that uses
information from spectrum sensing and reception quality to make a medium access
decision. Finally, we incorporate these features into a distributed
reinforcement learning framework for contention-based spectrum access. Our
formulation provides decentralized inference, online adaptability and also
caters to partial observability of the environment through recurrent
Q-learning. Empirically, we find its maximization of the proportional fairness
metric to be competitive with a genie-aided adaptive energy detection
threshold, while being robust to channel fading and small contention windows.

21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
31
The categories of this paper are: ao-sci
20
The categories of this paper are: acc-phys
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
16
The categories of this paper are: stat
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
26
The categories of this paper are: bayes-an
9
The categories of this paper are: nlin