Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Competitive MA-DRL for Transmit Power Pool Design in Semi-Grant-Free
  NOMA Systems   In this paper, we exploit the capability of multi-agent deep reinforcement
learning (MA-DRL) technique to generate a transmit power pool (PP) for Internet
of things (IoT) networks with semi-grant-free non-orthogonal multiple access
(SGF-NOMA). The PP is mapped with each resource block (RB) to achieve
distributed transmit power control (DPC). We first formulate the resource
(sub-channel and transmit power) selection problem as stochastic Markov game,
and then solve it using two competitive MA-DRL algorithms, namely double deep Q
network (DDQN) and Dueling DDQN. Each GF user as an agent tries to find out the
optimal transmit power level and RB to form the desired PP. With the aid of
dueling processes, the learning process can be enhanced by evaluating the
valuable state without considering the effect of each action at each state.
Therefore, DDQN is designed for communication scenarios with a small-size
action-state space, while Dueling DDQN is for a large-size case. Our results
show that the proposed MA-Dueling DDQN based SGF-NOMA with DPC outperforms the
SGF-NOMA system with the fixed-power-control mechanism and networks with pure
GF protocols with 17.5% and 22.2% gain in terms of the system throughput,
respectively. Moreover, to decrease the training time, we eliminate invalid
actions (high transmit power levels) to reduce the action space. We show that
our proposed algorithm is computationally scalable to massive IoT networks.
Finally, to control the interference and guarantee the quality-of-service
requirements of grant-based users, we find the optimal number of GF users for
each sub-channel.

19
The categories of this paper are: eess
27
The categories of this paper are: comp-gas
17
The categories of this paper are: q-fin
24
The categories of this paper are: dg-ga
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
22
The categories of this paper are: chao-dyn
9
The categories of this paper are: nlin
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
7
The categories of this paper are: hep-th
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
6
The categories of this paper are: astro-ph
4
The categories of this paper are: cond-mat