Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Ubiquitous Distributed Deep Reinforcement Learning at the Edge:
  Analyzing Byzantine Agents in Discrete Action Spaces   The integration of edge computing in next-generation mobile networks is
bringing low-latency and high-bandwidth ubiquitous connectivity to a myriad of
cyber-physical systems. This will further boost the increasing intelligence
that is being embedded at the edge in various types of autonomous systems,
where collaborative machine learning has the potential to play a significant
role. This paper discusses some of the challenges in multi-agent distributed
deep reinforcement learning that can occur in the presence of byzantine or
malfunctioning agents. As the simulation-to-reality gap gets bridged, the
probability of malfunctions or errors must be taken into account. We show how
wrong discrete actions can significantly affect the collaborative learning
effort. In particular, we analyze the effect of having a fraction of agents
that might perform the wrong action with a given probability. We study the
ability of the system to converge towards a common working policy through the
collaborative learning process based on the number of experiences from each of
the agents to be aggregated for each policy update, together with the fraction
of wrong actions from agents experiencing malfunctions. Our experiments are
carried out in a simulation environment using the Atari testbed for the
discrete action spaces, and advantage actor-critic (A2C) for the distributed
multi-agent training.

19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
22
The categories of this paper are: chao-dyn
6
The categories of this paper are: astro-ph
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
14
The categories of this paper are: math-ph
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
31
The categories of this paper are: ao-sci
20
The categories of this paper are: acc-phys
2
The categories of this paper are: math
23
The categories of this paper are: solv-int
30
The categories of this paper are: q-alg