Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Scalable Perception-Action-Communication Loops with Convolutional and
  Graph Neural Networks   In this paper, we present a perception-action-communication loop design using
Vision-based Graph Aggregation and Inference (VGAI). This multi-agent
decentralized learning-to-control framework maps raw visual observations to
agent actions, aided by local communication among neighboring agents. Our
framework is implemented by a cascade of a convolutional and a graph neural
network (CNN / GNN), addressing agent-level visual perception and feature
learning, as well as swarm-level communication, local information aggregation
and agent action inference, respectively. By jointly training the CNN and GNN,
image features and communication messages are learned in conjunction to better
address the specific task. We use imitation learning to train the VGAI
controller in an offline phase, relying on a centralized expert controller.
This results in a learned VGAI controller that can be deployed in a distributed
manner for online execution. Additionally, the controller exhibits good scaling
properties, with training in smaller teams and application in larger teams.
Through a multi-agent flocking application, we demonstrate that VGAI yields
performance comparable to or better than other decentralized controllers, using
only the visual input modality and without accessing precise location or motion
state information.

37
The categories of this paper are: supr-con
0
The categories of this paper are: hep-ph
12
The categories of this paper are: nucl-th
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
23
The categories of this paper are: solv-int
2
The categories of this paper are: math
3
The categories of this paper are: physics
25
The categories of this paper are: patt-sol
22
The categories of this paper are: chao-dyn