Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Invariant and Equivariant Graph Networks   Invariant and equivariant networks have been successfully used for learning
images, sets, point clouds, and graphs. A basic challenge in developing such
networks is finding the maximal collection of invariant and equivariant linear
layers. Although this question is answered for the first three examples (for
popular transformations, at-least), a full characterization of invariant and
equivariant linear layers for graphs is not known.
  In this paper we provide a characterization of all permutation invariant and
equivariant linear layers for (hyper-)graph data, and show that their
dimension, in case of edge-value graph data, is 2 and 15, respectively. More
generally, for graph data defined on k-tuples of nodes, the dimension is the
k-th and 2k-th Bell numbers. Orthogonal bases for the layers are computed,
including generalization to multi-graph data. The constant number of basis
elements and their characteristics allow successfully applying the networks to
different size graphs. From the theoretical point of view, our results
generalize and unify recent advancement in equivariant deep learning. In
particular, we show that our model is capable of approximating any message
passing neural network
  Applying these new linear layers in a simple deep neural network framework is
shown to achieve comparable results to state-of-the-art and to have better
expressivity than previous invariant and equivariant bases.

19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
18
The categories of this paper are: econ
22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci