Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Fast Graph Attention Networks Using Effective Resistance Based Graph
  Sparsification   The attention mechanism has demonstrated superior performance for inference
over nodes in graph neural networks (GNNs), however, they result in a high
computational burden during both training and inference. We propose FastGAT, a
method to make attention based GNNs lightweight by using spectral
sparsification to generate an optimal pruning of the input graph. This results
in a per-epoch time that is almost linear in the number of graph nodes as
opposed to quadratic. We theoretically prove that spectral sparsification
preserves the features computed by the GAT model, thereby justifying our
algorithm. We experimentally evaluate FastGAT on several large real world graph
datasets for node classification tasks under both inductive and transductive
settings. FastGAT can dramatically reduce (up to \textbf{10x}) the
computational time and memory requirements, allowing the usage of attention
based GNNs on large graphs.

33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
0
The categories of this paper are: hep-ph
35
The categories of this paper are: mtrl-th
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph