Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learnt Sparsification for Interpretable Graph Neural Networks   Graph neural networks (GNNs) have achieved great success on various tasks and
fields that require relational modeling. GNNs aggregate node features using the
graph structure as inductive biases resulting in flexible and powerful models.
However, GNNs remain hard to interpret as the interplay between node features
and graph structure is only implicitly learned. In this paper, we propose a
novel method called Kedge for explicitly sparsifying the underlying graph by
removing unnecessary neighbors. Our key idea is based on a tractable method for
sparsification using the Hard Kumaraswamy distribution that can be used in
conjugation with any GNN model. Kedge learns edge masks in a modular fashion
trained with any GNN allowing for gradient based optimization in an end-to-end
fashion. We demonstrate through extensive experiments that our model Kedge can
prune a large proportion of the edges with only a minor effect on the test
accuracy. Specifically, in the PubMed dataset, Kedge learns to drop more than
80% of the edges with an accuracy drop of merely 2% showing that graph
structure has only a small contribution in comparison to node features.
Finally, we also show that Kedge effectively counters the over-smoothing
phenomena in deep GNNs by maintaining good task performance with increasing GNN
layers.

34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
35
The categories of this paper are: mtrl-th
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin
4
The categories of this paper are: cond-mat
28
The categories of this paper are: alg-geom
17
The categories of this paper are: q-fin
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
23
The categories of this paper are: solv-int
32
The categories of this paper are: atom-ph