Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Interpretable and Generalizable Graph Learning via Stochastic Attention
  Mechanism   Interpretable graph learning is in need as many scientific applications
depend on learning models to collect insights from graph-structured data.
Previous works mostly focused on using post-hoc approaches to interpret a
pre-trained model (graph neural network models in particular). They argue
against inherently interpretable models because good interpretation of these
models is often at the cost of their prediction accuracy. And, the widely used
attention mechanism for inherent interpretation often fails to provide faithful
interpretation in graph learning tasks. In this work, we address both issues by
proposing Graph Stochastic Attention (GSAT), an attention mechanism derived
from the information bottleneck principle. GSAT leverages stochastic attention
to block the information from the task-irrelevant graph components while
learning stochasticity-reduced attention to select the task-relevant subgraphs
for interpretation. GSAT can also apply to fine-tuning and interpreting
pre-trained models via stochastic attention mechanism. Extensive experiments on
eight datasets show that GSAT outperforms the state-of-the-art methods by up to
20%$\uparrow$ in interpretation AUC and 5%$\uparrow$ in prediction accuracy.

7
The categories of this paper are: hep-th
25
The categories of this paper are: patt-sol
31
The categories of this paper are: ao-sci
33
The categories of this paper are: plasm-ph
27
The categories of this paper are: comp-gas
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
20
The categories of this paper are: acc-phys
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin
14
The categories of this paper are: math-ph
10
The categories of this paper are: q-bio
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat