Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Unleashing the Power of Transformer for Graphs   Despite recent successes in natural language processing and computer vision,
Transformer suffers from the scalability problem when dealing with graphs. The
computational complexity is unacceptable for large-scale graphs, e.g.,
knowledge graphs. One solution is to consider only the near neighbors, which,
however, will lose the key merit of Transformer to attend to the elements at
any distance. In this paper, we propose a new Transformer architecture, named
dual-encoding Transformer (DET). DET has a structural encoder to aggregate
information from connected neighbors and a semantic encoder to focus on
semantically useful distant nodes. In comparison with resorting to multi-hop
neighbors, DET seeks the desired distant neighbors via self-supervised
training. We further find these two encoders can be incorporated to boost each
others' performance. Our experiments demonstrate DET has achieved superior
performance compared to the respective state-of-the-art methods in dealing with
molecules, networks and knowledge graphs with various sizes.

27
The categories of this paper are: comp-gas
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
2
The categories of this paper are: math
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
20
The categories of this paper are: acc-phys
0
The categories of this paper are: hep-ph
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
24
The categories of this paper are: dg-ga