Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Rotate to Attend: Convolutional Triplet Attention Module   Benefiting from the capability of building inter-dependencies among channels
or spatial locations, attention mechanisms have been extensively studied and
broadly used in a variety of computer vision tasks recently. In this paper, we
investigate light-weight but effective attention mechanisms and present triplet
attention, a novel method for computing attention weights by capturing
cross-dimension interaction using a three-branch structure. For an input
tensor, triplet attention builds inter-dimensional dependencies by the rotation
operation followed by residual transformations and encodes inter-channel and
spatial information with negligible computational overhead. Our method is
simple as well as efficient and can be easily plugged into classic backbone
networks as an add-on module. We demonstrate the effectiveness of our method on
various challenging tasks including image classification on ImageNet-1k and
object detection on MSCOCO and PASCAL VOC datasets. Furthermore, we provide
extensive in-sight into the performance of triplet attention by visually
inspecting the GradCAM and GradCAM++ results. The empirical evaluation of our
method supports our intuition on the importance of capturing dependencies
across dimensions when computing attention weights. Code for this paper can be
publicly accessed at https://github.com/LandskapeAI/triplet-attention

7
The categories of this paper are: hep-th
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
32
The categories of this paper are: atom-ph
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
27
The categories of this paper are: comp-gas
14
The categories of this paper are: math-ph
13
The categories of this paper are: quant-ph
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
37
The categories of this paper are: supr-con