Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learn To Pay Attention   We propose an end-to-end-trainable attention module for convolutional neural
network (CNN) architectures built for image classification. The module takes as
input the 2D feature vector maps which form the intermediate representations of
the input image at different stages in the CNN pipeline, and outputs a 2D
matrix of scores for each map. Standard CNN architectures are modified through
the incorporation of this module, and trained under the constraint that a
convex combination of the intermediate 2D feature vectors, as parameterised by
the score matrices, must \textit{alone} be used for classification.
Incentivised to amplify the relevant and suppress the irrelevant or misleading,
the scores thus assume the role of attention values. Our experimental
observations provide clear evidence to this effect: the learned attention maps
neatly highlight the regions of interest while suppressing background clutter.
Consequently, the proposed function is able to bootstrap standard CNN
architectures for the task of image classification, demonstrating superior
generalisation over 6 unseen benchmark datasets. When binarised, our attention
maps outperform other CNN-based attention maps, traditional saliency maps, and
top object proposals for weakly supervised segmentation as demonstrated on the
Object Discovery dataset. We also demonstrate improved robustness against the
fast gradient sign method of adversarial attack.

4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
19
The categories of this paper are: eess
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
9
The categories of this paper are: nlin