Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: AlignTransformer: Hierarchical Alignment of Visual Regions and Disease
  Tags for Medical Report Generation   Recently, medical report generation, which aims to automatically generate a
long and coherent descriptive paragraph of a given medical image, has received
growing research interests. Different from the general image captioning tasks,
medical report generation is more challenging for data-driven neural models.
This is mainly due to 1) the serious data bias: the normal visual regions
dominate the dataset over the abnormal visual regions, and 2) the very long
sequence. To alleviate above two problems, we propose an AlignTransformer
framework, which includes the Align Hierarchical Attention (AHA) and the
Multi-Grained Transformer (MGT) modules: 1) AHA module first predicts the
disease tags from the input image and then learns the multi-grained visual
features by hierarchically aligning the visual regions and disease tags. The
acquired disease-grounded visual features can better represent the abnormal
regions of the input image, which could alleviate data bias problem; 2) MGT
module effectively uses the multi-grained features and Transformer framework to
generate the long medical report. The experiments on the public IU-Xray and
MIMIC-CXR datasets show that the AlignTransformer can achieve results
competitive with state-of-the-art methods on the two datasets. Moreover, the
human evaluation conducted by professional radiologists further proves the
effectiveness of our approach.

28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
14
The categories of this paper are: math-ph
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
32
The categories of this paper are: atom-ph
23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin
35
The categories of this paper are: mtrl-th