Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image
  Reconstruction   Hyperspectral image (HSI) reconstruction aims to recover the 3D
spatial-spectral signal from a 2D measurement in the coded aperture snapshot
spectral imaging (CASSI) system. The HSI representations are highly similar and
correlated across the spectral dimension. Modeling the inter-spectra
interactions is beneficial for HSI reconstruction. However, existing CNN-based
methods show limitations in capturing spectral-wise similarity and long-range
dependencies. Besides, the HSI information is modulated by a coded aperture
(physical mask) in CASSI. Nonetheless, current algorithms have not fully
explored the guidance effect of the mask for HSI restoration. In this paper, we
propose a novel framework, Mask-guided Spectral-wise Transformer (MST), for HSI
reconstruction. Specifically, we present a Spectral-wise Multi-head
Self-Attention (S-MSA) that treats each spectral feature as a token and
calculates self-attention along the spectral dimension. In addition, we
customize a Mask-guided Mechanism (MM) that directs S-MSA to pay attention to
spatial regions with high-fidelity spectral representations. Extensive
experiments show that our MST significantly outperforms state-of-the-art (SOTA)
methods on simulation and real HSI datasets while requiring dramatically
cheaper computational and memory costs. Code and pre-trained models are
available at https://github.com/caiyuanhao1998/MST/

32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph
27
The categories of this paper are: comp-gas
8
The categories of this paper are: hep-ex
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
4
The categories of this paper are: cond-mat
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
20
The categories of this paper are: acc-phys