Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: SideRT: A Real-time Pure Transformer Architecture for Single Image Depth
  Estimation   Since context modeling is critical for estimating depth from a single image,
researchers put tremendous effort into obtaining global context. Many global
manipulations are designed for traditional CNN-based architectures to overcome
the locality of convolutions. Attention mechanisms or transformers originally
designed for capturing long-range dependencies might be a better choice, but
usually complicates architectures and could lead to a decrease in inference
speed. In this work, we propose a pure transformer architecture called SideRT
that can attain excellent predictions in real-time. In order to capture better
global context, Cross-Scale Attention (CSA) and Multi-Scale Refinement (MSR)
modules are designed to work collaboratively to fuse features of different
scales efficiently. CSA modules focus on fusing features of high semantic
similarities, while MSR modules aim to fuse features at corresponding
positions. These two modules contain a few learnable parameters without
convolutions, based on which a lightweight yet effective model is built. This
architecture achieves state-of-the-art performances in real-time (51.3 FPS) and
becomes much faster with a reasonable performance drop on a smaller backbone
Swin-T (83.1 FPS). Furthermore, its performance surpasses the previous
state-of-the-art by a large margin, improving AbsRel metric 6.9% on KITTI and
9.7% on NYU. To the best of our knowledge, this is the first work to show that
transformer-based networks can attain state-of-the-art performance in real-time
in the single image depth estimation field. Code will be made available soon.

32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
16
The categories of this paper are: stat
9
The categories of this paper are: nlin
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
5
The categories of this paper are: gr-qc
13
The categories of this paper are: quant-ph