Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: UNETR: Transformers for 3D Medical Image Segmentation   Fully Convolutional Neural Networks (FCNNs) with contracting and expanding
paths have shown prominence for the majority of medical image segmentation
applications since the past decade. In FCNNs, the encoder plays an integral
role by learning both global and local features and contextual representations
which can be utilized for semantic output prediction by the decoder. Despite
their success, the locality of convolutional layers in FCNNs, limits the
capability of learning long-range spatial dependencies. Inspired by the recent
success of transformers for Natural Language Processing (NLP) in long-range
sequence learning, we reformulate the task of volumetric (3D) medical image
segmentation as a sequence-to-sequence prediction problem. We introduce a novel
architecture, dubbed as UNEt TRansformers (UNETR), that utilizes a transformer
as the encoder to learn sequence representations of the input volume and
effectively capture the global multi-scale information, while also following
the successful "U-shaped" network design for the encoder and decoder. The
transformer encoder is directly connected to a decoder via skip connections at
different resolutions to compute the final semantic segmentation output. We
have validated the performance of our method on the Multi Atlas Labeling Beyond
The Cranial Vault (BTCV) dataset for multi-organ segmentation and the Medical
Segmentation Decathlon (MSD) dataset for brain tumor and spleen segmentation
tasks. Our benchmarks demonstrate new state-of-the-art performance on the BTCV
leaderboard. Code: https://monai.io/research/unetr

5
The categories of this paper are: gr-qc
34
The categories of this paper are: chem-ph
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph
17
The categories of this paper are: q-fin
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
24
The categories of this paper are: dg-ga
22
The categories of this paper are: chao-dyn
3
The categories of this paper are: physics
6
The categories of this paper are: astro-ph
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph