Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Recent Advances in Vision Transformer: A Survey and Outlook of Recent
  Work   Vision Transformers (ViTs) are becoming more popular and dominating technique
for various vision tasks, compare to Convolutional Neural Networks (CNNs). As a
demanding technique in computer vision, ViTs have been successfully solved
various vision problems while focusing on long-range relationships. In this
paper, we begin by introducing the fundamental concepts and background of the
self-attention mechanism. Next, we provide a comprehensive overview of recent
top-performing ViT methods describing in terms of strength and weakness,
computational cost as well as training and testing dataset. We thoroughly
compare the performance of various ViT algorithms and most representative CNN
methods on popular benchmark datasets. Finally, we explore some limitations
with insightful observations and provide further research direction. The
project page along with the collections of papers are available at
https://github.com/khawar512/ViT-Survey

3
The categories of this paper are: physics
27
The categories of this paper are: comp-gas
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an