Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Unified Pruning Framework for Vision Transformers   Recently, vision transformer (ViT) and its variants have achieved promising
performances in various computer vision tasks. Yet the high computational costs
and training data requirements of ViTs limit their application in
resource-constrained settings. Model compression is an effective method to
speed up deep learning models, but the research of compressing ViTs has been
less explored. Many previous works concentrate on reducing the number of
tokens. However, this line of attack breaks down the spatial structure of ViTs
and is hard to be generalized into downstream tasks. In this paper, we design a
unified framework for structural pruning of both ViTs and its variants, namely
UP-ViTs. Our method focuses on pruning all ViTs components while maintaining
the consistency of the model structure. Abundant experimental results show that
our method can achieve high accuracy on compressed ViTs and variants, e.g.,
UP-DeiT-T achieves 75.79% accuracy on ImageNet, which outperforms the vanilla
DeiT-T by 3.59% with the same computational cost. UP-PVTv2-B0 improves the
accuracy of PVTv2-B0 by 4.83% for ImageNet classification. Meanwhile, UP-ViTs
maintains the consistency of the token representation and gains consistent
improvements on object detection tasks.

29
The categories of this paper are: funct-an
25
The categories of this paper are: patt-sol
34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
32
The categories of this paper are: atom-ph
11
The categories of this paper are: hep-lat
5
The categories of this paper are: gr-qc
6
The categories of this paper are: astro-ph
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph
35
The categories of this paper are: mtrl-th