Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Towards Training Stronger Video Vision Transformers for
  EPIC-KITCHENS-100 Action Recognition   With the recent surge in the research of vision transformers, they have
demonstrated remarkable potential for various challenging computer vision
applications, such as image recognition, point cloud classification as well as
video understanding. In this paper, we present empirical results for training a
stronger video vision transformer on the EPIC-KITCHENS-100 Action Recognition
dataset. Specifically, we explore training techniques for video vision
transformers, such as augmentations, resolutions as well as initialization,
etc. With our training recipe, a single ViViT model achieves the performance of
47.4\% on the validation set of EPIC-KITCHENS-100 dataset, outperforming what
is reported in the original paper by 3.4%. We found that video transformers are
especially good at predicting the noun in the verb-noun action prediction task.
This makes the overall action prediction accuracy of video transformers notably
higher than convolutional ones. Surprisingly, even the best video transformers
underperform the convolutional networks on the verb prediction. Therefore, we
combine the video vision transformers and some of the convolutional video
networks and present our solution to the EPIC-KITCHENS-100 Action Recognition
competition.

36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ
16
The categories of this paper are: stat
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
7
The categories of this paper are: hep-th