Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Transformers in Action: Weakly Supervised Action Segmentation   The video action segmentation task is regularly explored under weaker forms
of supervision, such as transcript supervision, where a list of actions is
easier to obtain than dense frame-wise labels. In this formulation, the task
presents various challenges for sequence modeling approaches due to the
emphasis on action transition points, long sequence lengths, and frame
contextualization, making the task well-posed for transformers. Given
developments enabling transformers to scale linearly, we demonstrate through
our architecture how they can be applied to improve action alignment accuracy
over the equivalent RNN-based models with the attention mechanism focusing
around salient action transition regions. Additionally, given the recent focus
on inference-time transcript selection, we propose a supplemental transcript
embedding approach to select transcripts more quickly at inference-time.
Furthermore, we subsequently demonstrate how this approach can also improve the
overall segmentation performance. Finally, we evaluate our proposed methods
across the benchmark datasets to better understand the applicability of
transformers and the importance of transcript selection on this video-driven
weakly-supervised task.

25
The categories of this paper are: patt-sol
19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
14
The categories of this paper are: math-ph
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
32
The categories of this paper are: atom-ph
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph