Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Probing Image-Language Transformers for Verb Understanding   Multimodal image-language transformers have achieved impressive results on a
variety of tasks that rely on fine-tuning (e.g., visual question answering and
image retrieval). We are interested in shedding light on the quality of their
pretrained representations -- in particular, if these models can distinguish
different types of verbs or if they rely solely on nouns in a given sentence.
To do so, we collect a dataset of image-sentence pairs (in English) consisting
of 421 verbs that are either visual or commonly found in the pretraining data
(i.e., the Conceptual Captions dataset). We use this dataset to evaluate
pretrained image-language transformers and find that they fail more in
situations that require verb understanding compared to other parts of speech.
We also investigate what category of verbs are particularly challenging.

14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
8
The categories of this paper are: hep-ex