Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Who's Waldo? Linking People Across Text and Images   We present a task and benchmark dataset for person-centric visual grounding,
the problem of linking between people named in a caption and people pictured in
an image. In contrast to prior work in visual grounding, which is predominantly
object-based, our new task masks out the names of people in captions in order
to encourage methods trained on such image-caption pairs to focus on contextual
cues (such as rich interactions between multiple people), rather than learning
associations between names and appearances. To facilitate this task, we
introduce a new dataset, Who's Waldo, mined automatically from image-caption
data on Wikimedia Commons. We propose a Transformer-based method that
outperforms several strong baselines on this task, and are releasing our data
to the research community to spur work on contextual models that consider both
vision and language.

30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
16
The categories of this paper are: stat
25
The categories of this paper are: patt-sol
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
34
The categories of this paper are: chem-ph