Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Grounding Referring Expressions in Images by Variational Context   We focus on grounding (i.e., localizing or linking) referring expressions in
images, e.g., "largest elephant standing behind baby elephant". This is a
general yet challenging vision-language task since it does not only require the
localization of objects, but also the multimodal comprehension of context ---
visual attributes (e.g., "largest", "baby") and relationships (e.g., "behind")
that help to distinguish the referent from other objects, especially those of
the same category. Due to the exponential complexity involved in modeling the
context associated with multiple image regions, existing work oversimplifies
this task to pairwise region modeling by multiple instance learning. In this
paper, we propose a variational Bayesian method, called Variational Context, to
solve the problem of complex context modeling in referring expression
grounding. Our model exploits the reciprocal relation between the referent and
context, i.e., either of them influences the estimation of the posterior
distribution of the other, and thereby the search space of context can be
greatly reduced, resulting in better localization of referent. We develop a
novel cue-specific language-vision embedding network that learns this
reciprocity model end-to-end. We also extend the model to the unsupervised
setting where no annotation for the referent is available. Extensive
experiments on various benchmarks show consistent improvement over
state-of-the-art methods in both supervised and unsupervised settings.

11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
10
The categories of this paper are: q-bio
35
The categories of this paper are: mtrl-th
9
The categories of this paper are: nlin
17
The categories of this paper are: q-fin
7
The categories of this paper are: hep-th
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
12
The categories of this paper are: nucl-th
14
The categories of this paper are: math-ph
20
The categories of this paper are: acc-phys