Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Deconfounded Visual Grounding   We focus on the confounding bias between language and location in the visual
grounding pipeline, where we find that the bias is the major visual reasoning
bottleneck. For example, the grounding process is usually a trivial
language-location association without visual reasoning, e.g., grounding any
language query containing sheep to the nearly central regions, due to that most
queries about sheep have ground-truth locations at the image center. First, we
frame the visual grounding pipeline into a causal graph, which shows the
causalities among image, query, target location and underlying confounder.
Through the causal graph, we know how to break the grounding bottleneck:
deconfounded visual grounding. Second, to tackle the challenge that the
confounder is unobserved in general, we propose a confounder-agnostic approach
called: Referring Expression Deconfounder (RED), to remove the confounding
bias. Third, we implement RED as a simple language attention, which can be
applied in any grounding method. On popular benchmarks, RED improves various
state-of-the-art grounding methods by a significant margin. Code will soon be
available at: https://github.com/JianqiangH/Deconfounded_VG.

4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat
9
The categories of this paper are: nlin
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
19
The categories of this paper are: eess