Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Visual Relationship Detection with Internal and External Linguistic
  Knowledge Distillation   Understanding visual relationships involves identifying the subject, the
object, and a predicate relating them. We leverage the strong correlations
between the predicate and the (subj,obj) pair (both semantically and spatially)
to predict the predicates conditioned on the subjects and the objects. Modeling
the three entities jointly more accurately reflects their relationships, but
complicates learning since the semantic space of visual relationships is huge
and the training data is limited, especially for the long-tail relationships
that have few instances. To overcome this, we use knowledge of linguistic
statistics to regularize visual model learning. We obtain linguistic knowledge
by mining from both training annotations (internal knowledge) and publicly
available text, e.g., Wikipedia (external knowledge), computing the conditional
probability distribution of a predicate given a (subj,obj) pair. Then, we
distill the knowledge into a deep model to achieve better generalization. Our
experimental results on the Visual Relationship Detection (VRD) and Visual
Genome datasets suggest that with this linguistic knowledge distillation, our
model outperforms the state-of-the-art methods significantly, especially when
predicting unseen relationships (e.g., recall improved from 8.45% to 19.17% on
VRD zero-shot testing set).

2
The categories of this paper are: math
17
The categories of this paper are: q-fin
8
The categories of this paper are: hep-ex
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin
34
The categories of this paper are: chem-ph