Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Context-aware Captions from Context-agnostic Supervision   We introduce an inference technique to produce discriminative context-aware
image captions (captions that describe differences between images or visual
concepts) using only generic context-agnostic training data (captions that
describe a concept or an image in isolation). For example, given images and
captions of "siamese cat" and "tiger cat", we generate language that describes
the "siamese cat" in a way that distinguishes it from "tiger cat". Our key
novelty is that we show how to do joint inference over a language model that is
context-agnostic and a listener which distinguishes closely-related concepts.
We first apply our technique to a justification task, namely to describe why an
image contains a particular fine-grained category as opposed to another
closely-related category of the CUB-200-2011 dataset. We then study
discriminative image captioning to generate language that uniquely refers to
one of two semantically-similar images in the COCO dataset. Evaluations with
discriminative ground truth for justification and human studies for
discriminative image captioning reveal that our approach outperforms baseline
generative and speaker-listener approaches for discrimination.

3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
5
The categories of this paper are: gr-qc
11
The categories of this paper are: hep-lat
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
0
The categories of this paper are: hep-ph