Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Negative Sample is Negative in Its Own Way: Tailoring Negative Sentences
  for Image-Text Retrieval   Matching model is essential for Image-Text Retrieval framework. Existing
research usually train the model with a triplet loss and explore various
strategy to retrieve hard negative sentences in the dataset. We argue that
current retrieval-based negative sample construction approach is limited in the
scale of the dataset thus fail to identify negative sample of high difficulty
for every image. We propose our TAiloring neGative Sentences with
Discrimination and Correction (TAGS-DC) to generate synthetic sentences
automatically as negative samples. TAGS-DC is composed of masking and refilling
to generate synthetic negative sentences with higher difficulty. To keep the
difficulty during training, we mutually improve the retrieval and generation
through parameter sharing. To further utilize fine-grained semantic of mismatch
in the negative sentence, we propose two auxiliary tasks, namely word
discrimination and word correction to improve the training. In experiments, we
verify the effectiveness of our model on MS-COCO and Flickr30K compared with
current state-of-the-art models and demonstrates its robustness and
faithfulness in the further analysis. Our code is available in
https://github.com/LibertFan/TAGS.

20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio
33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
0
The categories of this paper are: hep-ph
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
13
The categories of this paper are: quant-ph