Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Exact Adversarial Attack to Image Captioning via Structured Output
  Learning with Latent Variables   In this work, we study the robustness of a CNN+RNN based image captioning
system being subjected to adversarial noises. We propose to fool an image
captioning system to generate some targeted partial captions for an image
polluted by adversarial noises, even the targeted captions are totally
irrelevant to the image content. A partial caption indicates that the words at
some locations in this caption are observed, while words at other locations are
not restricted.It is the first work to study exact adversarial attacks of
targeted partial captions. Due to the sequential dependencies among words in a
caption, we formulate the generation of adversarial noises for targeted partial
captions as a structured output learning problem with latent variables. Both
the generalized expectation maximization algorithm and structural SVMs with
latent variables are then adopted to optimize the problem. The proposed methods
generate very successful at-tacks to three popular CNN+RNN based image
captioning models. Furthermore, the proposed attack methods are used to
understand the inner mechanism of image captioning systems, providing the
guidance to further improve automatic image captioning systems towards human
captioning.

30
The categories of this paper are: q-alg
6
The categories of this paper are: astro-ph
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
0
The categories of this paper are: hep-ph
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
5
The categories of this paper are: gr-qc