Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Exploring Visual Relationship for Image Captioning   It is always well believed that modeling relationships between objects would
be helpful for representing and eventually describing an image. Nevertheless,
there has not been evidence in support of the idea on image description
generation. In this paper, we introduce a new design to explore the connections
between objects for image captioning under the umbrella of attention-based
encoder-decoder framework. Specifically, we present Graph Convolutional
Networks plus Long Short-Term Memory (dubbed as GCN-LSTM) architecture that
novelly integrates both semantic and spatial object relationships into image
encoder. Technically, we build graphs over the detected objects in an image
based on their spatial and semantic connections. The representations of each
region proposed on objects are then refined by leveraging graph structure
through GCN. With the learnt region-level features, our GCN-LSTM capitalizes on
LSTM-based captioning framework with attention mechanism for sentence
generation. Extensive experiments are conducted on COCO image captioning
dataset, and superior results are reported when comparing to state-of-the-art
approaches. More remarkably, GCN-LSTM increases CIDEr-D performance from 120.1%
to 128.7% on COCO testing set.

30
The categories of this paper are: q-alg
32
The categories of this paper are: atom-ph
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
19
The categories of this paper are: eess
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio
33
The categories of this paper are: plasm-ph
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
17
The categories of this paper are: q-fin
36
The categories of this paper are: cmp-lg
14
The categories of this paper are: math-ph
4
The categories of this paper are: cond-mat