Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Exploring Overall Contextual Information for Image Captioning in
  Human-Like Cognitive Style   Image captioning is a research hotspot where encoder-decoder models combining
convolutional neural network (CNN) and long short-term memory (LSTM) achieve
promising results. Despite significant progress, these models generate
sentences differently from human cognitive styles. Existing models often
generate a complete sentence from the first word to the end, without
considering the influence of the following words on the whole sentence
generation. In this paper, we explore the utilization of a human-like cognitive
style, i.e., building overall cognition for the image to be described and the
sentence to be constructed, for enhancing computer image understanding. This
paper first proposes a Mutual-aid network structure with Bidirectional LSTMs
(MaBi-LSTMs) for acquiring overall contextual information. In the training
process, the forward and backward LSTMs encode the succeeding and preceding
words into their respective hidden states by simultaneously constructing the
whole sentence in a complementary manner. In the captioning process, the LSTM
implicitly utilizes the subsequent semantic information contained in its hidden
states. In fact, MaBi-LSTMs can generate two sentences in forward and backward
directions. To bridge the gap between cross-domain models and generate a
sentence with higher quality, we further develop a cross-modal attention
mechanism to retouch the two sentences by fusing their salient parts as well as
the salient areas of the image. Experimental results on the Microsoft COCO
dataset show that the proposed model improves the performance of
encoder-decoder models and achieves state-of-the-art results.

18
The categories of this paper are: econ
34
The categories of this paper are: chem-ph
24
The categories of this paper are: dg-ga
21
The categories of this paper are: adap-org
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
11
The categories of this paper are: hep-lat
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
7
The categories of this paper are: hep-th