Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Image Captioning using Facial Expression and Attention   Benefiting from advances in machine vision and natural language processing
techniques, current image captioning systems are able to generate detailed
visual descriptions. For the most part, these descriptions represent an
objective characterisation of the image, although some models do incorporate
subjective aspects related to the observer's view of the image, such as
sentiment; current models, however, usually do not consider the emotional
content of images during the caption generation process. This paper addresses
this issue by proposing novel image captioning models which use facial
expression features to generate image captions. The models generate image
captions using long short-term memory networks applying facial features in
addition to other visual features at different time steps. We compare a
comprehensive collection of image captioning models with and without facial
features using all standard evaluation metrics. The evaluation metrics indicate
that applying facial features with an attention mechanism achieves the best
performance, showing more expressive and more correlated image captions, on an
image caption dataset extracted from the standard Flickr 30K dataset,
consisting of around 11K images containing faces. An analysis of the generated
captions finds that, perhaps unexpectedly, the improvement in caption quality
appears to come not from the addition of adjectives linked to emotional aspects
of the images, but from more variety in the actions described in the captions.

15
The categories of this paper are: nucl-ex
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
16
The categories of this paper are: stat
29
The categories of this paper are: funct-an
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio