Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Solving Visual Madlibs with Multiple Cues   This paper focuses on answering fill-in-the-blank style multiple choice
questions from the Visual Madlibs dataset. Previous approaches to Visual
Question Answering (VQA) have mainly used generic image features from networks
trained on the ImageNet dataset, despite the wide scope of questions. In
contrast, our approach employs features derived from networks trained for
specialized tasks of scene classification, person activity prediction, and
person and object attribute prediction. We also present a method for selecting
sub-regions of an image that are relevant for evaluating the appropriateness of
a putative answer. Visual features are computed both from the whole image and
from local regions, while sentences are mapped to a common space using a simple
normalized canonical correlation analysis (CCA) model. Our results show a
significant improvement over the previous state of the art, and indicate that
answering different question types benefits from examining a variety of image
cues and carefully choosing informative image sub-regions.

33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
30
The categories of this paper are: q-alg
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
28
The categories of this paper are: alg-geom
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
14
The categories of this paper are: math-ph
22
The categories of this paper are: chao-dyn
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ