Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: 'Just because you are right, doesn't mean I am wrong': Overcoming a
  Bottleneck in the Development and Evaluation of Open-Ended Visual Question
  Answering (VQA) Tasks   GQA (Hudson and Manning, 2019) is a dataset for real-world visual reasoning
and compositional question answering. We found that many answers predicted by
the best visionlanguage models on the GQA dataset do not match the ground-truth
answer but still are semantically meaningful and correct in the given context.
In fact, this is the case with most existing visual question answering (VQA)
datasets where they assume only one ground-truth answer for each question. We
propose Alternative Answer Sets (AAS) of ground-truth answers to address this
limitation, which is created automatically using off-the-shelf NLP tools. We
introduce a semantic metric based on AAS and modify top VQA solvers to support
multiple plausible answers for a question. We implement this approach on the
GQA dataset and show the performance improvements.

5
The categories of this paper are: gr-qc
33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
30
The categories of this paper are: q-alg
27
The categories of this paper are: comp-gas
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
14
The categories of this paper are: math-ph
6
The categories of this paper are: astro-ph