Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Seeing is Knowing! Fact-based Visual Question Answering using Knowledge
  Graph Embeddings   Fact-based Visual Question Answering (FVQA), a challenging variant of VQA,
requires a QA-system to include facts from a diverse knowledge graph (KG) in
its reasoning process to produce an answer. Large KGs, especially common-sense
KGs, are known to be incomplete, i.e., not all non-existent facts are always
incorrect. Therefore, being able to reason over incomplete KGs for QA is a
critical requirement in real-world applications that has not been addressed
extensively in the literature. We develop a novel QA architecture that allows
us to reason over incomplete KGs, something current FVQA state-of-the-art
(SOTA) approaches lack due to their critical reliance on fact retrieval. We use
KG Embeddings, a technique widely used for KG completion, for the downstream
task of FVQA. We also employ a new image representation technique we call
'Image-as-Knowledge' to enable this capability, alongside a simple one-step
CoAttention mechanism to attend to text and image during QA. Our FVQA
architecture is faster during inference time, being O(m), as opposed to
existing FVQA SOTA methods which are O(N log N), where m = number of vertices,
N = number of edges = O(m^2). KG embeddings are shown to hold complementary
information to word embeddings: a combination of both metrics permits
performance comparable to SOTA methods in the standard answer retrieval task,
and significantly better (26% absolute) in the proposed missing-edge reasoning
task.

22
The categories of this paper are: chao-dyn
4
The categories of this paper are: cond-mat
0
The categories of this paper are: hep-ph
12
The categories of this paper are: nucl-th
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
3
The categories of this paper are: physics
27
The categories of this paper are: comp-gas
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
8
The categories of this paper are: hep-ex
9
The categories of this paper are: nlin
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat