Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Visual Abductive Reasoning   Abductive reasoning seeks the likeliest possible explanation for partial
observations. Although abduction is frequently employed in human daily
reasoning, it is rarely explored in computer vision literature. In this paper,
we propose a new task and dataset, Visual Abductive Reasoning (VAR), for
examining abductive reasoning ability of machine intelligence in everyday
visual situations. Given an incomplete set of visual events, AI systems are
required to not only describe what is observed, but also infer the hypothesis
that can best explain the visual premise. Based on our large-scale VAR dataset,
we devise a strong baseline model, Reasoner (causal-and-cascaded reasoning
Transformer). First, to capture the causal structure of the observations, a
contextualized directional position embedding strategy is adopted in the
encoder, that yields discriminative representations for the premise and
hypothesis. Then, multiple decoders are cascaded to generate and progressively
refine the premise and hypothesis sentences. The prediction scores of the
sentences are used to guide cross-sentence information flow in the cascaded
reasoning procedure. Our VAR benchmarking results show that Reasoner surpasses
many famous video-language models, while still being far behind human
performance. This work is expected to foster future efforts in the
reasoning-beyond-observation paradigm.

7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
0
The categories of this paper are: hep-ph
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
16
The categories of this paper are: stat
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
8
The categories of this paper are: hep-ex
13
The categories of this paper are: quant-ph