Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning by Abstraction: The Neural State Machine   We introduce the Neural State Machine, seeking to bridge the gap between the
neural and symbolic views of AI and integrate their complementary strengths for
the task of visual reasoning. Given an image, we first predict a probabilistic
graph that represents its underlying semantics and serves as a structured world
model. Then, we perform sequential reasoning over the graph, iteratively
traversing its nodes to answer a given question or draw a new inference. In
contrast to most neural architectures that are designed to closely interact
with the raw sensory data, our model operates instead in an abstract latent
space, by transforming both the visual and linguistic modalities into semantic
concept-based representations, thereby achieving enhanced transparency and
modularity. We evaluate our model on VQA-CP and GQA, two recent VQA datasets
that involve compositionality, multi-step inference and diverse reasoning
skills, achieving state-of-the-art results in both cases. We provide further
experiments that illustrate the model's strong generalization capacity across
multiple dimensions, including novel compositions of concepts, changes in the
answer distribution, and unseen linguistic structures, demonstrating the
qualities and efficacy of our approach.

5
The categories of this paper are: gr-qc
31
The categories of this paper are: ao-sci
32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
34
The categories of this paper are: chem-ph
0
The categories of this paper are: hep-ph
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
35
The categories of this paper are: mtrl-th
8
The categories of this paper are: hep-ex
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
29
The categories of this paper are: funct-an