Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Differentiable Adaptive Computation Time for Visual Reasoning   This paper presents a novel attention-based algorithm for achieving adaptive
computation called DACT, which, unlike existing ones, is end-to-end
differentiable. Our method can be used in conjunction with many networks; in
particular, we study its application to the widely known MAC architecture,
obtaining a significant reduction in the number of recurrent steps needed to
achieve similar accuracies, therefore improving its performance to computation
ratio. Furthermore, we show that by increasing the maximum number of steps
used, we surpass the accuracy of even our best non-adaptive MAC in the CLEVR
dataset, demonstrating that our approach is able to control the number of steps
without significant loss of performance. Additional advantages provided by our
approach include considerably improving interpretability by discarding useless
steps and providing more insights into the underlying reasoning process.
Finally, we present adaptive computation as an equivalent to an ensemble of
models, similar to a mixture of expert formulation. Both the code and the
configuration files for our experiments are made available to support further
research in this area.

5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
34
The categories of this paper are: chem-ph
24
The categories of this paper are: dg-ga
15
The categories of this paper are: nucl-ex
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
23
The categories of this paper are: solv-int
30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin
3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol