Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: MaskConnect: Connectivity Learning by Gradient Descent   Although deep networks have recently emerged as the model of choice for many
computer vision problems, in order to yield good results they often require
time-consuming architecture search. To combat the complexity of design choices,
prior work has adopted the principle of modularized design which consists in
defining the network in terms of a composition of topologically identical or
similar building blocks (a.k.a. modules). This reduces architecture search to
the problem of determining the number of modules to compose and how to connect
such modules. Again, for reasons of design complexity and training cost,
previous approaches have relied on simple rules of connectivity, e.g.,
connecting each module to only the immediately preceding module or perhaps to
all of the previous ones. Such simple connectivity rules are unlikely to yield
the optimal architecture for the given problem.
  In this work we remove these predefined choices and propose an algorithm to
learn the connections between modules in the network. Instead of being chosen a
priori by the human designer, the connectivity is learned simultaneously with
the weights of the network by optimizing the loss function of the end task
using a modified version of gradient descent. We demonstrate our connectivity
learning method on the problem of multi-class image classification using two
popular architectures: ResNet and ResNeXt. Experiments on four different
datasets show that connectivity learning using our approach yields consistently
higher accuracy compared to relying on traditional predefined rules of
connectivity. Furthermore, in certain settings it leads to significant savings
in number of parameters.

22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
13
The categories of this paper are: quant-ph
29
The categories of this paper are: funct-an
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
21
The categories of this paper are: adap-org
2
The categories of this paper are: math
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
9
The categories of this paper are: nlin
34
The categories of this paper are: chem-ph
18
The categories of this paper are: econ
23
The categories of this paper are: solv-int
27
The categories of this paper are: comp-gas