Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Sifting out the features by pruning: Are convolutional networks the
  winning lottery ticket of fully connected ones?   Pruning methods can considerably reduce the size of artificial neural
networks without harming their performance. In some cases, they can even
uncover sub-networks that, when trained in isolation, match or surpass the test
accuracy of their dense counterparts. Here we study the inductive bias that
pruning imprints in such "winning lottery tickets". Focusing on visual tasks,
we analyze the architecture resulting from iterative magnitude pruning of a
simple fully connected network (FCN). We show that the surviving node
connectivity is local in input space, and organized in patterns reminiscent of
the ones found in convolutional networks (CNN). We investigate the role played
by data and tasks in shaping the architecture of pruned sub-networks. Our
results show that the winning lottery tickets of FCNs display the key features
of CNNs. The ability of such automatic network-simplifying procedure to recover
the key features "hand-crafted" in the design of CNNs suggests interesting
applications to other datasets and tasks, in order to discover new and
efficient architectural inductive biases.

8
The categories of this paper are: hep-ex
26
The categories of this paper are: bayes-an
9
The categories of this paper are: nlin
0
The categories of this paper are: hep-ph
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
7
The categories of this paper are: hep-th
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph