Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Convolutional Neural Network Simplification with Progressive Retraining   Kernel pruning methods have been proposed to speed up, simplify, and improve
explanation of convolutional neural network (CNN) models. However, the
effectiveness of a simplified model is often below the original one. In this
letter, we present new methods based on objective and subjective relevance
criteria for kernel elimination in a layer-by-layer fashion. During the
process, a CNN model is retrained only when the current layer is entirely
simplified, by adjusting the weights from the next layer to the first one and
preserving weights of subsequent layers not involved in the process. We call
this strategy \emph{progressive retraining}, differently from kernel pruning
methods that usually retrain the entire model after each simplification action
-- e.g., the elimination of one or a few kernels. Our subjective relevance
criterion exploits the ability of humans in recognizing visual patterns and
improves the designer's understanding of the simplification process. The
combination of suitable relevance criteria and progressive retraining shows
that our methods can increase effectiveness with considerable model
simplification. We also demonstrate that our methods can provide better results
than two popular ones and another one from the state-of-the-art using four
challenging image datasets.

31
The categories of this paper are: ao-sci
13
The categories of this paper are: quant-ph
27
The categories of this paper are: comp-gas
36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
6
The categories of this paper are: astro-ph
7
The categories of this paper are: hep-th
25
The categories of this paper are: patt-sol
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
4
The categories of this paper are: cond-mat
33
The categories of this paper are: plasm-ph
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
14
The categories of this paper are: math-ph