Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Paraphrasing Complex Network: Network Compression via Factor Transfer   Many researchers have sought ways of model compression to reduce the size of
a deep neural network (DNN) with minimal performance degradation in order to
use DNNs in embedded systems. Among the model compression methods, a method
called knowledge transfer is to train a student network with a stronger teacher
network. In this paper, we propose a novel knowledge transfer method which uses
convolutional operations to paraphrase teacher's knowledge and to translate it
for the student. This is done by two convolutional modules, which are called a
paraphraser and a translator. The paraphraser is trained in an unsupervised
manner to extract the teacher factors which are defined as paraphrased
information of the teacher network. The translator located at the student
network extracts the student factors and helps to translate the teacher factors
by mimicking them. We observed that our student network trained with the
proposed factor transfer method outperforms the ones trained with conventional
knowledge transfer methods.

35
The categories of this paper are: mtrl-th
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph
19
The categories of this paper are: eess
27
The categories of this paper are: comp-gas
22
The categories of this paper are: chao-dyn
12
The categories of this paper are: nucl-th
7
The categories of this paper are: hep-th
28
The categories of this paper are: alg-geom
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
18
The categories of this paper are: econ