Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Win the Lottery Ticket via Fourier Analysis: Frequencies Guided Network
  Pruning   With the remarkable success of deep learning recently, efficient network
compression algorithms are urgently demanded for releasing the potential
computational power of edge devices, such as smartphones or tablets. However,
optimal network pruning is a non-trivial task which mathematically is an
NP-hard problem. Previous researchers explain training a pruned network as
buying a lottery ticket. In this paper, we investigate the Magnitude-Based
Pruning (MBP) scheme and analyze it from a novel perspective through Fourier
analysis on the deep learning model to guide model designation. Besides
explaining the generalization ability of MBP using Fourier transform, we also
propose a novel two-stage pruning approach, where one stage is to obtain the
topological structure of the pruned network and the other stage is to retrain
the pruned network to recover the capacity using knowledge distillation from
lower to higher on the frequency domain. Extensive experiments on CIFAR-10 and
CIFAR-100 demonstrate the superiority of our novel Fourier analysis based MBP
compared to other traditional MBP algorithms.

2
The categories of this paper are: math
17
The categories of this paper are: q-fin
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph