Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: MINT: Deep Network Compression via Mutual Information-based Neuron
  Trimming   Most approaches to deep neural network compression via pruning either
evaluate a filter's importance using its weights or optimize an alternative
objective function with sparsity constraints. While these methods offer a
useful way to approximate contributions from similar filters, they often either
ignore the dependency between layers or solve a more difficult optimization
objective than standard cross-entropy. Our method, Mutual Information-based
Neuron Trimming (MINT), approaches deep compression via pruning by enforcing
sparsity based on the strength of the relationship between filters of adjacent
layers, across every pair of layers. The relationship is calculated using
conditional geometric mutual information which evaluates the amount of similar
information exchanged between the filters using a graph-based criterion. When
pruning a network, we ensure that retained filters contribute the majority of
the information towards succeeding layers which ensures high performance. Our
novel approach outperforms existing state-of-the-art compression-via-pruning
methods on the standard benchmarks for this task: MNIST, CIFAR-10, and
ILSVRC2012, across a variety of network architectures. In addition, we discuss
our observations of a common denominator between our pruning methodology's
response to adversarial attacks and calibration statistics when compared to the
original network.

19
The categories of this paper are: eess
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
8
The categories of this paper are: hep-ex
9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
24
The categories of this paper are: dg-ga
20
The categories of this paper are: acc-phys
23
The categories of this paper are: solv-int
25
The categories of this paper are: patt-sol