Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ADMP: An Adversarial Double Masks Based Pruning Framework For
  Unsupervised Cross-Domain Compression   Despite the recent progress of network pruning, directly applying it to the
Internet of Things (IoT) applications still faces two challenges, i.e. the
distribution divergence between end and cloud data and the missing of data
label on end devices. One straightforward solution is to combine the
unsupervised domain adaptation (UDA) technique and pruning. For example, the
model is first pruned on the cloud and then transferred from cloud to end by
UDA. However, such a naive combination faces high performance degradation.
Hence this work proposes an Adversarial Double Masks based Pruning (ADMP) for
such cross-domain compression. In ADMP, we construct a Knowledge Distillation
framework not only to produce pseudo labels but also to provide a measurement
of domain divergence as the output difference between the full-size teacher and
the pruned student. Unlike existing mask-based pruning works, two adversarial
masks, i.e. soft and hard masks, are adopted in ADMP. So ADMP can prune the
model effectively while still allowing the model to extract strong
domain-invariant features and robust classification boundaries. During
training, the Alternating Direction Multiplier Method is used to overcome the
binary constraint of {0,1}-masks. On Office31 and ImageCLEF-DA datasets, the
proposed ADMP can prune 60% channels with only 0.2% and 0.3% average accuracy
loss respectively. Compared with the state of art, we can achieve about 1.63x
parameters reduction and 4.1% and 5.1% accuracy improvement.

0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin
22
The categories of this paper are: chao-dyn
23
The categories of this paper are: solv-int
9
The categories of this paper are: nlin
2
The categories of this paper are: math
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
13
The categories of this paper are: quant-ph
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat