Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ShrinkML: End-to-End ASR Model Compression Using Reinforcement Learning   End-to-end automatic speech recognition (ASR) models are increasingly large
and complex to achieve the best possible accuracy. In this paper, we build an
AutoML system that uses reinforcement learning (RL) to optimize the per-layer
compression ratios when applied to a state-of-the-art attention based
end-to-end ASR model composed of several LSTM layers. We use singular value
decomposition (SVD) low-rank matrix factorization as the compression method.
For our RL-based AutoML system, we focus on practical considerations such as
the choice of the reward/punishment functions, the formation of an effective
search space, and the creation of a representative but small data set for quick
evaluation between search steps. Finally, we present accuracy results on
LibriSpeech of the model compressed by our AutoML system, and we compare it to
manually-compressed models. Our results show that in the absence of retraining
our RL-based search is an effective and practical method to compress a
production-grade ASR system. When retraining is possible, we show that our
AutoML system can select better highly-compressed seed models compared to
manually hand-crafted rank selection, thus allowing for more compression than
previously possible.

6
The categories of this paper are: astro-ph
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
2
The categories of this paper are: math
20
The categories of this paper are: acc-phys
33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin