Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: PUDLE: Implicit Acceleration of Dictionary Learning by Backpropagation   The dictionary learning problem, representing data as a combination of a few
atoms, has long stood as a popular method for learning representations in
statistics and signal processing. The most popular dictionary learning
algorithm alternates between sparse coding and dictionary update steps, and
rich literature has studied its theoretical convergence. The growing popularity
of neurally plausible unfolded sparse coding networks has led to the empirical
finding that backpropagation through such networks performs dictionary
learning. This paper offers the theoretical proof for these empirical results
through PUDLE, a Provable Unfolded Dictionary LEarning method. We provide
sufficient conditions on the network initialization and data distribution for
model recovery. We highlight the impact of loss, unfolding, and backpropagation
on convergence. We discuss proper initializations and strategies to resolve the
instability issue concerning backpropagated gradient. This is achieved through
tuning network parameters and modification of loss function. We complement our
findings through synthetic and image denoising experiments. Finally, we
highlight the interpretability of PULDE by deriving a mathematical relation
between network weights, its output, and the training data.

13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
4
The categories of this paper are: cond-mat
6
The categories of this paper are: astro-ph
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
36
The categories of this paper are: cmp-lg
33
The categories of this paper are: plasm-ph
27
The categories of this paper are: comp-gas
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
23
The categories of this paper are: solv-int