Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Feature Learning in Deep Neural Networks - Studies on Speech Recognition
  Tasks   Recent studies have shown that deep neural networks (DNNs) perform
significantly better than shallow networks and Gaussian mixture models (GMMs)
on large vocabulary speech recognition tasks. In this paper, we argue that the
improved accuracy achieved by the DNNs is the result of their ability to
extract discriminative internal representations that are robust to the many
sources of variability in speech signals. We show that these representations
become increasingly insensitive to small perturbations in the input with
increasing network depth, which leads to better speech recognition performance
with deeper networks. We also show that DNNs cannot extrapolate to test samples
that are substantially different from the training examples. If the training
data are sufficiently representative, however, internal features learned by the
DNN are relatively stable with respect to speaker differences, bandwidth
differences, and environment distortion. This enables DNN-based recognizers to
perform as well or better than state-of-the-art systems based on GMMs or
shallow networks without the need for explicit model adaptation or feature
normalization.

17
The categories of this paper are: q-fin
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
9
The categories of this paper are: nlin
24
The categories of this paper are: dg-ga
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat
3
The categories of this paper are: physics