Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Relaxing the Conditional Independence Assumption of CTC-based ASR by
  Conditioning on Intermediate Predictions   This paper proposes a method to relax the conditional independence assumption
of connectionist temporal classification (CTC)-based automatic speech
recognition (ASR) models. We train a CTC-based ASR model with auxiliary CTC
losses in intermediate layers in addition to the original CTC loss in the last
layer. During both training and inference, each generated prediction in the
intermediate layers is summed to the input of the next layer to condition the
prediction of the last layer on those intermediate predictions. Our method is
easy to implement and retains the merits of CTC-based ASR: a simple model
architecture and fast decoding speed. We conduct experiments on three different
ASR corpora. Our proposed method improves a standard CTC model significantly
(e.g., more than 20 % relative word error rate reduction on the WSJ corpus)
with a little computational overhead. Moreover, for the TEDLIUM2 corpus and the
AISHELL-1 corpus, it achieves a comparable performance to a strong
autoregressive model with beam search, but the decoding speed is at least 30
times faster.

30
The categories of this paper are: q-alg
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
31
The categories of this paper are: ao-sci
25
The categories of this paper are: patt-sol
16
The categories of this paper are: stat
11
The categories of this paper are: hep-lat
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
29
The categories of this paper are: funct-an
20
The categories of this paper are: acc-phys
15
The categories of this paper are: nucl-ex
3
The categories of this paper are: physics