Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving non-autoregressive end-to-end speech recognition with
  pre-trained acoustic and language models   While Transformers have achieved promising results in end-to-end (E2E)
automatic speech recognition (ASR), their autoregressive (AR) structure becomes
a bottleneck for speeding up the decoding process. For real-world deployment,
ASR systems are desired to be highly accurate while achieving fast inference.
Non-autoregressive (NAR) models have become a popular alternative due to their
fast inference speed, but they still fall behind AR systems in recognition
accuracy. To fulfill the two demands, in this paper, we propose a NAR
CTC/attention model utilizing both pre-trained acoustic and language models:
wav2vec2.0 and BERT. To bridge the modality gap between speech and text
representations obtained from the pre-trained models, we design a novel
modality conversion mechanism, which is more suitable for logographic
languages. During inference, we employ a CTC branch to generate a target
length, which enables the BERT to predict tokens in parallel. We also design a
cache-based CTC/attention joint decoding method to improve the recognition
accuracy while keeping the decoding speed fast. Experimental results show that
the proposed NAR model greatly outperforms our strong wav2vec2.0 CTC baseline
(15.1% relative CER reduction on AISHELL-1). The proposed NAR model
significantly surpasses previous NAR systems on the AISHELL-1 benchmark and
shows a potential for English tasks.

32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
4
The categories of this paper are: cond-mat
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex