Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Streaming Transformer Transducer Based Speech Recognition Using
  Non-Causal Convolution   This paper improves the streaming transformer transducer for speech
recognition by using non-causal convolution. Many works apply the causal
convolution to improve streaming transformer ignoring the lookahead context. We
propose to use non-causal convolution to process the center block and lookahead
context separately. This method leverages the lookahead context in convolution
and maintains similar training and decoding efficiency. Given the similar
latency, using the non-causal convolution with lookahead context gives better
accuracy than causal convolution, especially for open-domain dictation
scenarios. Besides, this paper applies talking-head attention and a novel
history context compression scheme to further improve the performance. The
talking-head attention improves the multi-head self-attention by transferring
information among different heads. The history context compression method
introduces more extended history context compactly. On our in-house data, the
proposed methods improve a small Emformer baseline with lookahead context by
relative WERR 5.1\%, 14.5\%, 8.4\% on open-domain dictation, assistant general
scenarios, and assistant calling scenarios, respectively.

27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
17
The categories of this paper are: q-fin
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
34
The categories of this paper are: chem-ph
9
The categories of this paper are: nlin
8
The categories of this paper are: hep-ex
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
29
The categories of this paper are: funct-an