Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Cross-Utterance Language Models with Acoustic Error Sampling   The effective exploitation of richer contextual information in language
models (LMs) is a long-standing research problem for automatic speech
recognition (ASR). A cross-utterance LM (CULM) is proposed in this paper, which
augments the input to a standard long short-term memory (LSTM) LM with a
context vector derived from past and future utterances using an extraction
network. The extraction network uses another LSTM to encode surrounding
utterances into vectors which are integrated into a context vector using either
a projection of LSTM final hidden states, or a multi-head self-attentive layer.
In addition, an acoustic error sampling technique is proposed to reduce the
mismatch between training and test-time. This is achieved by considering
possible ASR errors into the model training procedure, and can therefore
improve the word error rate (WER). Experiments performed on both AMI and
Switchboard datasets show that CULMs outperform the LSTM LM baseline WER. In
particular, the CULM with a self-attentive layer-based extraction network and
acoustic error sampling achieves 0.6% absolute WER reduction on AMI, 0.3% WER
reduction on the Switchboard part and 0.9% WER reduction on the Callhome part
of Eval2000 test set over the respective baselines.

3
The categories of this paper are: physics
5
The categories of this paper are: gr-qc
11
The categories of this paper are: hep-lat
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
9
The categories of this paper are: nlin
12
The categories of this paper are: nucl-th
25
The categories of this paper are: patt-sol
2
The categories of this paper are: math
7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org