Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Two-Stage Augmentation and Adaptive CTC Fusion for Improved Robustness
  of Multi-Stream End-to-End ASR   Performance degradation of an Automatic Speech Recognition (ASR) system is
commonly observed when the test acoustic condition is different from training.
Hence, it is essential to make ASR systems robust against various environmental
distortions, such as background noises and reverberations. In a multi-stream
paradigm, improving robustness takes account of handling a variety of unseen
single-stream conditions and inter-stream dynamics. Previously, a practical
two-stage training strategy was proposed within multi-stream end-to-end ASR,
where Stage-2 formulates the multi-stream model with features from Stage-1
Universal Feature Extractor (UFE). In this paper, as an extension, we introduce
a two-stage augmentation scheme focusing on mismatch scenarios: Stage-1
Augmentation aims to address single-stream input varieties with data
augmentation techniques; Stage-2 Time Masking applies temporal masks on UFE
features of randomly selected streams to simulate diverse stream combinations.
During inference, we also present adaptive Connectionist Temporal
Classification (CTC) fusion with the help of hierarchical attention mechanisms.
Experiments have been conducted on two datasets, DIRHA and AMI, as a
multi-stream scenario. Compared with the previous training strategy,
substantial improvements are reported with relative word error rate reductions
of 29.7-59.3% across several unseen stream combinations.

33
The categories of this paper are: plasm-ph
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
2
The categories of this paper are: math
12
The categories of this paper are: nucl-th
20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
3
The categories of this paper are: physics
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con