Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Analyzing ASR pretraining for low-resource speech-to-text translation   Previous work has shown that for low-resource source languages, automatic
speech-to-text translation (AST) can be improved by pretraining an end-to-end
model on automatic speech recognition (ASR) data from a high-resource language.
However, it is not clear what factors --e.g., language relatedness or size of
the pretraining data-- yield the biggest improvements, or whether pretraining
can be effectively combined with other methods such as data augmentation. Here,
we experiment with pretraining on datasets of varying sizes, including
languages related and unrelated to the AST source language. We find that the
best predictor of final AST performance is the word error rate of the
pretrained ASR model, and that differences in ASR/AST performance correlate
with how phonetic information is encoded in the later RNN layers of our model.
We also show that pretraining and data augmentation yield complementary
benefits for AST.

9
The categories of this paper are: nlin
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg
7
The categories of this paper are: hep-th
27
The categories of this paper are: comp-gas
37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn