Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Language Adaptive Cross-lingual Speech Representation Learning with
  Sparse Sharing Sub-networks   Unsupervised cross-lingual speech representation learning (XLSR) has recently
shown promising results in speech recognition by leveraging vast amounts of
unlabeled data across multiple languages. However, standard XLSR model suffers
from language interference problem due to the lack of language specific
modeling ability. In this work, we investigate language adaptive training on
XLSR models. More importantly, we propose a novel language adaptive
pre-training approach based on sparse sharing sub-networks. It makes room for
language specific modeling by pruning out unimportant parameters for each
language, without requiring any manually designed language specific component.
After pruning, each language only maintains a sparse sub-network, while the
sub-networks are partially shared with each other. Experimental results on a
downstream multilingual speech recognition task show that our proposed method
significantly outperforms baseline XLSR models on both high resource and low
resource languages. Besides, our proposed method consistently outperforms other
adaptation methods and requires fewer parameters.

35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
18
The categories of this paper are: econ
24
The categories of this paper are: dg-ga
11
The categories of this paper are: hep-lat
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph
22
The categories of this paper are: chao-dyn
16
The categories of this paper are: stat
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg