Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Multi-Task Learning Framework for Overcoming the Catastrophic
  Forgetting in Automatic Speech Recognition   Recently, data-driven based Automatic Speech Recognition (ASR) systems have
achieved state-of-the-art results. And transfer learning is often used when
those existing systems are adapted to the target domain, e.g., fine-tuning,
retraining. However, in the processes, the system parameters may well deviate
too much from the previously learned parameters. Thus, it is difficult for the
system training process to learn knowledge from target domains meanwhile not
forgetting knowledge from the previous learning process, which is called as
catastrophic forgetting (CF). In this paper, we attempt to solve the CF problem
with the lifelong learning and propose a novel multi-task learning (MTL)
training framework for ASR. It considers reserving original knowledge and
learning new knowledge as two independent tasks, respectively. On the one hand,
we constrain the new parameters not to deviate too far from the original
parameters and punish the new system when forgetting original knowledge. On the
other hand, we force the new system to solve new knowledge quickly. Then, a MTL
mechanism is employed to get the balance between the two tasks. We applied our
method to an End2End ASR task and obtained the best performance in both target
and original datasets.

28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
18
The categories of this paper are: econ
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph
16
The categories of this paper are: stat
11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio
26
The categories of this paper are: bayes-an
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc