Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving Sequence-to-Sequence Acoustic Modeling by Adding
  Text-Supervision   This paper presents methods of making using of text supervision to improve
the performance of sequence-to-sequence (seq2seq) voice conversion. Compared
with conventional frame-to-frame voice conversion approaches, the seq2seq
acoustic modeling method proposed in our previous work achieved higher
naturalness and similarity. In this paper, we further improve its performance
by utilizing the text transcriptions of parallel training data. First, a
multi-task learning structure is designed which adds auxiliary classifiers to
the middle layers of the seq2seq model and predicts linguistic labels as a
secondary task. Second, a data-augmentation method is proposed which utilizes
text alignment to produce extra parallel sequences for model training.
Experiments are conducted to evaluate our proposed method with training sets at
different sizes. Experimental results show that the multi-task learning with
linguistic labels is effective at reducing the errors of seq2seq voice
conversion. The data-augmentation method can further improve the performance of
seq2seq voice conversion when only 50 or 100 training utterances are available.

31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
33
The categories of this paper are: plasm-ph
25
The categories of this paper are: patt-sol
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
35
The categories of this paper are: mtrl-th
5
The categories of this paper are: gr-qc
21
The categories of this paper are: adap-org
27
The categories of this paper are: comp-gas
10
The categories of this paper are: q-bio
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
9
The categories of this paper are: nlin