Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: WavThruVec: Latent speech representation as intermediate features for
  neural speech synthesis   Recent advances in neural text-to-speech research have been dominated by
two-stage pipelines utilizing low-level intermediate speech representation such
as mel-spectrograms. However, such predetermined features are fundamentally
limited, because they do not allow to exploit the full potential of a
data-driven approach through learning hidden representations. For this reason,
several end-to-end methods have been proposed. However, such models are harder
to train and require a large number of high-quality recordings with
transcriptions. Here, we propose WavThruVec - a two-stage architecture that
resolves the bottleneck by using high-dimensional Wav2Vec 2.0 embeddings as
intermediate speech representation. Since these hidden activations provide
high-level linguistic features, they are more robust to noise. That allows us
to utilize annotated speech datasets of a lower quality to train the
first-stage module. At the same time, the second-stage component can be trained
on large-scale untranscribed audio corpora, as Wav2Vec 2.0 embeddings are
time-aligned and speaker-independent. This results in an increased
generalization capability to out-of-vocabulary words, as well as to a better
generalization to unseen speakers. We show that the proposed model not only
matches the quality of state-of-the-art neural models, but also presents useful
properties enabling tasks like voice conversion or zero-shot synthesis.

3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
18
The categories of this paper are: econ
10
The categories of this paper are: q-bio
17
The categories of this paper are: q-fin
35
The categories of this paper are: mtrl-th
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph