Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Generalization of Spectrum Differential based Direct Waveform
  Modification for Voice Conversion   We present a modification to the spectrum differential based direct waveform
modification for voice conversion (DIFFVC) so that it can be directly applied
as a waveform generation module to voice conversion models. The recently
proposed DIFFVC avoids the use of a vocoder, meanwhile preserves rich spectral
details hence capable of generating high quality converted voice. To apply the
DIFFVC framework, a model that can estimate the spectral differential from the
F0 transformed input speech needs to be trained beforehand. This requirement
imposes several constraints, including a limitation on the estimation model to
parallel training and the need of extra training on each conversion pair, which
make DIFFVC inflexible. Based on the above motivations, we propose a new DIFFVC
framework based on an F0 transformation in the residual domain. By performing
inverse filtering on the input signal followed by synthesis filtering on the F0
transformed residual signal using the converted spectral features directly, the
spectral conversion model does not need to be retrained or capable of
predicting the spectral differential. We describe several details that need to
be taken care of under this modification, and by applying our proposed method
to a non-parallel, variational autoencoder (VAE)-based spectral conversion
model, we demonstrate that this framework can be generalized to any spectral
conversion model, and experimental evaluations show that it can outperform a
baseline framework whose waveform generation process is carried out by a
vocoder.

28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
34
The categories of this paper are: chem-ph
3
The categories of this paper are: physics
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
1
The categories of this paper are: cs
2
The categories of this paper are: math
17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
0
The categories of this paper are: hep-ph
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
11
The categories of this paper are: hep-lat