Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Speech Synthesis from Text and Ultrasound Tongue Image-based
  Articulatory Input   Articulatory information has been shown to be effective in improving the
performance of HMM-based and DNN-based text-to-speech synthesis. Speech
synthesis research focuses traditionally on text-to-speech conversion, when the
input is text or an estimated linguistic representation, and the target is
synthesized speech. However, a research field that has risen in the last decade
is articulation-to-speech synthesis (with a target application of a Silent
Speech Interface, SSI), when the goal is to synthesize speech from some
representation of the movement of the articulatory organs. In this paper, we
extend traditional (vocoder-based) DNN-TTS with articulatory input, estimated
from ultrasound tongue images. We compare text-only, ultrasound-only, and
combined inputs. Using data from eight speakers, we show that that the combined
text and articulatory input can have advantages in limited-data scenarios,
namely, it may increase the naturalness of synthesized speech compared to
single text input. Besides, we analyze the ultrasound tongue recordings of
several speakers, and show that misalignments in the ultrasound transducer
positioning can have a negative effect on the final synthesis performance.

13
The categories of this paper are: quant-ph
5
The categories of this paper are: gr-qc
9
The categories of this paper are: nlin
12
The categories of this paper are: nucl-th
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol
31
The categories of this paper are: ao-sci
32
The categories of this paper are: atom-ph
3
The categories of this paper are: physics
6
The categories of this paper are: astro-ph
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org