Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Realistic Speech-Driven Facial Animation with GANs   Speech-driven facial animation is the process that automatically synthesizes
talking characters based on speech signals. The majority of work in this domain
creates a mapping from audio features to visual features. This approach often
requires post-processing using computer graphics techniques to produce
realistic albeit subject dependent results. We present an end-to-end system
that generates videos of a talking head, using only a still image of a person
and an audio clip containing speech, without relying on handcrafted
intermediate features. Our method generates videos which have (a) lip movements
that are in sync with the audio and (b) natural facial expressions such as
blinks and eyebrow movements. Our temporal GAN uses 3 discriminators focused on
achieving detailed frames, audio-visual synchronization, and realistic
expressions. We quantify the contribution of each component in our model using
an ablation study and we provide insights into the latent representation of the
model. The generated videos are evaluated based on sharpness, reconstruction
quality, lip-reading accuracy, synchronization as well as their ability to
generate natural blinks.

2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
7
The categories of this paper are: hep-th
34
The categories of this paper are: chem-ph
27
The categories of this paper are: comp-gas
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an