Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Deep Semantic Manipulation of Facial Videos   Editing and manipulating facial features in videos is an interesting and
important field of research with a plethora of applications, ranging from movie
post-production and visual effects to realistic avatars for video games and
virtual assistants. To the best of our knowledge, this paper proposes the first
method to perform photorealistic manipulation of facial expressions in videos.
Our method supports semantic video manipulation based on neural rendering and
3D-based facial expression modelling. We focus on interactive manipulation of
the videos by altering and controlling the facial expressions, achieving
promising photorealistic results. The proposed method is based on a
disentangled representation and estimation of the 3D facial shape and activity,
providing the user with intuitive and easy-to-use control of the facial
expressions in the input video. We also introduce a user-friendly, interactive
AI tool that processes human-readable semantic labels about the desired emotion
manipulations in specific parts of the input video and synthesizes
photorealistic manipulated videos. We achieve that by mapping the emotion
labels to valence-arousal (VA) values, which in turn are mapped to disentangled
3D facial expressions through an especially designed and trained expression
decoder network. The paper presents detailed qualitative and quantitative
experiments, which demonstrate the effectiveness of our system and the
promising results it achieves. Additional results and videos can be found at
the supplementary material (https://github.com/Girish-03/DeepSemManipulation).

19
The categories of this paper are: eess
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
24
The categories of this paper are: dg-ga
13
The categories of this paper are: quant-ph
27
The categories of this paper are: comp-gas
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
16
The categories of this paper are: stat
20
The categories of this paper are: acc-phys
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci