Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Passing a Non-verbal Turing Test: Evaluating Gesture Animations
  Generated from Speech   People communicate using both speech and non-verbal signals such as gestures,
face expression or body pose. Non-verbal signals impact the meaning of the
spoken utterance in an abundance of ways. An absence of non-verbal signals
impoverishes the process of communication. Yet, when users are represented as
avatars, it is difficult to translate non-verbal signals along with the speech
into the virtual world without specialized motion-capture hardware. In this
paper, we propose a novel, data-driven technique for generating gestures
directly from speech. Our approach is based on the application of Generative
Adversarial Neural Networks (GANs) to model the correlation rather than
causation between speech and gestures. This approach approximates neuroscience
findings on how non-verbal communication and speech are correlated. We create a
large dataset which consists of speech and corresponding gestures in a 3D human
pose format from which our model learns the speaker-specific correlation. We
evaluate the proposed technique in a user study that is inspired by the Turing
test. For the study, we animate the generated gestures on a virtual character.
We find that users are not able to distinguish between the generated and the
recorded gestures. Moreover, users are able to identify our synthesized
gestures as related or not related to a given utterance. Code and videos are
available at https://github.com/mrebol/Gestures-From-Speech

4
The categories of this paper are: cond-mat
5
The categories of this paper are: gr-qc
31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
33
The categories of this paper are: plasm-ph
2
The categories of this paper are: math
32
The categories of this paper are: atom-ph
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
26
The categories of this paper are: bayes-an
9
The categories of this paper are: nlin
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph