Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Physics-based Human Motion Estimation and Synthesis from Videos   Human motion synthesis is an important problem with applications in graphics,
gaming and simulation environments for robotics. Existing methods require
accurate motion capture data for training, which is costly to obtain. Instead,
we propose a framework for training generative models of physically plausible
human motion directly from monocular RGB videos, which are much more widely
available. At the core of our method is a novel optimization formulation that
corrects imperfect image-based pose estimations by enforcing physics
constraints and reasons about contacts in a differentiable way. This
optimization yields corrected 3D poses and motions, as well as their
corresponding contact forces. Results show that our physically-corrected
motions significantly outperform prior work on pose estimation. We can then use
these to train a generative model to synthesize future motion. We demonstrate
both qualitatively and quantitatively significantly improved motion estimation,
synthesis quality and physical plausibility achieved by our method on the large
scale Human3.6m dataset \cite{h36m_pami} as compared to prior kinematic and
physics-based methods. By enabling learning of motion synthesis from video, our
method paves the way for large-scale, realistic and diverse motion synthesis.

0
The categories of this paper are: hep-ph
34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
16
The categories of this paper are: stat
18
The categories of this paper are: econ
8
The categories of this paper are: hep-ex
6
The categories of this paper are: astro-ph
9
The categories of this paper are: nlin
2
The categories of this paper are: math
27
The categories of this paper are: comp-gas
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
23
The categories of this paper are: solv-int