Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Signing at Scale: Learning to Co-Articulate Signs for Large-Scale
  Photo-Realistic Sign Language Production   Sign languages are visual languages, with vocabularies as rich as their
spoken language counterparts. However, current deep-learning based Sign
Language Production (SLP) models produce under-articulated skeleton pose
sequences from constrained vocabularies and this limits applicability. To be
understandable and accepted by the deaf, an automatic SLP system must be able
to generate co-articulated photo-realistic signing sequences for large domains
of discourse.
  In this work, we tackle large-scale SLP by learning to co-articulate between
dictionary signs, a method capable of producing smooth signing while scaling to
unconstrained domains of discourse. To learn sign co-articulation, we propose a
novel Frame Selection Network (FS-Net) that improves the temporal alignment of
interpolated dictionary signs to continuous signing sequences. Additionally, we
propose SignGAN, a pose-conditioned human synthesis model that produces
photo-realistic sign language videos direct from skeleton pose. We propose a
novel keypoint-based loss function which improves the quality of synthesized
hand images.
  We evaluate our SLP model on the large-scale meineDGS (mDGS) corpus,
conducting extensive user evaluation showing our FS-Net approach improves
co-articulation of interpolated dictionary signs. Additionally, we show that
SignGAN significantly outperforms all baseline methods for quantitative
metrics, human perceptual studies and native deaf signer comprehension.

34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin
13
The categories of this paper are: quant-ph
16
The categories of this paper are: stat
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
11
The categories of this paper are: hep-lat
4
The categories of this paper are: cond-mat
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
10
The categories of this paper are: q-bio
18
The categories of this paper are: econ
3
The categories of this paper are: physics
25
The categories of this paper are: patt-sol