Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Cross-modal Deep Face Normals with Deactivable Skip Connections   We present an approach for estimating surface normals from in-the-wild color
images of faces. While data-driven strategies have been proposed for single
face images, limited available ground truth data makes this problem difficult.
To alleviate this issue, we propose a method that can leverage all available
image and normal data, whether paired or not, thanks to a novel cross-modal
learning architecture. In particular, we enable additional training with single
modality data, either color or normal, by using two encoder-decoder networks
with a shared latent space. The proposed architecture also enables face details
to be transferred between the image and normal domains, given paired data,
through skip connections between the image encoder and normal decoder. Core to
our approach is a novel module that we call deactivable skip connections, which
allows integrating both the auto-encoded and image-to-normal branches within
the same architecture that can be trained end-to-end. This allows learning of a
rich latent space that can accurately capture the normal information. We
compare against state-of-the-art methods and show that our approach can achieve
significant improvements, both quantitative and qualitative, with natural face
images.

11
The categories of this paper are: hep-lat
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
22
The categories of this paper are: chao-dyn
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
24
The categories of this paper are: dg-ga
17
The categories of this paper are: q-fin
30
The categories of this paper are: q-alg
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg