Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Faces as Lighting Probes via Unsupervised Deep Highlight Extraction   We present a method for estimating detailed scene illumination using human
faces in a single image. In contrast to previous works that estimate lighting
in terms of low-order basis functions or distant point lights, our technique
estimates illumination at a higher precision in the form of a non-parametric
environment map. Based on the observation that faces can exhibit strong
highlight reflections from a broad range of lighting directions, we propose a
deep neural network for extracting highlights from faces, and then trace these
reflections back to the scene to acquire the environment map. Since real
training data for highlight extraction is very limited, we introduce an
unsupervised scheme for finetuning the network on real images, based on the
consistent diffuse chromaticity of a given face seen in multiple real images.
In tracing the estimated highlights to the environment, we reduce the blurring
effect of skin reflectance on reflected light through a deconvolution
determined by prior knowledge on face material properties. Comparisons to
previous techniques for highlight extraction and illumination estimation show
the state-of-the-art performance of this approach on a variety of indoor and
outdoor scenes.

34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
21
The categories of this paper are: adap-org
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
17
The categories of this paper are: q-fin
25
The categories of this paper are: patt-sol
23
The categories of this paper are: solv-int