Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Deep Portrait Lighting Enhancement with 3D Guidance   Despite recent breakthroughs in deep learning methods for image lighting
enhancement, they are inferior when applied to portraits because 3D facial
information is ignored in their models. To address this, we present a novel
deep learning framework for portrait lighting enhancement based on 3D facial
guidance. Our framework consists of two stages. In the first stage, corrected
lighting parameters are predicted by a network from the input bad lighting
image, with the assistance of a 3D morphable model and a differentiable
renderer. Given the predicted lighting parameter, the differentiable renderer
renders a face image with corrected shading and texture, which serves as the 3D
guidance for learning image lighting enhancement in the second stage. To better
exploit the long-range correlations between the input and the guidance, in the
second stage, we design an image-to-image translation network with a novel
transformer architecture, which automatically produces a lighting-enhanced
result. Experimental results on the FFHQ dataset and in-the-wild images show
that the proposed method outperforms state-of-the-art methods in terms of both
quantitative metrics and visual quality. We will publish our dataset along with
more results on https://cassiepython.github.io/egsr/index.html.

26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
34
The categories of this paper are: chem-ph
33
The categories of this paper are: plasm-ph
22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
5
The categories of this paper are: gr-qc
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an