  This paper proposes a gaze correction and animation method for
high-resolution, unconstrained portrait images, which can be trained without
the gaze angle and the head pose annotations. Common gaze-correction methods
usually require annotating training data with precise gaze, and head pose
information. Solving this problem using an unsupervised method remains an open
problem, especially for high-resolution face images in the wild, which are not
easy to annotate with gaze and head pose labels. To address this issue, we
first create two new portrait datasets: CelebGaze and high-resolution
CelebHQGaze. Second, we formulate the gaze correction task as an image
inpainting problem, addressed using a Gaze Correction Module (GCM) and a Gaze
Animation Module (GAM). Moreover, we propose an unsupervised training strategy,
i.e., Synthesis-As-Training, to learn the correlation between the eye region
features and the gaze angle. As a result, we can use the learned latent space
for gaze animation with semantic interpolation in this space. Moreover, to
alleviate both the memory and the computational costs in the training and the
inference stage, we propose a Coarse-to-Fine Module (CFM) integrated with GCM
and GAM. Extensive experiments validate the effectiveness of our method for
both the gaze correction and the gaze animation tasks in both low and
high-resolution face datasets in the wild and demonstrate the superiority of
our method with respect to the state of the arts. Code is available at
https://github.com/zhangqianhui/GazeAnimationV2
