DeepWarp: Photorealistic Image Resynthesis for Gaze Manipulation

Ganin, Yaroslav; Kononenko, Daniil; Sungatullina, Diana; Lempitsky, Victor

doi:10.48550/arxiv.1607.07215

Search citation statements

Order By: Relevance

Paper Sections

Select...

Related Work1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2022

Publication Types

Select...

Other1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Photorealistic control of real eye imagery has been important to various application domains. Imagebased techniques such as [Buehler et al 2019;Ganin et al 2016;He et al 2019;Manduchi 2020, 2021;Kononenko and Lempitsky 2015;Lee et al 2018;Shrivastava et al 2017;Zheng et al 2020] have used eye keypoints, gaze direction or underlying segmentation masks as control signals to synthesize eye images for a given subject. Such works are primarily focused on gaze redirection or gaze correction application for portrait images and videos.…”

Section: Related Workmentioning

confidence: 99%

EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes

Li,

Meka,

Müller

et al. 2022

Preprint

View full text Add to dashboard Cite

reflection via spherical harmonics and can represent non-surface structures such as hair (i.e. eyebrows) or highly diffuse volumetric bodies (i.e. sclera), both of which are a challenge for explicit surface models. Tightly integrating the two representations in a joint framework allows controlled photoreal image synthesis and joint optimization of both the geometry parameters of the eyeball and the implicit neural network in continuous 3D space. We show that for high-resolution close-ups of the human eye, our model can synthesize high-fidelity animated gaze from novel views under unseen illumination conditions, allowing to generate visually rich eye imagery.CCS Concepts: • Computing methodologies → Rendering.

show abstract