Loc3Diff: Local Diffusion for 3D Human Head Synthesis and Editing
Yushi Lan*, Feitong Tan, Qiangeng Xu, Di Qiu, Kyle Genova, Zeng Huang, Rohit Pandey, Sean Fanello
Abstract
"We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach constructs an implicit representation of 3D human heads, anchored on a parametric face model. To enhance representational capabilities and encode spatial information, we represent semantic consistent head region by a local tri-plane, modulated by a 3D Gaussian. Additionally, we parameterize these tri-planes in a 2D UV space via a 3DMM, enabling effective utilization of the diffusion model for 3D head avatar generation. Our method facilitates the creation of diverse and realistic 3D human heads with flexible global and fine-grained region-based editing over facial structures, appearance and expressions. Extensive experiments demonstrate the effectiveness of our method."
BibTeX
@inproceedings{eccv2024_loc3difflocaldif,
title = {Loc3Diff: Local Diffusion for 3D Human Head Synthesis and Editing},
author = {Yushi Lan* and Feitong Tan and Qiangeng Xu and Di Qiu and Kyle Genova and Zeng Huang and Rohit Pandey and Sean Fanello and Thomas Funkhouser and Chen Change Loy and Yinda Zhang*},
booktitle = {ECCV 2024},
year = {2024}
}