Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction

Sklyarova V, Chelishev J, Dogaru A, Medvedev I, Lempitsky V, Zakharov E (2023)

Publication Type: Conference contribution

Publication year: 2023

Publisher: Institute of Electrical and Electronics Engineers Inc.

Pages Range: 19705-19716

Conference Proceedings Title: Proceedings of the IEEE International Conference on Computer Vision

Event location: Paris FR

ISBN: 9798350307184

DOI: 10.1109/ICCV51070.2023.01810

Abstract

Generating realistic human 3D reconstructions using image or video data is essential for various communication and entertainment applications. While existing methods achieved impressive results for body and facial regions, realistic hair modeling still remains challenging due to its high mechanical complexity. This work proposes an approach capable of accurate hair geometry reconstruction at a strand level from a monocular video or multi-view images captured in uncontrolled lighting conditions. Our method has two stages, with the first stage performing joint reconstruction of coarse hair and bust shapes and hair orientation using implicit volumetric representations. The second stage then estimates a strand-level hair reconstruction by reconciling in a single optimization process the coarse volumetric constraints with hair strand and hairstyle priors learned from the synthetic data. To further increase the reconstruction fidelity, we incorporate image-based losses into the fitting process using a new differentiable renderer. The combined system, named Neural Haircut, achieves high realism and personalization of the reconstructed hairstyles. For video results, please refer to our project page †

Authors with CRIS profile

Andreea Ardelean Juniorprofessur für Cognitive Computer Vision (Stiftungsprofessur)

Involved external institutions

Cinemersive Labs Ltd GB United Kingdom (GB)

How to cite

APA:

Sklyarova, V., Chelishev, J., Dogaru, A., Medvedev, I., Lempitsky, V., & Zakharov, E. (2023). Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction. In Proceedings of the IEEE International Conference on Computer Vision (pp. 19705-19716). Paris, FR: Institute of Electrical and Electronics Engineers Inc..

MLA:

Sklyarova, Vanessa, et al. "Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction." Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision, ICCV 2023, Paris Institute of Electrical and Electronics Engineers Inc., 2023. 19705-19716.

BibTeX: Download