Evaluating 3D human face reconstruction from a frontal 2D image, focusing on facial regions associated with foetal alcohol syndrome
Atuhaire F, Egger B, Mutsvangwa T (2023)
Publication Type: Journal article
Publication year: 2023
Journal
Book Volume: 119
Article Number: 12064
Journal Issue: 3-4
Abstract
Foetal alcohol syndrome (FAS) is a preventable condition caused by maternal alcohol consumption during pregnancy. The FAS facial phenotype is an important factor for diagnosis, alongside central nervous system impairments and growth abnormalities. Current methods for analysing the FAS facial phenotype rely on 3D facial image data, obtained from costly and complex surface scanning devices. An alternative is to use 2D images, which are easy to acquire with a digital camera or smart phone. However, 2D images lack the geometric accuracy required for accurate facial shape analysis. Our research offers a solution through the reconstruction of 3D human faces from single or multiple 2D images. We have developed a framework for evaluating 3D human face reconstruction from a single-input 2D image using a 3D face model for potential use in FAS assessment. We first built a generative morphable model of the face from a database of registered 3D face scans with diverse skin tones. Then we applied this model to reconstruct 3D face surfaces from single frontal images using a model-driven sampling algorithm. The accuracy of the predicted 3D face shapes was evaluated in terms of surface reconstruction error and the accuracy of FASrelevant landmark locations and distances. Results show an average root mean square error of 2.62 mm. Our framework has the potential to estimate 3D landmark positions for parts of the face associated with the FAS facial phenotype. Future work aims to improve on the accuracy and adapt the approach for use in clinical settings.
Authors with CRIS profile
Additional Organisation(s)
Involved external institutions
Mbarara University of Science and Technology (MUST)
Uganda (UG)
University of Cape Town (UCT)
South Africa (ZA)
Massachusetts Institute of Technology (MIT)
United States (USA) (US)
Uganda (UG)
University of Cape Town (UCT)
South Africa (ZA)
Massachusetts Institute of Technology (MIT)
United States (USA) (US)
How to cite
APA:
Atuhaire, F., Egger, B., & Mutsvangwa, T. (2023). Evaluating 3D human face reconstruction from a frontal 2D image, focusing on facial regions associated with foetal alcohol syndrome. South African Journal of Science, 119(3-4). https://dx.doi.org/10.17159/sajs.2023/12064
MLA:
Atuhaire, Felix, Bernhard Egger, and Tinashe Mutsvangwa. "Evaluating 3D human face reconstruction from a frontal 2D image, focusing on facial regions associated with foetal alcohol syndrome." South African Journal of Science 119.3-4 (2023).
BibTeX: Download