3D Face Reconstruction From Radar Images

Bräutigam V, Wirth V, Ullmann I, Schüßler C, Vossiek M, Berking M, Egger B (2025)

Publication Type: Conference contribution

Publication year: 2025

Publisher: IEEE Computer Society

Pages Range: 4422-4431

Conference Proceedings Title: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

Event location: Nashville, TN

ISBN: 9798331599942

DOI: 10.1109/CVPRW67362.2025.00427

Abstract

The 3D reconstruction of faces gains wide attention in computer vision and is used in many fields of application, for example, animation, virtual reality, and even forensics. This work is motivated by monitoring patients in sleep laboratories. Due to their unique characteristics, sensors from the radar domain have advantages compared to optical sensors, namely penetration of electrically non-conductive materials and independence of light. These advantages of radar signals unlock new applications and require adaptation of 3D reconstruction frameworks. We propose a novel model-based method for 3D reconstruction from radar images. We generate a dataset of synthetic radar images with a physics-based but non-differentiable radar renderer. This dataset is used to train a CNN-based encoder to estimate the parameters of a 3D morphable face model. Whilst the encoder alone already leads to strong reconstructions of synthetic data, we extend our reconstruction in an Analysis-by-Synthesis fashion to a model-based autoencoder. This is enabled by learning the rendering process in the decoder, which acts as an object-specific differentiable radar renderer. Subsequently, the combination of both network parts is trained to minimize both, the loss of the parameters and the loss of the resulting reconstructed radar image. This leads to the additional benefit, that at test time the parameters can be further optimized by finetuning the autoencoder unsupervised on the image loss. We evaluated our frame-work on generated synthetic face images as well as on real radar images with 3D ground truth of four individuals. The dataset is available at https://doi.org/10.5281/zenodo.14264739.

Authors with CRIS profile

How to cite

APA:

Bräutigam, V., Wirth, V., Ullmann, I., Schüßler, C., Vossiek, M., Berking, M., & Egger, B. (2025). 3D Face Reconstruction From Radar Images. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (pp. 4422-4431). Nashville, TN, US: IEEE Computer Society.

MLA:

Bräutigam, Valentin, et al. "3D Face Reconstruction From Radar Images." Proceedings of the 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2025, Nashville, TN IEEE Computer Society, 2025. 4422-4431.

BibTeX: Download