Interactive Model-based Reconstruction of the Human Head using an RGB-D Sensor

Journal article


Publication Details

Author(s): Greiner G, Zollhöfer M, Stamminger M, Colaianni M, Thies J
Journal: Computer Animation and Virtual Worlds
Publication year: 2014
Volume: 25
Journal issue: 3-4
Pages range: 213-222
ISSN: 1546-4261
eISSN: 1546-427X


Abstract


We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB-D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high-quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm. The core of our method is a fast graphics processing unit-based nonlinear quasi-Newton solver that allows us to leverage all information of the RGB-D stream and fit a statistical head model to the observations at interactive frame rates. By jointly solving for shape, albedo and illumination parameters, we are able to reconstruct high-quality models including illumination corrected textures. All obtained reconstructions have a common topology and can be directly used as assets for games, films and various virtual reality applications. We show motion retargeting, retexturing and relighting examples. The accuracy of the presented algorithm is evaluated by a comparison against ground truth data. Copyright © 2014 John Wiley & Sons, Ltd.


FAU Authors / FAU Editors

Colaianni, Matteo
Lehrstuhl für Informatik 9 (Graphische Datenverarbeitung)
Greiner, Günther Prof. Dr.
Lehrstuhl für Informatik 9 (Graphische Datenverarbeitung)
Stamminger, Marc Prof. Dr.
Lehrstuhl für Informatik 9 (Graphische Datenverarbeitung)
Thies, Justus
Lehrstuhl für Informatik 9 (Graphische Datenverarbeitung)
Zollhöfer, Michael
Lehrstuhl für Informatik 9 (Graphische Datenverarbeitung)


How to cite

APA:
Greiner, G., Zollhöfer, M., Stamminger, M., Colaianni, M., & Thies, J. (2014). Interactive Model-based Reconstruction of the Human Head using an RGB-D Sensor. Computer Animation and Virtual Worlds, 25(3-4), 213-222. https://dx.doi.org/10.1002/cav.1584

MLA:
Greiner, Günther, et al. "Interactive Model-based Reconstruction of the Human Head using an RGB-D Sensor." Computer Animation and Virtual Worlds 25.3-4 (2014): 213-222.

BibTeX: 

Last updated on 2019-22-07 at 07:35