Interactive Model-based Reconstruction of the Human Head using an RGB-D Sensor

Greiner G, Zollhöfer M, Stamminger M, Colaianni M, Thies J (2014)


Publication Type: Journal article

Publication year: 2014

Journal

Book Volume: 25

Pages Range: 213-222

Journal Issue: 3-4

DOI: 10.1002/cav.1584

Abstract

We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB-D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high-quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm. The core of our method is a fast graphics processing unit-based nonlinear quasi-Newton solver that allows us to leverage all information of the RGB-D stream and fit a statistical head model to the observations at interactive frame rates. By jointly solving for shape, albedo and illumination parameters, we are able to reconstruct high-quality models including illumination corrected textures. All obtained reconstructions have a common topology and can be directly used as assets for games, films and various virtual reality applications. We show motion retargeting, retexturing and relighting examples. The accuracy of the presented algorithm is evaluated by a comparison against ground truth data. Copyright © 2014 John Wiley & Sons, Ltd.

Authors with CRIS profile

How to cite

APA:

Greiner, G., Zollhöfer, M., Stamminger, M., Colaianni, M., & Thies, J. (2014). Interactive Model-based Reconstruction of the Human Head using an RGB-D Sensor. Computer Animation and Virtual Worlds, 25(3-4), 213-222. https://dx.doi.org/10.1002/cav.1584

MLA:

Greiner, Günther, et al. "Interactive Model-based Reconstruction of the Human Head using an RGB-D Sensor." Computer Animation and Virtual Worlds 25.3-4 (2014): 213-222.

BibTeX: Download