Real-time Pixel Luminance Optimization for Dynamic Multi-projection Mapping

Siegl C, Colaianni M, Thies LTN, Thies J, Zollhöfer M, Izadi S, Stamminger M, Bauer F (2015)

Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2015


Publisher: Association for Computing Machinery (ACM)

City/Town: New York, NY, USA

Book Volume: 34

Pages Range: 237:1--237:11

Journal Issue: 6


DOI: 10.1145/2816795.2818111


Using projection mapping enables us to bring virtual worlds into shared physical spaces. In this paper, we present a novel, adaptable and real-time projection mapping system, which supports multiple projectors and high quality rendering of dynamic content on surfaces of complex geometrical shape. Our system allows for smooth blending across multiple projectors using a new optimization framework that simulates the diffuse direct light transport of the physical world to continuously adapt the color output of each projector pixel. We present a real-time solution to this optimization problem using off-the-shelf graphics hardware, depth cameras and projectors. Our approach enables us to move projectors, depth camera or objects while maintaining the correct illumination, in realtime, without the need for markers on the object. It also allows for projectors to be removed or dynamically added, and provides compelling results with only commodity hardware.

Authors with CRIS profile

Related research project(s)

How to cite


Siegl, C., Colaianni, M., Thies, L.T.-N., Thies, J., Zollhöfer, M., Izadi, S.,... Bauer, F. (2015). Real-time Pixel Luminance Optimization for Dynamic Multi-projection Mapping. Acm Transactions on Graphics, 34(6), 237:1--237:11.


Siegl, Christian, et al. "Real-time Pixel Luminance Optimization for Dynamic Multi-projection Mapping." Acm Transactions on Graphics 34.6 (2015): 237:1--237:11.

BibTeX: Download