Projection-Mapping-based 3D Painting

Klein V (2022)

Publication Language: English

Publication Type: Thesis

Publication year: 2022



3D painting denotes the process of drawing digitally in a three-dimensional virtual space. In contrast to Virtual Reality (VR) or classic Augmented Reality (AR), projection mapping still represents a largely unknown way of visualizing the digital painting on the physical target surface itself via projection. In this doctoral thesis, we identify the main barriers that keep projection-mapping-based 3D painting, also called projection painting, from being applied as a practical tool in ordinary work environments. We present new projection painting techniques that, on the one hand, explicitly target the spontaneous nature of rapid prototyping workflows. Instead of expecting the user to arduously provide a digital model of their physical target object, the Scan&Paint system incrementally scans the object itself during the painting session and applies image-based rendering techniques to store the paint data and render the painting. On the other hand, the Proxy Painting system innovatively mixes digital and traditional painting methods to bridge the gap between these supposedly contradicting disciplines. A copy of the target object, the so-called proxy object, is painted by the user with traditional means and the paint is digitally recorded and processed for projection onto the real target surface. We further introduce a fast marker-based software synchronization method for both systems' projector and camera to accurately capture the projected imagery during scanning procedures at the devices' native frame rates without the need of additional hardware. The overarching goal of the presented techniques is a high level of practicability and accessibility to advance projection painting to a viable tool in 3D painting.

Authors with CRIS profile

Related research project(s)

How to cite


Klein, V. (2022). Projection-Mapping-based 3D Painting (Dissertation).


Klein, Vanessa. Projection-Mapping-based 3D Painting. Dissertation, 2022.

BibTeX: Download