Real-time Shading-based Refinement for Consumer Depth Cameras

Beitrag in einer Fachzeitschrift


Details zur Publikation

Autor(en): Wu C, Niessner M, Izadi S, Theobald C, Stamminger M, Zollhöfer M
Zeitschrift: Acm Transactions on Graphics
Verlag: Association for Computing Machinery (ACM)
Jahr der Veröffentlichung: 2014
Band: 33
Heftnummer: 6
Seitenbereich: 200:1-10
ISSN: 0730-0301


Abstract


(Figure Presented) We present the first real-time method for refinement of depth data using shape-from-shading in general uncontrolled scenes. Per frame, our real-time algorithm takes raw noisy depth data and an aligned RGB image as input, and approximates the time-varying incident lighting, which is then used for geometry refinement. This leads to dramatically enhanced depth maps at 30Hz. Our algorithm makes few scene assumptions, handling arbitrary scene objects even under motion. To enable this type of real-time depth map enhancement, we contribute a new highly parallel algorithm that reformulates the inverse rendering optimization problem in prior work, allowing us to estimate lighting and shape in a temporally coherent way at video frame-rates. Our optimization problem is minimized using a new regular grid Gauss-Newton solver implemented fully on the GPU. We demonstrate results showing enhanced depth maps, which are comparable to offline methods but are computed orders of magnitude faster, as well as baseline comparisons with online filtering-based methods. We conclude with applications of our higher quality depth maps for improved real-time surface reconstruction and performance capture.


FAU-Autoren / FAU-Herausgeber

Stamminger, Marc Prof. Dr.
Lehrstuhl für Informatik 9 (Graphische Datenverarbeitung)
Zollhöfer, Michael
Lehrstuhl für Informatik 9 (Graphische Datenverarbeitung)


Autor(en) der externen Einrichtung(en)
Microsoft Corporation
Stanford University


Zitierweisen

APA:
Wu, C., Niessner, M., Izadi, S., Theobald, C., Stamminger, M., & Zollhöfer, M. (2014). Real-time Shading-based Refinement for Consumer Depth Cameras. Acm Transactions on Graphics, 33(6), 200:1-10. https://dx.doi.org/10.1145/2661229.2661232

MLA:
Wu, Chenglei, et al. "Real-time Shading-based Refinement for Consumer Depth Cameras." Acm Transactions on Graphics 33.6 (2014): 200:1-10.

BibTeX: 

Zuletzt aktualisiert 2018-11-08 um 00:24