High Dynamic Range Video Reconstruction from a Stereo Camera Setup

Bätz M, Richter T, Garbas JU, Papst A, Seiler J, Kaup A (2014)

Publication Language: English

Publication Type: Journal article

Publication year: 2014

Journal

Signal Processing-Image Communication Elsevier

Publisher: Elsevier

Book Volume: 29

Pages Range: 191-202

Journal Issue: 2

DOI: 10.1016/j.image.2013.08.016

Abstract

To overcome the dynamic range limitations in images taken with regular consumer cameras, several methods exist for creating high dynamic range (HDR) content. Current low-budget solutions apply a temporal exposure bracketing which is not applicable for dynamic scenes or HDR video. In this article, a framework is presented that utilizes two cameras to realize a spatial exposure bracketing, for which the different exposures are distributed among the cameras. Such a setup allows for HDR images of dynamic scenes and HDR video due to its frame by frame operating principle, but faces challenges in the stereo matching and HDR generation steps. Therefore, the modules in this framework are selected to alleviate these challenges and to properly handle under- and oversaturated regions. In comparison to existing work, the camera response calculation is shifted to an offline process and a masking with a saturation map before the actual HDR generation is proposed. The first aspect enables the use of more complex camera setups with different sensors and provides robust camera responses. The second one makes sure that only necessary pixel values are used from the additional camera view, and thus, reduces errors in the final HDR image. The resulting HDR images are compared with the quality metric HDR-VDP-2 and numerical results are given for the first time. For the Middlebury test images, an average gain of 52 points on a 0-100 mean opinion score is achieved in comparison to temporal exposure bracketing with camera motion. Finally, HDR video results are provided.

Authors with CRIS profile

Michel Bätz Lehrstuhl für Multimediakommunikation und Signalverarbeitung Thomas Richter Lehrstuhl für Multimediakommunikation und Signalverarbeitung Jürgen Seiler Lehrstuhl für Multimediakommunikation und Signalverarbeitung Andre Kaup Lehrstuhl für Multimediakommunikation und Signalverarbeitung

Involved external institutions

Fraunhofer-Institut für Integrierte Schaltungen (IIS) DE Germany (DE)

How to cite

APA:

Bätz, M., Richter, T., Garbas, J.-U., Papst, A., Seiler, J., & Kaup, A. (2014). High Dynamic Range Video Reconstruction from a Stereo Camera Setup. Signal Processing-Image Communication, 29(2), 191-202. https://doi.org/10.1016/j.image.2013.08.016

MLA:

Bätz, Michel, et al. "High Dynamic Range Video Reconstruction from a Stereo Camera Setup." Signal Processing-Image Communication 29.2 (2014): 191-202.

BibTeX: Download