Robust Super-Resolution for Mixed-Resolution Multiview Image plus Depth Data

Journal article


Publication Details

Author(s): Richter T, Seiler J, Schnurrer W, Kaup A
Journal: IEEE Transactions on Circuits and Systems For Video Technology
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Publication year: 2016
Volume: 26
Journal issue: 5
Pages range: 814-828
ISSN: 1051-8215
Language: English


Abstract

Increasing spatial resolution and thus improving the image quality is a key issue in the mixed-resolution multiview image and video processing domain. Given adjacent camera perspectives with various spatial resolutions and their corresponding depth information, the high-frequency part of a high-resolution view can be used for increasing the image quality of a neighboring low-resolution camera perspective. However, a reasonable projection of high-frequency information onto the image plane of a neighboring low-resolution view typically requires pixel-wise error-free depth data for the high-resolution reference image. Starting from this, a novel image super-resolution approach is proposed that is robust against both inaccurate depth acquisition and nonperfect calibration of spatially low-resolution depth sensors. The algorithm is based on displacement-compensated high-frequency synthesis and aims at correcting the projection errors introduced by inaccurate depth information. The proposed approach is further effectively extended by a signal extrapolation technique. For a wide range of proper scenarios, the proposed framework achieves substantial objective and visual gains compared with the considered reference approaches. The improvement of quality is shown for both simulated and self-recorded experimental data.


FAU Authors / FAU Editors

Kaup, André Prof. Dr.-Ing.
Lehrstuhl für Multimediakommunikation und Signalverarbeitung
Richter, Thomas Dr.-Ing.
Lehrstuhl für Multimediakommunikation und Signalverarbeitung
Schnurrer, Wolfgang
Lehrstuhl für Multimediakommunikation und Signalverarbeitung
Seiler, Jürgen PD Dr.-Ing.
Lehrstuhl für Multimediakommunikation und Signalverarbeitung


How to cite

APA:
Richter, T., Seiler, J., Schnurrer, W., & Kaup, A. (2016). Robust Super-Resolution for Mixed-Resolution Multiview Image plus Depth Data. IEEE Transactions on Circuits and Systems For Video Technology, 26(5), 814-828. https://dx.doi.org/10.1109/TCSVT.2015.2426498

MLA:
Richter, Thomas, et al. "Robust Super-Resolution for Mixed-Resolution Multiview Image plus Depth Data." IEEE Transactions on Circuits and Systems For Video Technology 26.5 (2016): 814-828.

BibTeX: 

Last updated on 2019-19-04 at 13:01