Motion Compensated Frame Rate Up-Conversion Using 3D Frequency Selective Extrapolation and a Multi-Layer Consistency Check

Bätz M, Brand F, Eichenseer A, Kaup A (2017)

Publication Language: English

Publication Type: Conference contribution

Publication year: 2017

Pages Range: 1452-1456

Event location: New Orleans, LA US

ISBN: 978-1-5090-4117-6

DOI: 10.1109/ICASSP.2017.7952397

Abstract

A high temporal resolution is desirable in many applications such as entertainment systems, automotive systems, or video surveillance. Apart from using cameras with a higher temporal resolution, it is also possible to employ frame rate up-conversion methods to obtain an enhanced temporal resolution. In principle, those algorithms can be grouped into approaches that rely on a motion estimation and approaches that do not. Both strategies typically process a video sequence frame by frame and take into account only the directly adjacent frames to compute the intermediate frame. In this paper, we propose a frame rate up-conversion technique that employs a motion compensated three-dimensional reconstruction algorithm. As a result, the proposed method takes into account more than two frames and is capable of jointly reconstructing up to a certain amount of missing frames in a video sequence. Furthermore, we present a multi-layer consistency check to further improve the reconstruction. On average, simulation results show a luminance PSNR gain compared to a conventional frame rate up-conversion method of 0.5 dB. Visual examples substantiate our objective results.

Authors with CRIS profile

Michel Bätz Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Fabian Brand Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Andrea Eichenseer Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Andre Kaup Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)

How to cite

APA:

Bätz, M., Brand, F., Eichenseer, A., & Kaup, A. (2017). Motion Compensated Frame Rate Up-Conversion Using 3D Frequency Selective Extrapolation and a Multi-Layer Consistency Check. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 1452-1456). New Orleans, LA, US.

MLA:

Bätz, Michel, et al. "Motion Compensated Frame Rate Up-Conversion Using 3D Frequency Selective Extrapolation and a Multi-Layer Consistency Check." Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA 2017. 1452-1456.

BibTeX: Download