A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video

Regensky A, Herglotz C, Kaup A (2021)

Publication Language: English

Publication Type: Conference contribution, Original article

Publication year: 2021

Event location: Toronto CA

URI: https://arxiv.org/abs/2202.13892

DOI: 10.1109/ICASSP39728.2021.9413576

Abstract

Although fisheye cameras are in high demand in many application areas due to their large fields of view, many image and video signal processing tasks such as motion compensation suffer from the introduced strong radial distortions. A recently proposed projection-based approach takes the fisheye projection into account to improve fisheye motion compensation. However, the approach does not consider the large field of view of fisheye lenses that requires the consideration of different motion planes in 3D space. We propose a novel viewport-adaptive motion compensation technique that applies the motion vectors in different perspective viewports in order to realize these motion planes. Thereby, some pixels are mapped to so-called virtual image planes and require special treatment to obtain reliable mappings between the perspective viewports and the original fisheye image. While the state-of-the-art ultra wide-angle compensation is sufficiently accurate, we propose a virtual image plane compensation that leads to perfect mappings. All in all, we achieve average gains of +2.40 dB in terms of PSNR compared to the state of the art in fisheye motion compensation.

Authors with CRIS profile

Andy Regensky Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Christian Herglotz Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Andre Kaup Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)

How to cite

APA:

Regensky, A., Herglotz, C., & Kaup, A. (2021). A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Toronto, CA.

MLA:

Regensky, Andy, Christian Herglotz, and André Kaup. "A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video." Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto 2021.

BibTeX: Download