Frequency Selective Mesh-to-Grid Resampling for Image Communication

Journal article
(Original article)


Publication Details

Author(s): Koloda J, Seiler J, Kaup A
Journal: IEEE Transactions on Multimedia
Publication year: 2017
Volume: 19
Journal issue: 8
Pages range: 1689-1701
ISSN: 1520-9210
Language: English


Abstract


This paper presents a novel approach for image reconstruction from pixels located at arbitrary non-integer positions, called mesh. This task forms an intrinsic part of various multimedia applications, including super-resolution, fisheye imaging or generations of new views in multicamera systems, among others. We propose a new frequency selective mesh-to-grid resampling (FSMR) algorithm that aims at producing high quality reconstructions. It is inspired by the existing frequency selective reconstruction (FSR) algorithm that is known to exhibit high performance when pixels are located on the regular two-dimensional grid. However, if samples that are located at non-integer positions are involved, a severe overfitting problem arises from the fact that non-orthogonal weighted bases sampled at non-integer positions are used for signal modelling. In order to overcome this issue, we propose a novel stabilising mechanism that is based on a set of adaptively weighted initial estimates, called key points. We also show that Fourier basis, used in the classic grid-based FSR, yields complex signals when non-integer positions are involved. Since digital images are real-valued, we propose to employ two-dimensional cosine transform basis. Experimental results show the superiority of the proposed approach over a wide range of existing reconstruction techniques.



FAU Authors / FAU Editors

Kaup, Andre Prof. Dr.-Ing.
Lehrstuhl für Multimediakommunikation und Signalverarbeitung
Koloda, Jan
Lehrstuhl für Multimediakommunikation und Signalverarbeitung
Seiler, Jürgen Dr.-Ing.
Lehrstuhl für Multimediakommunikation und Signalverarbeitung


How to cite

APA:
Koloda, J., Seiler, J., & Kaup, A. (2017). Frequency Selective Mesh-to-Grid Resampling for Image Communication. IEEE Transactions on Multimedia, 19(8), 1689-1701.

MLA:
Koloda, Jan, Jürgen Seiler, and Andre Kaup. "Frequency Selective Mesh-to-Grid Resampling for Image Communication." IEEE Transactions on Multimedia 19.8 (2017): 1689-1701.

BibTeX: 

Last updated on 2018-19-04 at 03:52