Frequency Selective Mesh-to-Grid Resampling for Image Communication

Koloda J, Seiler J, Kaup A (2017)

Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2017


Book Volume: 19

Pages Range: 1689-1701

Journal Issue: 8

DOI: 10.1109/TMM.2017.2683267


This paper presents a novel approach for image reconstruction from pixels located at arbitrary non-integer positions, called mesh. This task forms an intrinsic part of various multimedia applications, including super-resolution, fisheye imaging or generations of new views in multicamera systems, among others. We propose a new frequency selective mesh-to-grid resampling (FSMR) algorithm that aims at producing high quality reconstructions. It is inspired by the existing frequency selective reconstruction (FSR) algorithm that is known to exhibit high performance when pixels are located on the regular two-dimensional grid. However, if samples that are located at non-integer positions are involved, a severe overfitting problem arises from the fact that non-orthogonal weighted bases sampled at non-integer positions are used for signal modelling. In order to overcome this issue, we propose a novel stabilising mechanism that is based on a set of adaptively weighted initial estimates, called key points. We also show that Fourier basis, used in the classic grid-based FSR, yields complex signals when non-integer positions are involved. Since digital images are real-valued, we propose to employ two-dimensional cosine transform basis. Experimental results show the superiority of the proposed approach over a wide range of existing reconstruction techniques.

Authors with CRIS profile

How to cite


Koloda, J., Seiler, J., & Kaup, A. (2017). Frequency Selective Mesh-to-Grid Resampling for Image Communication. IEEE Transactions on Multimedia, 19(8), 1689-1701.


Koloda, Jan, Jürgen Seiler, and André Kaup. "Frequency Selective Mesh-to-Grid Resampling for Image Communication." IEEE Transactions on Multimedia 19.8 (2017): 1689-1701.

BibTeX: Download