Frame Rate Up-Conversion Using Key Point Agnostic Frequency-Selective Mesh-to-Grid Resampling

Heimann V, Spruck A, Kaup A (2021)

Publication Status: Accepted

Publication Type: Conference contribution, Conference Contribution

Publication year: 2021

Event location: Toronto (Virtual Conference) CA

URI: https://arxiv.org/abs/2210.10444

DOI: 10.1109/ICASSP39728.2021.9413684

Abstract

High frame rates are desired in many fields of application. As in many cases the frame repetition rate of an already captured video has to be increased, frame rate up-conversion (FRUC) is of high interest. We conduct a motion compensated approach. From two neighboring frames, the motion is estimated and the neighboring pixels are shifted along the motion vector into the frame to be reconstructed. For displaying, these irregularly distributed mesh pixels have to be resampled onto regularly spaced grid positions. We use the model-based key point ag- nostic frequency-selective mesh-to-grid resampling (AFSMR) for this task and show that AFSMR works best for applications that contain irregular meshes with varying densities. AFSMR gains up to 3.2 dB in contrast to the already high performing frequency-selective mesh-to-grid resampling (FSMR). Addition- ally, AFSMR increases the run time by a factor of 11 relative to FSMR.

Authors with CRIS profile

Viktoria Heimann Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Andreas Spruck Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Andre Kaup Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)

Additional Organisation(s)

Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)

How to cite

APA:

Heimann, V., Spruck, A., & Kaup, A. (2021). Frame Rate Up-Conversion Using Key Point Agnostic Frequency-Selective Mesh-to-Grid Resampling. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. Toronto (Virtual Conference), CA.

MLA:

Heimann, Viktoria, Andreas Spruck, and André Kaup. "Frame Rate Up-Conversion Using Key Point Agnostic Frequency-Selective Mesh-to-Grid Resampling." Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Toronto (Virtual Conference) 2021.

BibTeX: Download