Blind image fusion for hyperspectral imaging with the directional total variation

Beitrag in einer Fachzeitschrift

Details zur Publikation

Autor(en): Bungert L, Ehrhardt MJ, Coomes D, Rasch J, Reisenhofer R, Schönlieb CB
Zeitschrift: Inverse Problems
Jahr der Veröffentlichung: 2018
Band: 34
Heftnummer: 4
ISSN: 0266-5611


Hyperspectral imaging is a cutting-edge type of remote sensing used for mapping vegetation properties, rock minerals and other materials. A major drawback of hyperspectral imaging devices is their intrinsic low spatial resolution. In this paper, we propose a method for increasing the spatial resolution of a hyperspectral image by fusing it with an image of higher spatial resolution that was obtained with a different imaging modality. This is accomplished by solving a variational problem in which the regularization functional is the directional total variation. To accommodate for possible mis-registrations between the two images, we consider a non-convex blind super-resolution problem where both a fused image and the corresponding convolution kernel are estimated. Using this approach, our model can realign the given images if needed. Our experimental results indicate that the non-convexity is negligible in practice and that reliable solutions can be computed using a variety of different optimization algorithms. Numerical results on real remote sensing data from plant sciences and urban monitoring show the potential of the proposed method and suggests that it is robust with respect to the regularization parameters, mis-registration and the shape of the kernel.

FAU-Autoren / FAU-Herausgeber

Bungert, Leon
Lehrstuhl für Angewandte Mathematik

Autor(en) der externen Einrichtung(en)
Fraunhofer-Institut für Nachrichtentechnik (Heinrich-Hertz-Institut FhG HHI)
Universität Wien / University of Vienna
University of Cambridge


Bungert, L., Ehrhardt, M.J., Coomes, D., Rasch, J., Reisenhofer, R., & Schönlieb, C.-B. (2018). Blind image fusion for hyperspectral imaging with the directional total variation. Inverse Problems, 34(4).

Bungert, Leon, et al. "Blind image fusion for hyperspectral imaging with the directional total variation." Inverse Problems 34.4 (2018).


Zuletzt aktualisiert 2019-30-01 um 21:08