Physics-aware learning and domain-specific loss design in ophthalmology

Burwinkel H, Matz H, Saur S, Hauger C, Trost M, Hirnschall N, Findl O, Navab N, Ahmadi SA (2022)

Publication Type: Journal article

Publication year: 2022

Journal

Medical Image Analysis Elsevier

Book Volume: 76

Article Number: 102314

DOI: 10.1016/j.media.2021.102314

Abstract

The human cataract, a developing opacification of the human eye lens, currently constitutes the world's most frequent cause for blindness. As a result, cataract surgery has become the most frequently performed ophthalmic surgery in the world. By removing the human lens and replacing it with an artificial intraocular lens (IOL), the optical system of the eye is restored. In order to receive a good refractive result, the IOL specifications, especially the refractive power, have to be determined precisely prior to surgery. In the last years, there has been a body of work to perform this prediction by using biometric information extracted from OCT imaging data, recently also by machine learning (ML) methods. Approaches so far consider only biometric information or physical modelling, but provide no effective combination, while often also neglecting IOL geometry. Additionally, ML on small data sets without sufficient domain coverage can be challenging. To solve these issues, we propose OpticNet, a novel optical refraction network based on an unsupervised, domain-specific loss function that explicitly incorporates physical information into the network. By providing a precise and differentiable light propagation eye model, physical gradients following the eye optics are backpropagated into the network. We further propose a new transfer learning procedure, which allows the unsupervised pre-training on the optical model and fine-tuning of the network on small amounts of surgical patient data. We show that our method outperforms the current state of the art on five OCT-image based data sets, provides better domain coverage within its predictions, and achieves better physical consistency.

Involved external institutions

Technische Universität München (TUM) DE Germany (DE) Carl Zeiss Meditec AG DE Germany (DE) Hanusch-Krankenhaus AT Austria (AT) Ludwig-Maximilians-Universität (LMU) DE Germany (DE)

How to cite

APA:

Burwinkel, H., Matz, H., Saur, S., Hauger, C., Trost, M., Hirnschall, N.,... Ahmadi, S.-A. (2022). Physics-aware learning and domain-specific loss design in ophthalmology. Medical Image Analysis, 76. https://doi.org/10.1016/j.media.2021.102314

MLA:

Burwinkel, Hendrik, et al. "Physics-aware learning and domain-specific loss design in ophthalmology." Medical Image Analysis 76 (2022).

BibTeX: Download