Calibration by differentiation – Self-supervised calibration for X-ray microscopy using a differentiable cone-beam reconstruction operator

Thies M, Wagner F, Huang Y, Gu M, Kling L, Pechmann S, Aust O, Grüneboom A, Schett G, Christiansen SH, Maier A (2022)


Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2022

Journal

DOI: 10.1111/jmi.13125

Open Access Link: https://doi.org/10.1111/jmi.13125

Abstract

High-resolution X-ray microscopy (XRM) is gaining interest for biological investigations of extremely small-scale structures. XRM imaging of bones in living mice could provide new insights into the emergence and treatment of osteoporosis by observing osteocyte lacunae, which are holes in the bone of few micrometers in size. Imaging living animals at that resolution, however, is extremely challenging and requires very sophisticated data processing converting the raw XRM detector output into reconstructed images. This paper presents an open-source, differentiable reconstruction pipeline for XRM data which analytically computes the final image from the raw measurements. In contrast to most proprietary reconstruction software, it offers the user full control over each processing step and, additionally, makes the entire pipeline deep learning compatible by ensuring differentiability. This allows fitting trainable modules both before and after the actual reconstruction step in a purely data-driven way using the gradient-based optimizers of common deep learning frameworks. The value of such differentiability is demonstrated by calibrating the parameters of a simple cupping correction module operating on the raw projection images using only a self-supervisory quality metric based on the reconstructed volume and no further calibration measurements. The retrospective calibration directly improves image quality as it avoids cupping artifacts and decreases the difference in gray values between outer and inner bone by 68% to 94%. Furthermore, it makes the reconstruction process entirely independent of the XRM manufacturer and paves the way to explore modern deep learning reconstruction methods for arbitrary XRM and, potentially, other flat-panel CT systems. This exemplifies how differentiable reconstruction can be leveraged in the context of XRM and, hence, is an important step toward the goal of reducing the resolution limit of in-vivo bone imaging to the single micrometer domain.

Authors with CRIS profile

Related research project(s)

Involved external institutions

How to cite

APA:

Thies, M., Wagner, F., Huang, Y., Gu, M., Kling, L., Pechmann, S.,... Maier, A. (2022). Calibration by differentiation – Self-supervised calibration for X-ray microscopy using a differentiable cone-beam reconstruction operator. Journal of Microscopy. https://dx.doi.org/10.1111/jmi.13125

MLA:

Thies, Mareike, et al. "Calibration by differentiation – Self-supervised calibration for X-ray microscopy using a differentiable cone-beam reconstruction operator." Journal of Microscopy (2022).

BibTeX: Download