A multimodal comparison of latent denoising diffusion probabilistic models and generative adversarial networks for medical image synthesis

Müller-Franzes G, Niehues JM, Khader F, Tayebi Arasteh S, Haarburger C, Kuhl C, Wang T, Han T, Nolte T, Nebelung S, Kather JN, Truhn D (2023)


Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2023

Journal

Book Volume: 13

Article Number: 12098 (non-FAU publication)

DOI: 10.1038/s41598-023-39278-0

Open Access Link: https://www.nature.com/articles/s41598-023-39278-0

Abstract

Although generative adversarial networks (GANs) can produce large datasets, their limited diversity and fidelity have been recently addressed by denoising diffusion probabilistic models, which have demonstrated superiority in natural image synthesis. In this study, we introduce Medfusion, a conditional latent DDPM designed for medical image generation, and evaluate its performance against GANs, which currently represent the state-of-the-art. Medfusion was trained and compared with StyleGAN-3 using fundoscopy images from the AIROGS dataset, radiographs from the CheXpert dataset, and histopathology images from the CRCDX dataset. Based on previous studies, Progressively Growing GAN (ProGAN) and Conditional GAN (cGAN) were used as additional baselines on the CheXpert and CRCDX datasets, respectively. Medfusion exceeded GANs in terms of diversity (recall), achieving better scores of 0.40 compared to 0.19 in the AIROGS dataset, 0.41 compared to 0.02 (cGAN) and 0.24 (StyleGAN-3) in the CRMDX dataset, and 0.32 compared to 0.17 (ProGAN) and 0.08 (StyleGAN-3) in the CheXpert dataset. Furthermore, Medfusion exhibited equal or higher fidelity (precision) across all three datasets. Our study shows that Medfusion constitutes a promising alternative to GAN-based models for generating high-quality medical images, leading to improved diversity and less artifacts in the generated images.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Müller-Franzes, G., Niehues, J.M., Khader, F., Tayebi Arasteh, S., Haarburger, C., Kuhl, C.,... Truhn, D. (2023). A multimodal comparison of latent denoising diffusion probabilistic models and generative adversarial networks for medical image synthesis. Scientific Reports, 13. https://doi.org/10.1038/s41598-023-39278-0

MLA:

Müller-Franzes, Gustav, et al. "A multimodal comparison of latent denoising diffusion probabilistic models and generative adversarial networks for medical image synthesis." Scientific Reports 13 (2023).

BibTeX: Download