Enhancing Zero-Shot Learning in Chest X-ray Diagnostics Using BioBERT for Textual Representation

Bharadwaj P, Bhat S, Maier A (2025)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2025

Event location: Regensburg DE

Abstract

Accurate diagnosis of pulmonary diseases from chest X-rays remains a challenging task, especially due to the scarcity of labeled data. In this work, we propose an enhanced zero-shot learning framework that integrates BioBERT—a pre-trained model for biomedical text representation—into a contrastive learning pipeline for medical imaging diagnostics. Our method leverages the synergy between textual radiology reports and image data by combining BioBERT with a CLIP-based architecture. To address the lack of textual data in standard datasets, we generate synthetic radiology reports for each pathology, aiming to mimic the complexity of actual clinical descriptions. Through extensive experiments, we demonstrate significant improvements in disease classification accuracy and generalization, particularly in zero-shot inference scenarios. Our analysis also reveals how similarities in pathology descriptions can lead to misclassifications, emphasizing the importance of nuanced textual representations. This work establishes a zero-shot learning method in medical imaging, highlighting the potential of BioBERT in enhancing automated diagnostic systems for chest X-rays.

Authors with CRIS profile

Sheethal Bhat Lehrstuhl für Informatik 14 (Bild- und Sprachverarbeitung) (LME) Andreas Maier Lehrstuhl für Informatik 5 (Mustererkennung)

How to cite

APA:

Bharadwaj, P., Bhat, S., & Maier, A. (2025). Enhancing Zero-Shot Learning in Chest X-ray Diagnostics Using BioBERT for Textual Representation. In Proceedings of the Bildverarbeitung für die Medizin 2025. Regensburg, DE.

MLA:

Bharadwaj, Prakhar, Sheethal Bhat, and Andreas Maier. "Enhancing Zero-Shot Learning in Chest X-ray Diagnostics Using BioBERT for Textual Representation." Proceedings of the Bildverarbeitung für die Medizin 2025, Regensburg 2025.

BibTeX: Download