CheXReport: A transformer-based architecture to generate chest X-ray reports suggestions
Zeiser FA, da Costa CA, de Oliveira Ramos G, Maier A, da Rosa Righi R (2024)
Publication Type: Journal article
Publication year: 2024
Journal
Book Volume: 255
Article Number: 124644
DOI: 10.1016/j.eswa.2024.124644
Abstract
Chest X-ray analysis plays a fundamental role in modern medicine for screening, diagnosing, and defining treatment strategies. This importance exposes radiologists to high workloads and demands for detecting increasingly specific findings. The task of assisting the chest x-ray imaging process is clinically relevant. However, current literature still captures relevant visual information and correlates it with the reports’ findings. In this way, the proposal for automatic suggestions for X-ray reports can assist in the X-ray analysis processes in clinical routine. This paper presents CheXReport model, designed to generate chest X-ray reports by leveraging a fully transformer-based encoder–decoder framework. Unlike traditional approaches, our model uses Swin Transformer blocks in both the encoder and decoder, improving the extraction and integration of visual and textual features from chest X-ray images. We evaluate the CheXReport on the publicly available MIMIC-CXR dataset comprising 377,110 images and corresponding free-text reports. Specifically, CheXReport achieves state-of-the-art performance on the MIMIC-CXR dataset, outperforming other leading models on BLEU-4 and ROUGE metrics. Our qualitative and quantitative analyses highlight the effectiveness of the fully transformer-based architecture in generating detailed, accurate, and contextually relevant radiology reports.
Authors with CRIS profile
Involved external institutions
Brazil (BR)How to cite
APA:
Zeiser, F.A., da Costa, C.A., de Oliveira Ramos, G., Maier, A., & da Rosa Righi, R. (2024). CheXReport: A transformer-based architecture to generate chest X-ray reports suggestions. Expert Systems With Applications, 255. https://doi.org/10.1016/j.eswa.2024.124644
MLA:
Zeiser, Felipe André, et al. "CheXReport: A transformer-based architecture to generate chest X-ray reports suggestions." Expert Systems With Applications 255 (2024).
BibTeX: Download