Attention-guided Erasing

Bhandary Panambur A, Yu H, Bhat S, Madhu P, Bayer S, Maier A (2024)

Publication Type: Conference contribution

Publication year: 2024


Publisher: Springer Vieweg

Series: Informatik aktuell

City/Town: Wiesbaden

Pages Range: 13-18

Conference Proceedings Title: Bildverarbeitung für die Medizin 2024

Event location: Erlangen DE

ISBN: 9783658440367

DOI: 10.1007/978-3-658-44037-4_8


The assessment of breast density is crucial in the context of breast cancer screening, especially in populations with a higher percentage of dense breast tissues. This study introduces a novel data augmentation technique termed attention-guided erasing (AGE), devised to enhance the downstream classification of four distinct breast density categories in mammography following the BI-RADS recommendation in the Vietnamese cohort. The proposed method integrates supplementary information during transfer learning, utilizing visual attention maps derived from a vision transformer backbone trained using the self-supervised DINO method. These maps are utilized to erase background regions in the mammogram images, unveiling only the potential areas of dense breast tissues to the network. Through the incorporation of AGE during transfer learning with varying random probabilities, we consistently surpass classification performance compared to scenarios without AGE and the traditional random erasing transformation. We validate our methodology using the publicly available VinDr-Mammo dataset. Specifically, we attain a mean F1-score of 0.5910, outperforming values of 0.5594 and 0.5691 corresponding to scenarios without AGE and with random erasing (RE), respectively. This superiority is further substantiated by t-tests, revealing a p-value of p<0.0001, underscoring the statistical significance of our approach.

Authors with CRIS profile

How to cite


Bhandary Panambur, A., Yu, H., Bhat, S., Madhu, P., Bayer, S., & Maier, A. (2024). Attention-guided Erasing. In Andreas Maier, Thomas M. Deserno, Heinz Handels, Klaus Maier-Hein, Christoph Palm, Thomas Tolxdorff (Eds.), Bildverarbeitung für die Medizin 2024 (pp. 13-18). Erlangen, DE: Wiesbaden: Springer Vieweg.


Bhandary Panambur, Adarsh, et al. "Attention-guided Erasing." Proceedings of the Bildverarbeitung für die Medizin 2024, Erlangen Ed. Andreas Maier, Thomas M. Deserno, Heinz Handels, Klaus Maier-Hein, Christoph Palm, Thomas Tolxdorff, Wiesbaden: Springer Vieweg, 2024. 13-18.

BibTeX: Download