Schwinn L, Nguyen A, Raab R, Bungert L, Tenbrinck D, Zanca D, Burger M, Eskofier B (2021)
Publication Language: English
Publication Type: Conference contribution, Conference Contribution
Publication year: 2021
Event location: Online
URI: https://arxiv.org/abs/2102.12196
The susceptibility of deep neural networks to untrustworthy predictions, including out-of-distribution (OOD) data and adversarial examples, still prevent their widespread use in safety-critical applications. Most existing methods either require a retraining of a given model to achieve robust identification of adversarial attacks or are limited to out-of-distribution sample detection only. In this work, we propose a geometric gradient analysis (GGA) to improve the identification of untrustworthy predictions without retraining of a given model. GGA analyzes the geometry of the loss landscape of neural networks based on the saliency maps of their respective input. We observe considerable differences between the input gradient geometry of trustworthy and untrustworthy predictions. Using these differences, GGA outperforms prior approaches in detecting OOD data and adversarial attacks, including state-of-the-art and adaptive attacks. Code is available at: https://github.com/mad-lab-fau/GGA-Identifying-Untrustworthy-Predictions
APA:
Schwinn, L., Nguyen, A., Raab, R., Bungert, L., Tenbrinck, D., Zanca, D.,... Eskofier, B. (2021). Identifying untrustworthy predictions in neural networks by geometric gradient analysis. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI). Online.
MLA:
Schwinn, Leo, et al. "Identifying untrustworthy predictions in neural networks by geometric gradient analysis." Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI), Online 2021.
BibTeX: Download