Identifying untrustworthy predictions in neural networks by geometric gradient analysis

Schwinn L, Nguyen A, Raab R, Bungert L, Tenbrinck D, Zanca D, Burger M, Eskofier B (2021)


Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2021

Event location: Online

URI: https://arxiv.org/abs/2102.12196

Abstract

The susceptibility of deep neural networks to untrustworthy predictions, including out-of-distribution (OOD) data and adversarial examples, still prevent their widespread use in safety-critical applications. Most existing methods either require a retraining of a given model to achieve robust identification of adversarial attacks or are limited to out-of-distribution sample detection only. In this work, we propose a geometric gradient analysis (GGA) to improve the identification of untrustworthy predictions without retraining of a given model. GGA analyzes the geometry of the loss landscape of neural networks based on the saliency maps of their respective input. We observe considerable differences between the input gradient geometry of trustworthy and untrustworthy predictions. Using these differences, GGA outperforms prior approaches in detecting OOD data and adversarial attacks, including state-of-the-art and adaptive attacks. Code is available at: https://github.com/mad-lab-fau/GGA-Identifying-Untrustworthy-Predictions


Authors with CRIS profile

How to cite

APA:

Schwinn, L., Nguyen, A., Raab, R., Bungert, L., Tenbrinck, D., Zanca, D.,... Eskofier, B. (2021). Identifying untrustworthy predictions in neural networks by geometric gradient analysis. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI). Online.

MLA:

Schwinn, Leo, et al. "Identifying untrustworthy predictions in neural networks by geometric gradient analysis." Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI), Online 2021.

BibTeX: Download