Fool Me Once, Shame On You, Fool Me Twice, Shame On Me: A Taxonomy of Attack and Defense Patterns for AI Security
Heinrich K, Graf J, Chen J, Laurisch J, Zschech P (2020)
Publication Language: English
Publication Type: Conference contribution
Publication year: 2020
Conference Proceedings Title: Proceedings of the 28th European Conference on Information Systems
Event location: Virtual Conference
ISBN: 978-1-7336325-1-5
URI: https://aisel.aisnet.org/ecis2020_rp/166/
Abstract
Advances in the area of AI systems lead to the application of complex deep neural networks (DNN) that outperform other algorithms in critical applications like predictive maintenance, healthcare or autonomous driving. Unfortunately, the properties that render them so successful also lead to vulnerabilities that can make them the subject of adversarial attacks. While these systems try to mimic human behavior when transforming large amounts of data into decision recommendations, they remain black-box models so that humans often fail to detect adversarial behavior patterns in the model training process. Therefore, we derive a taxonomy from an extensive literature review to structure the knowledge of possible attack and defense patterns to create a basis for the analysis and implementation of AI security for scientists and practitioners alike. Furthermore, we use the taxonomy to expose the most common attack pattern and, in addition, we demonstrate the application of the taxonomy by projecting two real-world cases onto the taxonomy space and discuss applicable attack and defense patterns.
Authors with CRIS profile
Additional Organisation(s)
Involved external institutions
Germany (DE)How to cite
APA:
Heinrich, K., Graf, J., Chen, J., Laurisch, J., & Zschech, P. (2020). Fool Me Once, Shame On You, Fool Me Twice, Shame On Me: A Taxonomy of Attack and Defense Patterns for AI Security. In Association for Information Systems (Eds.), Proceedings of the 28th European Conference on Information Systems. Virtual Conference.
MLA:
Heinrich, Kai, et al. "Fool Me Once, Shame On You, Fool Me Twice, Shame On Me: A Taxonomy of Attack and Defense Patterns for AI Security." Proceedings of the 28th European Conference on Information Systems (ECIS), Virtual Conference Ed. Association for Information Systems, 2020.
BibTeX: Download