How risky is my AI system? A method for transparent classification of AI system descriptions by regulated AI risk categories

Weinzierl S, Zilker S, Zschech P, Kraus M, Leibelt T, Matzner M (2024)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2024

Pages Range: 1-17

Conference Proceedings Title: Proceedings of the 45th International Conference on Information Systems

Event location: Bangkok, Thailand TH

URI: https://open.fau.de/bitstreams/092b306d-86fb-420d-8ba1-57172d11611a/download

Abstract

Risk-based artificial intelligence (AI) regulations define risk categories for AI-enabled systems. The operators of such systems must determine the risk category applicable to their AI systems. This requires detailed knowledge of the classification rules defined in the regulations. Only a few supporting tools have been developed to facilitate the task of risk classification. This paper presents a novel method that describes all the necessary steps to develop such a tool. To demonstrate and evaluate the method, it is instantiated for the European Union’s AI Act. The evaluation shows i) that the classification model achieves promising performance in predicting the risk categories for AI systems, ii) that users can effectively use the web application to carry out a risk classification, and iii) that users find SHAP text plots integrated into the web application helpful for understanding the reasons of a classification prediction.

Authors with CRIS profile

Sven Weinzierl Lehrstuhl für Digital Industrial Service Systems Sandra Zilker Lehrstuhl für Digital Industrial Service Systems Martin Matzner Lehrstuhl für Digital Industrial Service Systems

Involved external institutions

Universität Leipzig DE Germany (DE) Universität Regensburg DE Germany (DE)

How to cite

APA:

Weinzierl, S., Zilker, S., Zschech, P., Kraus, M., Leibelt, T., & Matzner, M. (2024). How risky is my AI system? A method for transparent classification of AI system descriptions by regulated AI risk categories. In Proceedings of the 45th International Conference on Information Systems (pp. 1-17). Bangkok, Thailand, TH.

MLA:

Weinzierl, Sven, et al. "How risky is my AI system? A method for transparent classification of AI system descriptions by regulated AI risk categories." Proceedings of the International Conference on Information Systems, Bangkok, Thailand 2024. 1-17.

BibTeX: Download