Coping with Data Distribution Shifts: XAI-Based Adaptive Learning with SHAP Clustering for Energy Consumption Prediction

Clement T, Kemmerzell N, Nguyen Truong Thanh H, Abdelaal M, Stjelja D (2023)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2023

Event location: Brisbane AU

URI: https://link.springer.com/chapter/10.1007/978-981-99-8391-9_12

Abstract

Adapting to data distribution shifts after training remains a significant challenge within the realm of Artificial Intelligence. This paper presents a refined approach, superior to Automated Hyper Parameter Tuning methods, that effectively detects and learns from such shifts to improve the efficacy of prediction models. By integrating Explainable AI (XAI) techniques into adaptive learning with SHAP clustering, we generate interpretable model explanations and use these insights for adaptive refinement. Our three-stage process: (1) SHAP value generation for the model explanation, (2) clustering these values for pattern identification, and (3) model refinement based on the derived SHAP cluster characteristics, mitigates overfitting and ensures robust data shift handling. We evaluate our method on a comprehensive dataset comprising energy consumption records of buildings, as well as two additional datasets, to assess the transferability of our approach to other domains, regression, and classification problems. Our experiments highlight that our method not only improves predictive performance in both task types but also delivers interpretable model explanations, offering significant value in dealing with the challenges of data distribution shifts in AI.

Authors with CRIS profile

Tobias Clement Lehrstuhl für Wirtschaftsinformatik, insbesondere IT-Management Nils Kemmerzell Lehrstuhl für Wirtschaftsinformatik, insbesondere IT-Management Hung Nguyen Truong Thanh Lehrstuhl für Wirtschaftsinformatik, insbesondere IT-Management

Involved external institutions

Software AG DE Germany (DE) Granlund FI Finland (FI)

How to cite

APA:

Clement, T., Kemmerzell, N., Nguyen Truong Thanh, H., Abdelaal, M., & Stjelja, D. (2023). Coping with Data Distribution Shifts: XAI-Based Adaptive Learning with SHAP Clustering for Energy Consumption Prediction. In Proceedings of the Australasian Joint Conference on Artificial Intelligence (AJCAI). Brisbane, AU.

MLA:

Clement, Tobias, et al. "Coping with Data Distribution Shifts: XAI-Based Adaptive Learning with SHAP Clustering for Energy Consumption Prediction." Proceedings of the Australasian Joint Conference on Artificial Intelligence (AJCAI), Brisbane 2023.

BibTeX: Download