Interpretable generalized additive neural networks

Kraus M, Tschernutter D, Weinzierl S, Zschech P (2023)


Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2023

Journal

DOI: 10.1016/j.ejor.2023.06.032

Open Access Link: https://www.sciencedirect.com/science/article/pii/S0377221723005027

Abstract

We propose Interpretable Generalized Additive Neural Networks (IGANN), a novel machine learning model that uses gradient boosting and tailored neural networks to obtain high predictive performance while being interpretable to humans. We derive an efficient training algorithm based on the theory of extreme learning machines, that allows reducing the training process to solving a sequence of regularized linear regressions. We analyze the algorithm theoretically, provide insights into the rate of change of so-called shape functions, and show that the computational complexity of the training process scales linearly with the number of samples in the training dataset. We implement IGANN in PyTorch, which allows the model to be trained on graphics processing units (GPUs) to speed up training. We demonstrate favorable results in a variety of numerical experiments and showcase IGANN’s value in three real-world case studies for productivity prediction, credit scoring, and criminal recidivism prediction.

Authors with CRIS profile

Related research project(s)

How to cite

APA:

Kraus, M., Tschernutter, D., Weinzierl, S., & Zschech, P. (2023). Interpretable generalized additive neural networks. European Journal of Operational Research. https://dx.doi.org/10.1016/j.ejor.2023.06.032

MLA:

Kraus, Mathias, et al. "Interpretable generalized additive neural networks." European Journal of Operational Research (2023).

BibTeX: Download