Beyond incompatibility: Trade-offs between mutually exclusive fairness criteria in machine learning and law
Zehlike M, Loosley A, Jonsson H, Wiedemann E, Hacker P (2025)
Publication Type: Journal article
Publication year: 2025
Journal
Book Volume: 340
Article Number: 104280
DOI: 10.1016/j.artint.2024.104280
Abstract
Fair and trustworthy AI is becoming ever more important in both machine learning and legal domains. One important consequence is that decision makers must seek to guarantee a ‘fair’, i.e., non-discriminatory, algorithmic decision procedure. However, there are several competing notions of algorithmic fairness that have been shown to be mutually incompatible under realistic factual assumptions. This concerns, for example, the widely used fairness measures of ‘calibration within groups’ and ‘balance for the positive/negative class,’ which relate to accuracy, false negative and false positive rates, respectively. In this paper, we present a novel algorithm (FAir Interpolation Method: FAIM) for continuously interpolating between these three fairness criteria. Thus, an initially unfair prediction can be remedied to meet, at least partially, a desired, weighted combination of the respective fairness conditions. We demonstrate the effectiveness of our algorithm when applied to synthetic data, the COMPAS data set, and a new, real-world data set from the e-commerce sector. We provide guidance on using our algorithm in different high-stakes contexts, and we discuss to what extent FAIM can be harnessed to comply with conflicting legal obligations. The analysis suggests that it may operationalize duties in traditional legal fields, such as credit scoring and criminal justice proceedings, but also for the latest AI regulations put forth in the EU, like the Digital Markets Act and the recently enacted AI Act.
Authors with CRIS profile
Involved external institutions
Germany (DE)How to cite
APA:
Zehlike, M., Loosley, A., Jonsson, H., Wiedemann, E., & Hacker, P. (2025). Beyond incompatibility: Trade-offs between mutually exclusive fairness criteria in machine learning and law. Artificial Intelligence, 340. https://doi.org/10.1016/j.artint.2024.104280
MLA:
Zehlike, Meike, et al. "Beyond incompatibility: Trade-offs between mutually exclusive fairness criteria in machine learning and law." Artificial Intelligence 340 (2025).
BibTeX: Download