Generic performance measure for multiclass-classifiers

Beitrag in einer Fachzeitschrift

Details zur Publikation

Autorinnen und Autoren: Kautz T, Eskofier B, Pasluosta CF
Zeitschrift: Pattern Recognition
Jahr der Veröffentlichung: 2017
Band: 68
Heftnummer: 8
Seitenbereich: 111 - 125
ISSN: 0031-3203
Sprache: Englisch


The evaluation of classification performance is crucial for algorithm and model selection. However, a performance measure for multiclass classification problems (i.e., more than two classes) has not yet been fully adopted in the pattern recognition and machine learning community. In this work, we introduce the multiclass performance score (MPS), a generic performance measure for multiclass problems. The MPS was designed to evaluate any multiclass classification algorithm for any arbitrary testing condition. This measure handles the case of unknown misclassification costs and imbalanced data, and provides confidence indicators of the performance estimation. We evaluated the MPS using real and synthetic data, and compared it against other frequently used performance measures. The results suggest that the proposed MPS allows capturing the performance of a classification with minimum influence from the training and testing conditions. This is demonstrated by its robustness towards imbalanced data and its sensitivity towards class separation in feature space.

FAU-Autorinnen und Autoren / FAU-Herausgeberinnen und Herausgeber

Eskofier, Björn Prof. Dr.
Lehrstuhl für Informatik 14 (Maschinelles Lernen und Datenanalytik)
Kautz, Thomas
Stiftungs-Juniorprofessur für Sportinformatik (Digital Sports)
Pasluosta, Cristian Federico
Stiftungs-Juniorprofessur für Sportinformatik (Digital Sports)


Kautz, T., Eskofier, B., & Pasluosta, C.F. (2017). Generic performance measure for multiclass-classifiers. Pattern Recognition, 68(8), 111 - 125.

Kautz, Thomas, Björn Eskofier, and Cristian Federico Pasluosta. "Generic performance measure for multiclass-classifiers." Pattern Recognition 68.8 (2017): 111 - 125.


Zuletzt aktualisiert 2018-17-10 um 12:20