Home Publications Research Grants Inventions & Patents Awards Additional Research Activities Faculties & Institutions Research Areas

MLcps: machine learning cumulative performance score for classification problems

Akshay A, Abedi M, Shekarchizadeh N, Burkhard FC, Katoch M, Bigger-Allen A, Adam RM, Monastyrskaya K, Gheinani AH (2023)

---

Publication Language: English

Publication Type: Journal article

Publication year: 2023

Journal

Book Volume: 12

Article Number: giad108

DOI: 10.1093/gigascience/giad108

Abstract

Background: Assessing the performance of machine learning (ML) models requires careful consideration of the evaluation metrics used. It is often necessary to utilize multiple metrics to gain a comprehensive understanding of a trained model’s performance, as each metric focuses on a specific aspect. However, comparing the scores of these individual metrics for each model to determine the best-performing model can be time-consuming and susceptible to subjective user preferences, potentially introducing bias. Results: We propose the Machine Learning Cumulative Performance Score (MLcps), a novel evaluation metric for classification problems. MLcps integrates several precomputed evaluation metrics into a unified score, enabling a comprehensive assessment of the trained model’s strengths and weaknesses. We tested MLcps on 4 publicly available datasets, and the results demonstrate that MLcps provides a holistic evaluation of the model’s robustness, ensuring a thorough understanding of its overall performance. Conclusions: By utilizing MLcps, researchers and practitioners no longer need to individually examine and compare multiple metrics to identify the best-performing models. Instead, they can rely on a single MLcps value to assess the overall performance of their ML models. This streamlined evaluation process saves valuable time and effort, enhancing the efficiency of model evaluation. MLcps is available as a Python package at https://pypi.org/project/MLcps/.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Akshay, A., Abedi, M., Shekarchizadeh, N., Burkhard, F.C., Katoch, M., Bigger-Allen, A.,... Gheinani, A.H. (2023). MLcps: machine learning cumulative performance score for classification problems. GigaScience, 12. https://dx.doi.org/10.1093/gigascience/giad108

MLA:

Akshay, Akshay, et al. "MLcps: machine learning cumulative performance score for classification problems." GigaScience 12 (2023).

BibTeX: Download