Automated Evaluation of Standardized Dementia Screening Tests
Braun F, Förstel M, Oppermann B, Erzigkeit A, Hillemacher T, Lehfeld H, Riedhammer K (2022)
Publication Type: Conference contribution
Publication year: 2022
Publisher: International Speech Communication Association
Book Volume: 2022-September
Pages Range: 2478-2482
Conference Proceedings Title: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Event location: Incheon
DOI: 10.21437/Interspeech.2022-10436
Abstract
For dementia screening and monitoring, standardized tests play a key role in clinical routine since they aim at minimizing subjectivity by measuring performance on a variety of cognitive tasks. In this paper, we report a study consisting of a semi-standardized history taking followed by two standardized neuropsychological tests, namely the SKT and the CERAD-NB. The tests include basic tasks such as naming objects, learning word lists, but also widely used tools such as the MMSE. Most of the tasks are performed verbally and should thus be suitable for automated scoring based on transcripts. For the first batch of 30 patients, we analyze the correlation between expert manual evaluations and automatic evaluations based on manual and automatic transcriptions. For both SKT and CERAD-NB, we observe high to perfect correlations using manual transcripts; for certain tasks with lower correlation, the automatic scoring is stricter than the human reference since it is limited to the audio. Using automatic transcriptions, correlations drop as expected and are related to recognition accuracy; however, we still observe high correlations of up to 0.98 (SKT) and 0.85 (CERAD-NB). We show that using word alternatives helps to mitigate recognition errors and subsequently improves correlation with expert scores.
Authors with CRIS profile
Involved external institutions
Germany (DE)How to cite
APA:
Braun, F., Förstel, M., Oppermann, B., Erzigkeit, A., Hillemacher, T., Lehfeld, H., & Riedhammer, K. (2022). Automated Evaluation of Standardized Dementia Screening Tests. In Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH (pp. 2478-2482). Incheon, KR: International Speech Communication Association.
MLA:
Braun, F., et al. "Automated Evaluation of Standardized Dementia Screening Tests." Proceedings of the 23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022, Incheon International Speech Communication Association, 2022. 2478-2482.
BibTeX: Download