ADABase: A Multimodal Dataset for Cognitive Load Estimation
Oppelt MP, Foltyn A, Deuschel J, Lang NR, Holzer N, Eskofier B, Yang SH (2023)
Publication Type: Journal article
Publication year: 2023
Journal
Book Volume: 23
Journal Issue: 1
DOI: 10.3390/s23010340
Abstract
Driver monitoring systems play an important role in lower to mid-level autonomous vehicles. Our work focuses on the detection of cognitive load as a component of driver-state estimation to improve traffic safety. By inducing single and dual-task workloads of increasing intensity on 51 subjects, while continuously measuring signals from multiple modalities, based on physiological measurements such as ECG, EDA, EMG, PPG, respiration rate, skin temperature and eye tracker data, as well as behavioral measurements such as action units extracted from facial videos, performance metrics like reaction time and subjective feedback using questionnaires, we create ADABase (Autonomous Driving Cognitive Load Assessment Database) As a reference method to induce cognitive load onto subjects, we use the well-established n-back test, in addition to our novel simulator-based k-drive test, motivated by real-world semi-autonomously vehicles. We extract expert features of all measurements and find significant changes in multiple modalities. Ultimately we train and evaluate machine learning algorithms using single and multimodal inputs to distinguish cognitive load levels. We carefully evaluate model behavior and study feature importance. In summary, we introduce a novel cognitive load test, create a cognitive load database, validate changes using statistical tests, introduce novel classification and regression tasks for machine learning and train and evaluate machine learning models.
Authors with CRIS profile
Maximilian Oppelt
Björn Eskofier Machine Learning and Data Analytics Lab Seung Hee Yang Professur für Artificial Intelligence in Biomedical Speech Processing (Stiftungsprofessur)
Björn Eskofier Machine Learning and Data Analytics Lab Seung Hee Yang Professur für Artificial Intelligence in Biomedical Speech Processing (Stiftungsprofessur)
Involved external institutions
Germany (DE)How to cite
APA:
Oppelt, M.P., Foltyn, A., Deuschel, J., Lang, N.R., Holzer, N., Eskofier, B., & Yang, S.H. (2023). ADABase: A Multimodal Dataset for Cognitive Load Estimation. Sensors, 23(1). https://doi.org/10.3390/s23010340
MLA:
Oppelt, Maximilian P., et al. "ADABase: A Multimodal Dataset for Cognitive Load Estimation." Sensors 23.1 (2023).
BibTeX: Download