Medium-term speaker states - A review on intoxication, sleepiness and the first challenge

Journal article
(Original article)

Publication Details

Author(s): Schuller B, Steidl S, Batliner A, Schiel F, Krajewski J, Weninger F, Eyben F
Journal: Computer Speech and Language
Publisher: Elsevier
Publication year: 2014
Volume: 28
Journal issue: 2
Pages range: 346-374
ISSN: 0885-2308
Language: English


In the emerging field of computational paralinguistics, most research efforts are devoted to either short-term speaker states such as emotions, or long-term traits such as personality, gender, or age. To bridge this gap on the time axis, and hence broaden the scope of the field, the INTERSPEECH 2011 Speaker State Challenge addressed the algorithmic analysis of medium-term speaker states: alcohol intoxication and sleepiness, both of which are highly relevant in high risk environments. Preserving the paradigms of the two previous INTERSPEECH Challenges, researchers were invited to participate in a large-scale evaluation providing unified testing conditions. This article reviews previous efforts to automatically recognise intoxication and sleepiness from speech signals, and gives an overview on the Challenge conditions and data sets, the methods used by the participants, and their results. By fusing participants’ systems, we show that binary classification of alcoholisation and sleepiness from short-term observations, i.e., single utterances, can both reach over 72% accuracy on unseen test data; furthermore, we demonstrate that these medium-term states can be recognised more robustly by fusing short-term classifiers along the time axis, reaching up to 91% accuracy for intoxication and 75% for sleepiness.

FAU Authors / FAU Editors

Steidl, Stefan PD Dr.-Ing.
Lehrstuhl für Informatik 5 (Mustererkennung)

How to cite

Schuller, B., Steidl, S., Batliner, A., Schiel, F., Krajewski, J., Weninger, F., & Eyben, F. (2014). Medium-term speaker states - A review on intoxication, sleepiness and the first challenge. Computer Speech and Language, 28(2), 346-374.

Schuller, Björn, et al. "Medium-term speaker states - A review on intoxication, sleepiness and the first challenge." Computer Speech and Language 28.2 (2014): 346-374.


Last updated on 2018-19-04 at 02:30