Medium-term speaker states - A review on intoxication, sleepiness and the first challenge

Schuller B, Steidl S, Batliner A, Schiel F, Krajewski J, Weninger F, Eyben F (2014)

Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2014


Original Authors: Schuller Björn, Steidl Stefan, Batliner Anton, Schiel Florian, Krajewski Jarek, Weninger Felix, Eyben Florian

Publisher: Elsevier

Book Volume: 28

Pages Range: 346-374

Journal Issue: 2

DOI: 10.1016/j.csl.2012.12.002


In the emerging field of computational paralinguistics, most research efforts are devoted to either short-term speaker states such as emotions, or long-term traits such as personality, gender, or age. To bridge this gap on the time axis, and hence broaden the scope of the field, the INTERSPEECH 2011 Speaker State Challenge addressed the algorithmic analysis of medium-term speaker states: alcohol intoxication and sleepiness, both of which are highly relevant in high risk environments. Preserving the paradigms of the two previous INTERSPEECH Challenges, researchers were invited to participate in a large-scale evaluation providing unified testing conditions. This article reviews previous efforts to automatically recognise intoxication and sleepiness from speech signals, and gives an overview on the Challenge conditions and data sets, the methods used by the participants, and their results. By fusing participants’ systems, we show that binary classification of alcoholisation and sleepiness from short-term observations, i.e., single utterances, can both reach over 72% accuracy on unseen test data; furthermore, we demonstrate that these medium-term states can be recognised more robustly by fusing short-term classifiers along the time axis, reaching up to 91% accuracy for intoxication and 75% for sleepiness.

Authors with CRIS profile

Involved external institutions

How to cite


Schuller, B., Steidl, S., Batliner, A., Schiel, F., Krajewski, J., Weninger, F., & Eyben, F. (2014). Medium-term speaker states - A review on intoxication, sleepiness and the first challenge. Computer Speech and Language, 28(2), 346-374.


Schuller, Björn, et al. "Medium-term speaker states - A review on intoxication, sleepiness and the first challenge." Computer Speech and Language 28.2 (2014): 346-374.

BibTeX: Download