"Of All Things the Measure is Man" - Classification of Emotions and Inter-Labeler Consistency

Steidl S, Levit M, Batliner A, Nöth E, Niemann H (2005)

Publication Type: Conference contribution, Conference Contribution

Publication year: 2005

Original Authors: Steidl Stefan, Levit Michael, Batliner Anton, Nöth Elmar, Niemann Heinrich

Publisher: Conference Managament Services, Inc.

City/Town: 3833 S. Texas Ave., Ste. 221 Bryan, TX 77802-4015

Pages Range: 317-320

Conference Proceedings Title: Proceedings of ICASSP 2005 - International Conference on Acoustics, Speech, and Signal Processing

Event location: Philadelphia, PA US

URI: http://www5.informatik.uni-erlangen.de/Forschung/Publikationen/2005/Steidl05-OAT.pdf

Abstract

In traditional classification problems, the reference needed for training a classifier is given and considered to be absolutely correct. However, this does not apply to all tasks. In emotion recognition in non-acted speech, for instance, one often does not know which emotion was really intended by the speaker. Hence, the data is annotated by a group of human labelers who do not agree on one common class in most cases. Often, similar classes are confused systematically. We propose a new entropy-based method to evaluate classification results taking into account these systematic confusions. We can show that a classifier which achieves a recognition rate of "only" about 60% on a four-class-problem performs as well as our five human labelers on average.

Authors with CRIS profile

Stefan Steidl Lehrstuhl für Informatik 14 (Bild- und Sprachverarbeitung) Anton Batliner Lehrstuhl für Informatik 14 (Bild- und Sprachverarbeitung) Elmar Nöth Professur für Informatik (Mustererkennung) Heinrich Niemann Technische Fakultät

How to cite

APA:

Steidl, S., Levit, M., Batliner, A., Nöth, E., & Niemann, H. (2005). "Of All Things the Measure is Man" - Classification of Emotions and Inter-Labeler Consistency. In IEEE (Eds.), Proceedings of ICASSP 2005 - International Conference on Acoustics, Speech, and Signal Processing (pp. 317-320). Philadelphia, PA, US: 3833 S. Texas Ave., Ste. 221 Bryan, TX 77802-4015: Conference Managament Services, Inc..

MLA:

Steidl, Stefan, et al. ""Of All Things the Measure is Man" - Classification of Emotions and Inter-Labeler Consistency." Proceedings of the ICASSP 2005 - International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, PA Ed. IEEE, 3833 S. Texas Ave., Ste. 221 Bryan, TX 77802-4015: Conference Managament Services, Inc., 2005. 317-320.

BibTeX: Download