Classification of emotions and evaluation of customer satisfaction from speech in real world acoustic environments

Parra-Gallego LF, Orozco-Arroyave JR (2022)


Publication Type: Journal article

Publication year: 2022

Journal

Book Volume: 120

Article Number: 103286

DOI: 10.1016/j.dsp.2021.103286

Abstract

This paper focuses on finding suitable features to robustly recognize emotions and evaluate customer satisfaction (CS) from speech in real acoustic scenarios. The classification of emotions is based on standard and well-known corpora and the evaluation of CS is based on recordings of real opinions given by customers about the received service during phone calls with call-center agents. The feature sets considered in this study include two speaker models, namely x-vectors and i-vectors, and also the well known feature set introduced in the Interspeech 2010 Paralinguistics Challenge (I2010PC). Additionally, we introduce the use of phonation, articulation and prosody features extracted with the DisVoice framework as alternative feature sets to robustly model emotions and CS from speech. The results indicate that the I2010PC feature set is the best approach to classify emotions in the standard databases typically used in the literature. When considering the recordings collected in the call-center, without any control over the acoustic conditions, the best results are those that include our articulation features. The I2010PC feature set includes 1584 measures while the articulation approach only includes 488 measures. We think that the proposed approach is more suitable for real-world applications where the acoustic conditions are not controlled and also it is potentially more convenient for industrial applications.

Involved external institutions

How to cite

APA:

Parra-Gallego, L.F., & Orozco-Arroyave, J.R. (2022). Classification of emotions and evaluation of customer satisfaction from speech in real world acoustic environments. Digital Signal Processing, 120. https://doi.org/10.1016/j.dsp.2021.103286

MLA:

Parra-Gallego, Luis Felipe, and Juan Rafael Orozco-Arroyave. "Classification of emotions and evaluation of customer satisfaction from speech in real world acoustic environments." Digital Signal Processing 120 (2022).

BibTeX: Download