Influence of Utterance and Speaker Characteristics on the Classification of Children with Cleft Lip and Palate

Baumann I, Wagner D, Braun F, Bayerl SP, Nöth E, Riedhammer K, Bocklet T (2023)


Publication Type: Conference contribution

Publication year: 2023

Publisher: International Speech Communication Association

Book Volume: 2023-August

Pages Range: 4648-4652

Conference Proceedings Title: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Event location: Dublin, IRL

DOI: 10.21437/Interspeech.2023-1873

Abstract

Recent findings show that pre-trained wav2vec 2.0 models are reliable feature extractors for various speaker characteristics classification tasks. We show that latent representations extracted at different layers of a pre-trained wav2vec 2.0 system can be used as features for binary classification to distinguish between children with Cleft Lip and Palate (CLP) and a healthy control group. The results indicate that the distinction between CLP and healthy voices, especially with latent representations from the lower and middle encoder layers, reaches an accuracy of 100%. We test the classifier to find influencing factors for classification using unseen out-of-domain healthy and pathologic corpora with varying characteristics: age, spoken content, and acoustic conditions. Cross-pathology and cross-healthy tests reveal that the trained classifiers are unreliable if there is a mismatch between training and out-of-domain test data in, e.g., age, spoken content, or acoustic conditions.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Baumann, I., Wagner, D., Braun, F., Bayerl, S.P., Nöth, E., Riedhammer, K., & Bocklet, T. (2023). Influence of Utterance and Speaker Characteristics on the Classification of Children with Cleft Lip and Palate. In Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH (pp. 4648-4652). Dublin, IRL: International Speech Communication Association.

MLA:

Baumann, Ilja, et al. "Influence of Utterance and Speaker Characteristics on the Classification of Children with Cleft Lip and Palate." Proceedings of the 24th International Speech Communication Association, Interspeech 2023, Dublin, IRL International Speech Communication Association, 2023. 4648-4652.

BibTeX: Download