Relating EEG Recordings to Speech Using Envelope Tracking and The Speech-FFR

Thornton M, Mandic D, Reichenbach T (2023)

Publication Type: Conference contribution

Publication year: 2023

Journal

2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Publisher: Institute of Electrical and Electronics Engineers Inc.

Book Volume: 2023-June

Conference Proceedings Title: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Event location: Rhodes Island GR

ISBN: 9781728163277

DOI: 10.1109/ICASSP49357.2023.10096082

Abstract

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is challenging due to the low signal-to-noise ratios of EEG signals. We report on an approach developed for the ICASSP 2023 'Auditory EEG Decoding' Signal Processing Grand Challenge. A simple ensembling method is shown to considerably improve upon the baseline decoder performance. Even higher classification rates are achieved by jointly decoding the speech-evoked frequency-following response and responses to the temporal envelope of speech, as well as by fine-tuning the decoders to individual subjects. Our results could have applications in the diagnosis of hearing disorders or in cognitively steered hearing aids.

Authors with CRIS profile

Tobias Reichenbach Professur für Sensorische Neurotechnologie

Involved external institutions

Imperial College London / The Imperial College of Science, Technology and Medicine GB United Kingdom (GB)

How to cite

APA:

Thornton, M., Mandic, D., & Reichenbach, T. (2023). Relating EEG Recordings to Speech Using Envelope Tracking and The Speech-FFR. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. Rhodes Island, GR: Institute of Electrical and Electronics Engineers Inc..

MLA:

Thornton, Mike, Danilo Mandic, and Tobias Reichenbach. "Relating EEG Recordings to Speech Using Envelope Tracking and The Speech-FFR." Proceedings of the 48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023, Rhodes Island Institute of Electrical and Electronics Engineers Inc., 2023.

BibTeX: Download