Acoustic Self-awareness of Autonomous Systems in a World of Sounds

Schmidt A, Löllmann H, Kellermann W (2020)

Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2020


Book Volume: 7

Pages Range: 1127-1149

Journal Issue: 108

DOI: 10.1109/JPROC.2020.2977372

Open Access Link:


Autonomous systems (ASs) operating in real-world environments are exposed to a plurality and diversity of sounds that carry a wealth of information for perception in cognitive dynamic systems. While the importance of the acoustic modality for humans as ``autonomous systems'' is obvious, it is investigated to what extent current technical ASs operating in scenarios filled with airborne sound exploit their potential for supporting self-awareness. As a first step, the state of the art of relevant generic techniques for acoustic scene analysis is reviewed, i.e., source localization and the various facets of signal enhancement, including spatial filtering, source separation, noise suppression, dereverberation and echo cancellation. Then, a comprehensive overview of current techniques for ego-noise suppression, as a specific additional challenge for ASs, is presented. Generic methods for robust source localization and signal extraction but also specific models and estimation methods for ego-noise based on various learning techniques are discussed. Finally, active sensing is considered with its unique potential for acoustic scene analysis and, thus, for supporting self-awareness of ASs. Thereby, recent techniques for binaural listening exploiting head motion, for active localization and exploration and for active signal enhancement are presented, with humanoid robots as typical platforms. Underlining the multimodal nature of self-awareness, links to other modalities and nonacoustic reference information are pointed out where appropriate.

Authors with CRIS profile

How to cite


Schmidt, A., Löllmann, H., & Kellermann, W. (2020). Acoustic Self-awareness of Autonomous Systems in a World of Sounds. Proceedings of the IEEE, 7(108), 1127-1149.


Schmidt, Alexander, Heinrich Löllmann, and Walter Kellermann. "Acoustic Self-awareness of Autonomous Systems in a World of Sounds." Proceedings of the IEEE 7.108 (2020): 1127-1149.

BibTeX: Download