DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filtering

Schröter H, Escalante-B AN, Rosenkranz T, Maier A (2022)

Publication Type: Conference contribution, Original article

Publication year: 2022

Conference Proceedings Title: ICASSP 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Event location: Singapore

URI: https://github.com/Rikorose/DeepFilterNet

DOI: 10.1109/icassp43922.2022.9747055

Open Access Link: https://arxiv.org/abs/2110.05588

Abstract

Complex-valued processing has brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram, while complex masks (CM) are usually preferred over real-valued masks due to their ability to modify the phase. Recent work proposed to use a complex filter instead of a point-wise multiplication with a mask. This allows to incorporate information from previous and future time steps exploiting local correlations within each frequency band. In this work, we propose DeepFilterNet, a two stage speech enhancement framework utilizing deep filtering. First, we enhance the spectral envelope using ERB-scaled gains modeling the human frequency perception. The second stage employs deep filtering to enhance the periodic components of speech. Additionally to taking advantage of perceptual properties of speech, we enforce network sparsity via separable convolutions and extensive grouping in linear and recurrent layers to design a low complexity architecture. We further show that our two stage deep filtering approach outperforms complex masks over a variety of frequency resolutions and latencies and demonstrate convincing performance compared to other state-of-the-art models.

Authors with CRIS profile

Hendrik Schröter Lehrstuhl für Informatik 5 (Mustererkennung) Andreas Maier Lehrstuhl für Informatik 5 (Mustererkennung)

Related research project(s)

Deep Learning based Noise Reduction for Hearing Aids Feb. 1, 2019 - Jan. 31, 2023

Involved external institutions

Sivantos GmbH DE Germany (DE) WS Audiology DK Denmark (DK)

How to cite

APA:

Schröter, H., Escalante-B, A.N., Rosenkranz, T., & Maier, A. (2022). DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filtering. In ICASSP 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Singapore.

MLA:

Schröter, Hendrik, et al. "DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filtering." Proceedings of the ICASSP 2022, Singapore 2022.

BibTeX: Download