CONTROLLING THE REMIXING OF SEPARATED DIALOGUE WITH A NON-INTRUSIVE QUALITY ESTIMATE
Torcoli M, Paulus J, Kastner T, Uhle C (2021)
Publication Type: Conference contribution
Publication year: 2021
Publisher: IEEE
City/Town: NEW YORK
Pages Range: 91-95
Conference Proceedings Title: 2021 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA)
Event location: New Paltz, NY
DOI: 10.1109/WASPAA52581.2021.9632756
Abstract
Remixing separated audio sources trades off interferer attenuation against the amount of audible deteriorations. This paper proposes a non-intrusive audio quality estimation method for controlling this trade-off in a signal-adaptive manner. The recently proposed 2f-model is adopted as the underlying quality measure, since it has been shown to correlate strongly with basic audio quality in source separation. An alternative operation mode of the measure is proposed, more appropriate when considering material with long inactive periods of the target source. The 2f-model requires the reference target source as an input, but this is not available in many applications. Deep neural networks (DNNs) are trained to estimate the 2f-model intrusively using the reference target (iDNN2f), non-intrusively using the input mix as reference (nDNN2f), and reference-free using only the separated output signal (rDNN2f). It is shown that iDNN2f achieves very strong correlation with the original measure on the test data (Pearson ρ=0.99 ), while performance decreases for nDNN2f (ρ ≥ 0.91) and rDNN2f (ρ ≥ 0.82). The non-intrusive estimate nDNN2f is mapped to select item-dependent remixing gains with the aim of maximizing the interferer attenuation under a constraint on the minimum quality of the remixed output (e.g., audible but not annoying deteriorations). A listening test shows that this is successfully achieved even with very different selected gains (up to 23 dB difference).
Authors with CRIS profile
Involved external institutions
Germany (DE)How to cite
APA:
Torcoli, M., Paulus, J., Kastner, T., & Uhle, C. (2021). CONTROLLING THE REMIXING OF SEPARATED DIALOGUE WITH A NON-INTRUSIVE QUALITY ESTIMATE. In 2021 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA) (pp. 91-95). New Paltz, NY: NEW YORK: IEEE.
MLA:
Torcoli, Matteo, et al. "CONTROLLING THE REMIXING OF SEPARATED DIALOGUE WITH A NON-INTRUSIVE QUALITY ESTIMATE." Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY NEW YORK: IEEE, 2021. 91-95.
BibTeX: Download