Objective Measures of Perceptual Audio Quality Reviewed: An Evaluation of Their Application Domain Dependence

Torcoli M, Kastner T, Herre J (2021)

Publication Type: Journal article

Publication year: 2021

Journal

IEEE/ACM Transactions on Audio, Speech and Language Processing Institute of Electrical and Electronics Engineers (IEEE)

Book Volume: 28

Pages Range: 1530-1541

Article Number: 9388867

DOI: 10.1109/TASLP.2021.3069302

Abstract

Over the past few decades, computational methods have been developed to estimate perceptual audio quality. These methods, also referred to as objective quality measures, are usually developed and intended for a specific application domain. Because of their convenience, they are often used outside their original intended domain, even if it is unclear whether they provide reliable quality estimates in this case. This work studies the correlation of well-known state-of-the-art objective measures with human perceptual scores in two different domains: audio coding and source separation. The following objective measures are considered: fwSNRseg, dLLR, PESQ, PEAQ, POLQA, PEMO-Q, ViSQOLAudio, (SI-)BSSEval, PEASS, LKR-PI, 2f-model, and HAAQI. Additionally, a novel measure (SI-SA2f) is presented, based on the 2f-model and a BSSEval-based signal decomposition. We use perceptual scores from 7 listening tests about audio coding and 7 listening tests about source separation as ground-truth data for the correlation analysis. The results show that one method (2f-model) performs significantly better than the others on both domains and indicate that the dataset for training the method and a robust underlying auditory model are crucial factors towards a universal, domain-independent objective measure.

Authors with CRIS profile

Thorsten Kastner Lehrstuhl für Audiocodierung (AudioLabs) (Stiftungslehrstuhl) Jürgen Herre Lehrstuhl für Audiocodierung (AudioLabs) (Stiftungslehrstuhl)

Involved external institutions

Fraunhofer-Institut für Integrierte Systeme und Bauelementetechnologie (IISB) DE Germany (DE)

How to cite

APA:

Torcoli, M., Kastner, T., & Herre, J. (2021). Objective Measures of Perceptual Audio Quality Reviewed: An Evaluation of Their Application Domain Dependence. IEEE/ACM Transactions on Audio, Speech and Language Processing, 28, 1530-1541. https://doi.org/10.1109/TASLP.2021.3069302

MLA:

Torcoli, Matteo, Thorsten Kastner, and Jürgen Herre. "Objective Measures of Perceptual Audio Quality Reviewed: An Evaluation of Their Application Domain Dependence." IEEE/ACM Transactions on Audio, Speech and Language Processing 28 (2021): 1530-1541.

BibTeX: Download