Bit Distribution Study and Implementation of Spatial Quality Map in the JPEG-AI Standardization
Jia P, Mao J, Koyuncu E, Koyuncu AB, Solovyev T, Karabutov A, Zhao Y, Alshina E, Kaup A (2024)
Publication Type: Conference contribution
Publication year: 2024
Publisher: Institute of Electrical and Electronics Engineers Inc.
Conference Proceedings Title: 2024 IEEE International Conference on Visual Communications and Image Processing, VCIP 2024
Event location: Tokyo
ISBN: 9798331529543
DOI: 10.1109/VCIP63160.2024.10849825
Abstract
Currently, there is a high demand for neural network-based image compression codecs. These codecs employ non-linear transforms to create compact bit representations and facilitate faster coding speeds on devices compared to the handcrafted transforms used in classical frameworks. The scientific and industrial communities are highly interested in these properties, leading to the standardization effort of JPEG-AI. The JPEG-AI verification model has been released and is currently under development for standardization. Utilizing neural networks, it can outperform the classic codec VVC intra by over 10% BD-rate operating at base operation point. Researchers attribute this success to the flexible bit distribution in the spatial domain, in contrast to VVC intra's anchor that is generated with a constant quality point. However, our study reveals that VVC intra displays a more adaptable bit distribution structure through the implementation of various block sizes. As a result of our observations, we have proposed a spatial bit allocation method to optimize the JPEG-AI verification model's bit distribution and enhance the visual quality. Furthermore, by applying the VVC bit distribution strategy, the objective performance of JPEG-AI verification mode can be further improved, resulting in a maximum gain of 0.45 dB in PSNR-Y.
Authors with CRIS profile
Panqi Jia
Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)
Esin Koyuncu
Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)
Andre Kaup
Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)
Involved external institutions
China (CN)How to cite
APA:
Jia, P., Mao, J., Koyuncu, E., Koyuncu, A.B., Solovyev, T., Karabutov, A.,... Kaup, A. (2024). Bit Distribution Study and Implementation of Spatial Quality Map in the JPEG-AI Standardization. In 2024 IEEE International Conference on Visual Communications and Image Processing, VCIP 2024. Tokyo, JP: Institute of Electrical and Electronics Engineers Inc..
MLA:
Jia, Panqi, et al. "Bit Distribution Study and Implementation of Spatial Quality Map in the JPEG-AI Standardization." Proceedings of the 2024 IEEE International Conference on Visual Communications and Image Processing, VCIP 2024, Tokyo Institute of Electrical and Electronics Engineers Inc., 2024.
BibTeX: Download