Analysis of Neural Image Compression Networks for Machine-to-Machine Communication

Fischer K, Forsch C, Herglotz C, Kaup A (2021)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2021

Event location: Anchorage (virtual) US

URI: https://arxiv.org/abs/2205.06511

DOI: 10.1109/ICIP42928.2021.9506763

Open Access Link: https://arxiv.org/abs/2205.06511

Abstract

Video and image coding for machines (VCM) is an emerging field that aims to develop compression methods resulting in optimal bitstreams when the decoded frames are analyzed by a neural network. Several approaches already exist improving classic hybrid codecs for this task. However, neural compression networks (NCNs) have made an enormous progress in coding images over the last years. Thus, it is reasonable to consider such NCNs, when the information sink at the decoder side is a neural network as well. Therefore, we build-up an evaluation framework analyzing the performance of four state-of-the-art NCNs, when a Mask R-CNN is segmenting objects from the decoded image. The compression performance is measured by the weighted average precision for the Cityscapes dataset. Based on that analysis, we find that networks with leaky ReLU as non-linearity and training with SSIM as distortion criteria results in the highest coding gains for the VCM task. Furthermore, it is shown that the GAN-based NCN architecture achieves the best coding performance and even out-performs the recently standardized Versatile Video Coding (VVC) for the given scenario.

Authors with CRIS profile

Kristian Fischer Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Christian Forsch Lehrstuhl für Digitale Übertragung (IDC) Christian Herglotz Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Andre Kaup Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)

How to cite

APA:

Fischer, K., Forsch, C., Herglotz, C., & Kaup, A. (2021). Analysis of Neural Image Compression Networks for Machine-to-Machine Communication. In Proceedings of the IEEE International Conference on Image Processing (ICIP). Anchorage (virtual), US.

MLA:

Fischer, Kristian, et al. "Analysis of Neural Image Compression Networks for Machine-to-Machine Communication." Proceedings of the IEEE International Conference on Image Processing (ICIP), Anchorage (virtual) 2021.

BibTeX: Download