Intra To Inter: Towards Intra Prediction for Learning-Based Video Coders Using Optical Flow

Brand F, Seiler J, Kaup A (2021)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2021

Pages Range: 2119-2123

Conference Proceedings Title: Proc. 2021 IEEE International Conference on Image Processing (ICIP)

Event location: Anchorage, AK, USA US

DOI: 10.1109/ICIP42928.2021.9506274

Abstract

Traditional video coders often rely on a block structure for transmission. Here each block is coded separately and sequentially and for each block the encoder can decide whether to use intra or inter prediction. This way, inter and intra prediction can be mixed within a single frame. This has advantages when new areas are uncovered, which were not present in the reference frame, and can hence not be predicted well. These areas are typically predicted using intra prediction. Currently much research goes into end-to-end-trained video coders which do not operate on a block level and typically use dense motion fields for inter prediction. There it is more difficult to incorporate intra prediction for uncovered regions. In this paper we propose a novel concept which enables us to reinterpret classical angular intra prediction in a way that we can transmit it as part of the dense motion field. We can save an average of 18% rate for the transmission of the motion vectors for the same quality of the prediction image.

Authors with CRIS profile

Fabian Brand Lehrstuhl für Multimediakommunikation und Signalverarbeitung Jürgen Seiler Lehrstuhl für Multimediakommunikation und Signalverarbeitung Andre Kaup Lehrstuhl für Multimediakommunikation und Signalverarbeitung

How to cite

APA:

Brand, F., Seiler, J., & Kaup, A. (2021). Intra To Inter: Towards Intra Prediction for Learning-Based Video Coders Using Optical Flow. In Proc. 2021 IEEE International Conference on Image Processing (ICIP) (pp. 2119-2123). Anchorage, AK, USA, US.

MLA:

Brand, Fabian, Jürgen Seiler, and André Kaup. "Intra To Inter: Towards Intra Prediction for Learning-Based Video Coders Using Optical Flow." Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA 2021. 2119-2123.

BibTeX: Download