Universal Modeling of Monoscopic and Multiview Video Codecs with Applications to Encoder Control

Domański, Marek; Al-Obaidi, Yasir; Grajek, Tomasz

doi:10.1109/icip42928.2021.9506735

Cited by 4 publications

(1 citation statement)

References 28 publications

(24 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is well understood that independent compression of multiple views and depths [77] results in high bitrates. Moreover, a new critical constraint in immersive video services is the so-called pixel rate: it reflects the number of pixels to be decoded per second in order to initiate the rendering of a given virtual view.…”

Section: Introductionmentioning

confidence: 99%

Overview and Efficiency of Decoder-Side Depth Estimation in MPEG Immersive Video

Mieloch¹,

Garus

Milovanović

et al. 2022

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

This paper presents the overview and rationale behind the Decoder-Side Depth Estimation (DSDE) mode of the MPEG Immersive Video (MIV) standard, using the Geometry Absent profile, for efficient compression of immersive multiview video. A MIV bitstream generated by an encoder operating in the DSDE mode does not include depth maps. It only contains the information required to reconstruct them in the client or in the cloud: decoded views and metadata. The paper explains the technical details and techniques supported by this novel MIV DSDE mode. The description additionally includes the specification on Geometry Assistance Supplemental Enhancement Information which helps to reduce the complexity of depth estimation, when performed in the cloud or at the decoder side. The depth estimation in MIV is a non-normative part of the decoding process, therefore, any method can be used to compute the depth maps. This paper lists a set of requirements for depth estimation, induced by the specific characteristics of the DSDE. The depth estimation reference software, continuously and collaboratively developed with MIV to meet these requirements, is presented in this paper. Several original experimental results are presented. The efficiency of the DSDE is compared to two MIV profiles. The combined non-transmission of depth maps and efficient coding of textures enabled by the DSDE leads to efficient compression and rendering quality improvement compared to the usual encoder-side depth estimation. Moreover, results of the first evaluation of state-of-the-art multiview depth estimators in the DSDE context, including machine learning techniques, are presented.

show abstract

Section: Introductionmentioning

confidence: 99%