Intra Prediction of Depth Picture with Plane Modeling

Abstract

In this paper, an intra prediction method is proposed for coding of depth pictures using plane modelling. Each pixel in the depth picture is related to the distance from a camera to an object surface, and pixels corresponding to a flat surface of an object form a relationship with the 2D plane surface. The plane surface can be represented by a simple equation in the 3D camera coordinate system in such a way that the coordinate system of depth pixels can be transformed to the camera coordinate system. This paper finds the parameters which define the plane surface closest to given depth pixels. The plane model is then used to predict the depth pixels on the plane surface. A depth prediction method is also devised for efficient intra prediction of depth pictures, using variable-size blocks. For prediction with variable-size blocks, the plane surface that occupies a large part of the picture can be predicted using a large block size. The simulation results of the proposed method show that the mean squared error is reduced by up to 96.6% for a block size of 4 × 4 pixels and reduced by up to 98% for a block size of 16 × 16, compared with the intra prediction modes of H.264/AVC and H.265/HEVC.

Efficient Depth Data Coding Method Based on Plane Modeling for Intra Prediction

“…Wang et al [14][15] proposed a prediction method for depth data by calculating the camera movement from the neighboring frame. Our previous study [16] predicts the depth pixels through a plane modeling that is an intra-picture prediction method by a plane estimation. The plane is estimated through depth pixel values in the block.…”

“…A depth picture is defined as a frame at the certain time of depth data. A depth pixel value is defined as the z-axis coordinate of the point on 3D space [16]. Therefore, the 3D coordinates of the depth pixel can be calculated through pinhole camera model [20].…”

“…The local area of the surface presented by depth data can be approximated as a plane surface. Our previous study [16] proposes a plane modeling method which estimates the approximation plane in blocks for depth data. However, the previous method needs to code the additional coefficients for decoding the estimated plane.…”

Zoom motion estimation for color and depth videos using depth information

“…A method of motion estimation for depth video is also proposed in this paper. In depth video coding, studies for intra-prediction have been conducted [39][40][41][42][43], but studies for interprediction are insufficient. When an object in depth video has zoom motion, not only the size but also depth values of the object are scaled to a zoom rate.…”

Ellipsoid Modeling Method for Coding of Face Depth Picture

“…The depth picture can be regarded as representation of surfaces. Therefore, the depth picture can be predicted by plane modeling [14] or spherical surface [15]. In order to predict a face depth picture, the ellipsoid modeling is proposed because the shape of the face is close to an ellipsoid.…”