Content-based mesh generation algorithm

Abstract

The work presents an altemative method for encoding shape-information of video objects, which is a new requirement in the recent evolution of video codec scheme: compressing and transmitting object-based video streams. The proposed method takes the advantage of the latest development in video encoding ~ motion compensation on the base of mesh presentation of frame -to complete its target. The Content-based mesh is deployed to represent video objects, which are detected by a previous video object detector (in a consistent case of scene, detection can simply be a segmenting phase of video frame) or from the whole frame. This special mesh structure constructs the base for successive motion compensation based on mesh-vertices. With content-based mesh, shape information of objects is represented by polygons, therefore it is lossy. Increasing the number of boundary vertices at the cost of bandwidth can alleviate the problem. Integrating the proposed method into a full VOP codec scheme is our perspective.