Perspective-aware warping for seamless stereoscopic image cloning

Luo, Shengjie; Shen, I‐Chao; Chen, Bing‐Yu; Cheng, Wen-Huang; Chuang, Yung-Yu

doi:10.1145/2366145.2366201

Cited by 32 publications

(23 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Koppal et al [7] proposed a technique that enables the manipulation of stereo parameters such as the interocular distance and location. The problem of stereoscopic copy and paste has been addressed by using a segmentation-based technique [8] and a gradient-domain technique [9]. Wang and Sawchuck [10] proposed a framework for disparity manipulation of stereoscopic media.…”

Section: Related Workmentioning

confidence: 99%

Geometrically Consistent Stereoscopic Image Editing Using Patch-Based Synthesis

Luo

Sun

Shen

et al. 2015

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

This paper presents a patch-based synthesis framework for stereoscopic image editing. The core of the proposed method builds upon a patch-based optimization framework with two key contributions: First, we introduce a depth-dependent patch-pair similarity measure for distinguishing and better utilizing image contents with different depth structures. Second, a joint patch-pair search is proposed for properly handling the correlation between two views. The proposed method successfully overcomes two main challenges of editing stereoscopic 3D media: (1) maintaining the depth interpretation, and (2) providing controllability of the scene depth. The method offers patch-based solutions to a wide variety of stereoscopic image editing problems, including depth-guided texture synthesis, stereoscopic NPR, paint by depth, content adaptation, and 2D to 3D conversion. Several challenging cases are demonstrated to show the effectiveness of the proposed method. The results of user studies also show that the proposed method produces stereoscopic images with good stereoscopics and visual quality.

show abstract

Section: Related Workmentioning

confidence: 99%

Geometrically Consistent Stereoscopic Image Editing Using Patch-Based Synthesis

Luo

Sun

Shen

et al. 2015

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

show abstract

“…Resizing systems based on the warping method are proposed in Refs. [14][15][16], while Refs. [17,18] edit stereoscopic pairs by using a warping method.…”

Section: Related Workmentioning

confidence: 99%

A retargeting method for stereoscopic 3D video

Liu

Sun

2015

Comp. Visual Media

View full text Add to dashboard Cite

We propose a disparity-constrained retargeting method for stereoscopic 3D video, which simultaneously resizes a binocular video to a new aspect ratio and remaps the depth to the perceptual comfort zone. First, we model distortion energies to prevent important video contents from deforming. Then, to maintain depth mapping stability, we model disparity variation energies to constraint the disparity range both in spatial and temporal domains. The last component of our method is a non-uniform, pixel-wise warp to the target resolution based on these energy models. Using this method, we can process the original stereoscopic video to generate new, high-perceptual-quality versions at different display resolutions. For evaluation, we conduct a user study; we also discuss the performance of our method.

show abstract

“…They provide a set of basic disparity mapping operators and a warping function to achieve desirable disparity distributions. Luo et al [17] and Liu et al [18] further apply the mesh-warping technique to seamless stereoscopic image cloning and authoring, respectively. Although the abovementioned retargeting methods can yield good results, the lack of consideration of the consistency of object deformation or the continuity of mesh warping may result in apparent distortions in the disparities and shapes of visually salient objects.…”

Section: Related Workmentioning

confidence: 99%

Object-Coherence Warping for Stereoscopic Image Retargeting

Lin

Chang

et al. 2014

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

Abstract-This paper addresses the topic of content-aware stereoscopic image retargeting. The key to this topic is consistently adapting a stereoscopic image to fit displays with various aspect ratios and sizes while preserving visually salient content. Most methods focus on preserving the disparities and shapes of visually salient objects through nonlinear image warping, in which distortions caused by warping are propagated to homogenous and low-significance regions. However, disregarding the consistency of object deformation sometimes results in apparent distortions in both the disparities and shapes of objects. An object-coherence warping scheme is proposed to reduce this unwanted distortion. The basic idea is to utilize the information of matched objects rather than that of matched pixels in warping. Such information implies object correspondences in a stereoscopic image pair, which allows the generation of an object significance map and the consistent preservation of objects. This strategy enables our method to consistently preserve both the disparities and shapes of visually salient objects, leading to good content-aware retargeting. In the experiments, qualitative and quantitative analyses of various stereoscopic images show that our results are better than those generated by related methods in terms of consistency of object preservation.

show abstract

Perspective-aware warping for seamless stereoscopic image cloning

Cited by 32 publications

References 26 publications

Geometrically Consistent Stereoscopic Image Editing Using Patch-Based Synthesis

Geometrically Consistent Stereoscopic Image Editing Using Patch-Based Synthesis

A retargeting method for stereoscopic 3D video

Object-Coherence Warping for Stereoscopic Image Retargeting

Contact Info

Product

Resources

About