Live accurate and dense reconstruction from a handheld camera

Chen, Yadang; Hao, Chuanyan; Cai, Zhongmou; Wu, Wen; Wu, Enhua

doi:10.1002/cav.1508

Cited by 6 publications

(12 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Results show that our method could generate pleasant segmentation results (Figure 6). In the future, we are going to utilize the illumination decomposition technique 18 for better segmentation performance and study transparent object reconstruction based on three‐dimensional reconstruction methods like 19‐25 …”

Section: Resultsmentioning

confidence: 99%

Transparent object segmentation from casually captured videos

Liao

Yan

et al. 2020

Computer Animation & Virtual

View full text Add to dashboard Cite

Segmentation of transparent objects from sequences can be very useful in computer vision applications. However, without additional auxiliary information it can be hard work for traditional segmentation methods, as light in the transparent area captured by RGB cameras mostly derive from the background and the appearance of transparent objects changes with surroundings. In this article, we present a from-coarse-to-fine transparent object segmentation method, which utilizes trajectory clustering to roughly distinguish the transparent from the background and refine the segmentation based on combination information of color and distortion. We further incorporate the transparency saliency with color and trajectory smoothness throughout the video to acquire a spatiotemporal segmentation based on graph-cut. We conduct our method on various datasets. The results demonstrate that our method can successfully segment transparent objects from the background.

show abstract

Section: Resultsmentioning

confidence: 99%

Transparent object segmentation from casually captured videos

Liao

Yan

et al. 2020

Computer Animation & Virtual

View full text Add to dashboard Cite

show abstract

“…Lowe 18 proposed the scale‐invariant feature transform (SIFT) descriptor which is invariant to image scaling, translation, and rotation, and partially invariant to illumination changes and affine transformation or 3D projection. Based on Lowe's work, lots of 3D reconstruction (mainly structure from motion) algorithms are introduced 19‐25 . As feature points corresponding to SIFT descriptor are usually sparsely distributed in images and they essentially do not have the capacity to propagate correspondences to neighboring pixels, SIFT descriptor is mainly limited as a matching tool in sparse 3D reconstruction despite the fact that it has performed pretty well in correspondence especially in terms of accuracy.…”

Section: Related Workmentioning

confidence: 99%

Folding patch correspondence for multiview stereo

Liao

Yan

et al. 2020

Computer Animation & Virtual

View full text Add to dashboard Cite

In this article, we propose the novel folding patch model which can replace the traditional patch model utilized in patch-based multiview stereo (MVS) methods to significantly improve the reconstruction results. The patch model is applied as an approximation of the scene surface differential in the geometric estimation procedure. By minimizing the photometric discrepancy of the projection of the patch model on multiple source images, patch-based MVS algorithms optimize the position and normal values for the 3D hypothesis of the target pixel. The optimization is based on the assumption that the patch model can fit the target scene surface perfectly. However, when it comes to complex scenes crowded with sharp edges, splintery surfaces, or round surfaces, the patch model is inherently not suitable since even from the microscopic perspective these surfaces are not entirely flat. We construct the folding patch model by folding the traditional patch model from the middle line. By adjusting the folding angle and direction, the folding patch model can fit complex surfaces more flexibly. We apply our folding patch model to the representative open-source patch based multiview stereo (PMVS) and COLMAP, and validate the effectiveness on ETH3D benchmark and data sets captured in nature. The results demonstrate that utilizing the folding patch model can significantly improve the behavior of PMVS and COLMAP, especially on data sets mainly consist of complex surfaces from plants.

show abstract

“…Recently, one of the typical tasks is the 3D reconstruction technology based on camera calibration. This technique has achieved good results, but generally requires the input of multiple images to reconstruct the real three-dimensional information [1][2]. This is a complex, tedious and resource-consuming process, not suitable for the perspective scenario just in a single image.…”

Section: Introductionmentioning

confidence: 99%

An Interactive Perspective Scene Completion Framework Guided by Complanate Mesh

2020

KSII TIIS

View full text Add to dashboard Cite

This paper presents an efficient interactive framework for perspective scene completion and editing tasks, which are available largely in the real world but rarely studied in the field of image completion. Considering that it is quite hard to extract perspective information from a single image, this work starts from a friendly and portable interactive platform to obtain the basic perspective data. Then, in order to make this interface less sensitive, easier and more flexible, a perspective-rectification based correction mechanism is proposed to iteratively update the locations of the initial points selected by users. At last, a complanate mesh is generated by the geometry calculations from these corrected initial positions. This mesh must approximate the perspective direction and the structure topology as much as possible so that the filling process can be conducted under the constraint of the perspective effects of the original image. Our experiments show the results with good qualities and performances, and also demonstrate the validity of our approaches by various perspective scenes and images.

show abstract

Live accurate and dense reconstruction from a handheld camera

Cited by 6 publications

References 20 publications

Transparent object segmentation from casually captured videos

Transparent object segmentation from casually captured videos

Folding patch correspondence for multiview stereo

An Interactive Perspective Scene Completion Framework Guided by Complanate Mesh

Contact Info

Product

Resources

About