3D tree skeletonization from multiple images based on PyrLK optical flow

Zhang, Dejia; Xie, Ning; Liang, Shuang; Jia, Jinyuan

doi:10.1016/j.patrec.2015.11.007

Cited by 18 publications

(13 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This was developed into a table interface where users can generated three-dimensional trees in interactive structure as if drawing [26][27][28]. Other than this, similar three-dimensional trees were automatically reconstructed by using computer vision technique when digital trees photo images are put in or three-dimensional tree model animation was expressed through digital tree video that reflect movements [9,29]. However, although this can more easily and intuitively generate a one-tree model than before, generating multiple diverse models that compose a virtual landscape one by one is practically impossible.…”

Section: Procedural Modeling Of Treesmentioning

confidence: 99%

See 1 more Smart Citation

Modeling and Optimization of a Tree Based on Virtual Reality for Immersive Virtual Landscape Generation

Kim

2016

Symmetry

View full text Add to dashboard Cite

This study proposes a modeling method that can effectively generate multiple diverse digital trees for creating immersive virtual landscape based on virtual reality and an optimization method for real-time rendering. The proposed method simplifies a process of procedures from growth of tree models to the generation of the three-dimensional branch geometric model. Here, the procedural branch graph (PBG) algorithm is proposed, which simultaneously and effectively generates diverse trees that have a similar branch pattern. Moreover, the optimization method is designed in a polygon-based branch model which controls the resolution of tree models according to the distance from the camera to generate a tree model structure that is appropriate for an immersive system based on virtual reality. Finally, a virtual reality system is established based on the Oculus SDK (Software Development Kit) and Unity3D engine. In this process, the image processing-based pixel to tree (PTT) method is proposed as a technique for easily and efficiently generating a virtual landscape by allocating multiple trees on terrain. An immersive virtual landscape that has a stereoscopic perception and spatial impression is created through the proposed method and whether it can deliver experience of nature in virtual reality to the users was checked through an experiment.

show abstract

Section: Procedural Modeling Of Treesmentioning

confidence: 99%

“…After converging with geometric modeling and computer graphic theory, it has been applied as a method for generating realistic trees [6]. Afterwards, the generation of realistic digital trees was studied through application with diverse technologies and research fields, including botanical approach and computer vision [7][8][9].…”

Section: Introductionmentioning

confidence: 99%

Modeling and Optimization of a Tree Based on Virtual Reality for Immersive Virtual Landscape Generation

Kim

2016

Symmetry

View full text Add to dashboard Cite

show abstract

“…Bucksch et al [16] proposed a solution of these type of problems by subdividing the point cloud into octree cells and used some local heuristics to form a skeleton graph from the cells. Zhang et al [17] later applied this technique locally to individual branches. However, these methods rely on several heuristic assumptions and require many parameters to be tuned to obtain the desired result.…”

Section: Introductionmentioning

confidence: 99%

Skeletonization of Plant Point Cloud Data in Stochastic Optimization Framework

Chaudhury¹,

Godin²

2020

Preprint

View full text Add to dashboard Cite

Skeleton extraction from 3D plant point cloud data is an essential prior for myriads of phenotyping studies. Although skeleton extraction from 3D shapes have been studied extensively in the computer vision and graphics literature, handling the case of plants is still an open problem. Drawbacks of the existing approaches include the zigzag structure of the skeleton, nonuniform density of skeleton points, lack of points in the areas having complex geometry structure, and most importantly the lack of biological relevance. With the aim to "correct" an existing coarse skeleton structure, we propose a stochastic framework which is supported by the biological structure of the original plant. Initially we estimate the branching structure of the plant by the notion of β-splines to form a curve tree defined as a finite set of curves joined in a tree topology with certain level of smoothness. In the next phase, we force the discrete points in the curve tree to move towards the original point cloud by treating each point in the cloud as a center of Gaussian, and points in the curve tree as observations from the Gaussians. The task is to find the correct Gaussian centroid for each point. The optimization technique is iterative and is based on the Expectation Maximization (EM) algorithm. The E-step estimates which Gaussian the observed point cloud was sampled from, and the M-step maximizes the negative log-likelihood that the observed points were sampled from the Gaussian Mixture Model (GMM) with respect to the model parameters. We experiment with several real world and synthetic datasets and demonstrate the robustness of the approach over the state-of-the-art.

show abstract

“…Later studies have attempted to generate digital trees more easily in an intuitive structure through the rule and grammar-based process [3]. Some studies have aimed at effectively reconstructing realistic digital plant by combining images with computer vision technique [4]. Because most of these studies focused on the realistic growth and modeling of plant, complexity and efficiency received relatively minor consideration.…”

Section: Introductionmentioning

confidence: 99%

GeoMaTree : Geometric and Mathematical Model Based Digital Tree Authoring System

2018

KSII TIIS

View full text Add to dashboard Cite

This study proposes a method to develop an authoring system(GeoMaTree) for diverse trees that constitute a virtual landscape. The GeoMaTree system enables the simple, intuitive production of an efficient structure, and supports real-time processing. The core of the proposed system is a procedural modeling based on a mathematical model and an application that supports digital content creation on diverse platforms. The procedural modeling allows users to control the complex pattern of branch propagation through an intuitive process. The application is a multi-resolution 3D model that supports appropriate optimization for a tree structure. The application and a compatible function, with commercial tools for supporting the creation of realistic synthetic images and virtual landscapes, are implemented, and the proposed system is applied to a variety of 3D image content.

show abstract

3D tree skeletonization from multiple images based on PyrLK optical flow

Cited by 18 publications

References 21 publications

Modeling and Optimization of a Tree Based on Virtual Reality for Immersive Virtual Landscape Generation

Modeling and Optimization of a Tree Based on Virtual Reality for Immersive Virtual Landscape Generation

Skeletonization of Plant Point Cloud Data in Stochastic Optimization Framework

GeoMaTree : Geometric and Mathematical Model Based Digital Tree Authoring System

Contact Info

Product

Resources

About