Instance-level 3D shape retrieval from a single image by hybrid-representation-assisted joint embedding

Zou, Qian-Fang; Liu, Ligang; Liu, Yang

doi:10.1007/s00371-020-01935-0

Cited by 3 publications

(1 citation statement)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The authors of [27,28] use CAD models to estimate the 3D shape of an object using a set of landmarks. Zou et al focused in [29] on finding the most similar 3D shapes from a 3D shape space for input image queries.…”

Section: D Reconstruction Using Template Deformationmentioning

confidence: 99%

3D objects reconstruction from frontal images: an example with guitars

2022

View full text Add to dashboard Cite

This work deals with the automatic 3D reconstruction of objects from frontal RGB images. This aims at a better understanding of the reconstruction of 3D objects from RGB images and their use in immersive virtual environments. We propose a complete workflow that can be easily adapted to almost any other family of rigid objects. To explain and validate our method, we focus on guitars. First, we detect and segment the guitars present in the image using semantic segmentation methods based on convolutional neural networks. In a second step, we perform the final 3D reconstruction of the guitar by warping the rendered depth maps of a fitted 3D template in 2D image space to match the input silhouette. We validated our method by obtaining guitar reconstructions from real input images and renders of all guitar models available in the ShapeNet database. Numerical results for different object families were obtained by computing standard mesh evaluation metrics such as Intersection over Union, Chamfer Distance, and the F-score. The results of this study show that our method can automatically generate high-quality 3D object reconstructions from frontal images using various segmentation and 3D reconstruction techniques.

show abstract

Section: D Reconstruction Using Template Deformationmentioning

confidence: 99%