DFusion: Denoised TSDF Fusion of Multiple Depth Maps with Sensor Pose Noises

Niu, Zhaofeng; Fujimoto, Yuichiro; Kanbara, Masayuki; Sawabe, Taishi; Kato, Hirokazu

doi:10.3390/s22041631

Cited by 3 publications

(2 citation statements)

References 36 publications

(51 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For testing, a sample consisting of 8 object categories was used: table, chair, bookshelf, sofa, trash can, cabinet, display, and bathtub (Table 1). This sample was obtained using the TSDF Fusion method [19], which reconstructs 3D object surfaces from a set of RGB-D images. The TSDF Fusion method uses a Truncated Signed Distance Function (TSDF), which is a scalar field that stores the distance from each point in space to the nearest surface.…”

Section: Performance Evaluation Of the Proposed Methodsmentioning

confidence: 99%

Joint layout, object pose, and mesh reconstruction method from scanned point clouds with restoration of missing points

Sorokin,

Zhdanov,

Zhdanov

et al. 2023

Optoelectronic Imaging and Multimedia Technology X

View full text Add to dashboard Cite

Current work proposes a novel approach for joint layout, object pose, and mesh reconstruction from scanned point clouds that leverages the latest neural network architectures and addresses the challenge of missing point data. The goal of this research is to develop an advanced approach that can generate accurate and complete 3D models from point cloud data obtained from real-world environments. The proposed method leverages state-of-the-art neural network architectures, including PointNet++ and Transformer, to accomplish the task. PointNet++ is used for feature extraction, while Transformer is used for joint feature representation learning. By combining these two networks, the proposed method can effectively encode the complex geometries of the 3D scenes and generate high-quality reconstructions. The core concept of the method is to initially segment the point cloud into small fragments using a neural network. Each fragment is then reconstructed as a polygonal mesh. Addressing the restoration of missing points in point cloud data is a significant problem that this paper tackles. It adapts a robust method, which utilizes the L1-Median algorithm and local point cloud features, to effectively fill in these missing points. This approach is capable of adjusting to various geometric structures and rectifying topological connection errors, enabling the reconstruction of complete and accurate models even when some original data is missing. The proposed method is compared against several state-of-the-art approaches and has the potential to be a valuable tool in a range of applications, including architecture, engineering, digitization of cultural heritages, as well as augmented and mixed reality systems.

show abstract

Section: Performance Evaluation Of the Proposed Methodsmentioning

confidence: 99%

Joint layout, object pose, and mesh reconstruction method from scanned point clouds with restoration of missing points

Sorokin,

Zhdanov,

Zhdanov

et al. 2023

Optoelectronic Imaging and Multimedia Technology X

View full text Add to dashboard Cite

show abstract

“…Niu et al [4] proposed a new fusion network to minimize the influences from the two most common sensor noises, i.e., depth noises and pose noises.…”

mentioning

confidence: 99%