Intelligent Reverse-Engineering Segmentation: Automatic Semantic Recognition of Large 3D Digitalized Cloud of Points Dedicated to Heritage Objects

Abstract

In this article we present a multidisciplinary experimentation realized between a mechanical laboratory, a computer scientist laboratory and a museum. Our goal is to provide automatic tools for non-expert people who want to use 3D digitized elements. After scanning an objet, we obtain a huge amount of points. In order to manipulate it, it is necessary to decimate it. However, when doing this operation, we can optimize the algorithms for creating semantic topology; obviously we can do it automatically. Consequently, we are going to do what we name segmentation: we extract meaning from 3D points and meshes. Our experimentation deals with a physical mock-up of Nantes city that have been designed in 1900. After digitalization, we have created a software that can: 1. use the whole 3D cloud of points as an input; 2. fill a knowledge database with an intelligent segmentation of the 3D virtual models: ground, walls, roofs… This use case is the first step of our research. At the end, we aim to deploy our method to complex mechanical parts. Nowadays, when designing CAD parts we use as well as volume parts than surface parts or meshes. We know is it not necessary to reconstruct all the triangles. It is a lost of time and we can directly use cloud of points for CAD design. However, the design tree will not be updated. So, with our method, imagine that one day we can digitalize a motor and a system could automatically create the 3D mock-up and the design tree.

Knowledge management for modeled Heritage objects, requirement specifications towards a tool for heterogeneity embracing

“…BIM software used for documenting heritage buildings come from the construction industry [36], and are tweaked in order to manage hypothetical, uncertain and incomplete data. In a similar way, heritage studies deploy reverse engineering methodology and tools from industrial and mechanical engineers [31]. All of those approaches create a specific type of interdisciplinarity.…”

Museum augmented interface for historical scale models: towards a new way for cultural heritage promotion

“…Many topological issues still have to be treated at this step: holes, file mergers, missing parts and so on. Post-treatment (using Geomagic software) to solve these issues is described in [11].…”