Computer Vision Meets Image Processing and UAS PhotoGrammetric Data Integration: From HBIM to the eXtended Reality Project of Arco della Pace in Milan and Its Decorative Complexity

Banfi, Fabrizio; Mandelli, Alessandro

doi:10.3390/jimaging7070118

Cited by 14 publications

(10 citation statements)

References 54 publications

(54 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Visualisation and interaction with the model are flexible and fast at the same time. The generation of HBIM for a medieval infrastructure and a cloud system able to share the levelling results has led to a repository for SHM [93].…”

Section: Levels Of Interoperability Interactivity and Immersion Of The Masegra Castle And Azzone Visconti Bridge: A Critical Reviewmentioning

confidence: 99%

The Evolution of Interactivity, Immersion and Interoperability in HBIM: Digital Model Uses, VR and AR for Built Cultural Heritage

Banfi

2021

IJGI

Self Cite

View full text Add to dashboard Cite

Today, a building is not just a “body” or a “machine” as defined by modern architecture, but rather an immaterial entity immersed in a digital world where not only its components but also the information associated with it are accounted for. In recent decades, building information modelling (BIM) has made it possible to move from 2D CAD drawings to 3D models capable of supporting different processes and interacting with different disciplines in the AEC industry for storing, documenting and sharing heterogeneous content. It has thus become possible to direct these techniques towards built heritage to investigate new forms of communication and share heritage building information modelling (HBIM) models. This research investigates this evolution in both generative terms (scan-to-BIM process) and cultural and historical terms in order to orient BIM uses towards novel forms of interactivity and immersion between users and models. The author proposes the use of a digital process and the development of VR and AR environments based on a visual programming language (VPL) to improve access to a deeper knowledge of HBIM models and the artefacts and information contained therein.

show abstract

Section: Levels Of Interoperability Interactivity and Immersion Of The Masegra Castle And Azzone Visconti Bridge: A Critical Reviewmentioning

confidence: 99%

The Evolution of Interactivity, Immersion and Interoperability in HBIM: Digital Model Uses, VR and AR for Built Cultural Heritage

Banfi

2021

IJGI

Self Cite

View full text Add to dashboard Cite

show abstract

“…The typical classification consists in dividing segmentation algorithms as follows: pixel-based algorithms, when individual pixel values form the only information used to perform segmentation; edge-based algorithms, when segmentation is based on the detection of the edges present within the given image; and region-based algorithms, when both pixel values and the surrounding information are utilised to form different regions. Image segmentation is an essential step towards high-level image processing task, such as image analysis, pattern recognition [2][3][4], and computer vision [5]. In different applications of colour image processing, great importance is attached to the techniques used for image segmentation, because the results of the further steps of image processing depend on the segmentation quality (the object recognition and tracking, the retrieval in image databases, etc.…”

Section: Introductionmentioning

confidence: 99%

A Semiautomatic Multi-Label Color Image Segmentation Coupling Dirichlet Problem and Colour Distances

2021

View full text Add to dashboard Cite

Image segmentation is an essential but critical component in low level vision, image analysis, pattern recognition, and now in robotic systems. In addition, it is one of the most challenging tasks in image processing and determines the quality of the final results of the image analysis. Colour based segmentation could hence offer more significant extraction of information as compared to intensity or texture based segmentation. In this work, we propose a new local or global method for multi-label segmentation that combines a random walk based model with a direct label assignment computed using a suitable colour distance. Our approach is a semi-automatic image segmentation technique, since it requires user interaction for the initialisation of the segmentation process. The random walk part involves a combinatorial Dirichlet problem for a weighted graph, where the nodes are the pixel of the image, and the positive weights are related to the distances between pixels: in this work we propose a novel colour distance for computing such weights. In the random walker model we assign to each pixel of the image a probability quantifying the likelihood that the node belongs to some subregion. The computation of the colour distance is pursued by employing the coordinates in a colour space (e.g., RGB, XYZ, YCbCr) of a pixel and of the ones in its neighbourhood (e.g., in a 8–neighbourhood). The segmentation process is, therefore, reduced to an optimisation problem coupling the probabilities from the random walker approach, and the similarity with respect the labelled pixels. A further investigation involves an adaptive preprocess strategy using a regression tree for learning suitable weights to be used in the computation of the colour distance. We discuss the properties of the new method also by comparing with standard random walk and k−means approaches. The experimental results carried on the White Blood Cell (WBC) dataset and GrabCut datasets show the remarkable performance of the proposed method in comparison with state-of-the-art methods, such as normalised random walk and normalised lazy random walk, with respect to segmentation quality and computational time. Moreover, it reveals to be very robust with respect to the presence of noise and to the choice of the colourspace.

show abstract

“…A photogrammetric survey was also carried out to produce 3D orthophotos from the collected images block; the results are attached to the HBIM as the basis for a detailed analysis of the related portion of the building [45]. Banfi et al [46] also proposed a BIM texture method in extended reality (XR) environment derives from synchronization of multiple modeling software. The method requires the use of several immersive photogrammetric photos, and UV mapping was used to address the problem of representing a texture in 3D rendering.…”

Section: Introductionmentioning

confidence: 99%

“…Banfi et al [46] developed a novel web-immersive texture mapping method based on a synchronized mapping technique of multiple modeling software in an extended reality platform. The orthophotos used for web immersive texture map-ping were generated by photogrammetric survey using different convergent images.…”

mentioning

confidence: 99%

As-Textured As-Built BIM Using Sensor Fusion, Zee Ain Historical Village as a Case Study

2021

View full text Add to dashboard Cite

The work described in the paper emphasizes the importance of integrating imagery and laser scanner techniques (TLS) to optimize the geometry and visual quality of Heritage BIM. The fusion-based workflow was approached during the recording of Zee Ain Historical Village in Saudi Arabia. The village is a unique example of traditional human settlements, and represents a complex natural and cultural heritage site. The proposed workflow divides data integration into two levels. At the basic level, UAV photogrammetry with enhanced mobility and visibility is used to map the ragged terrain and supplement TLS point data in upper and unaccusable building zones where shadow data originated. The merging of point clouds ensures that the building’s overall geometry is correctly rebuilt and that data interpretation is improved during HBIM digitization. In addition to the correct geometry, texture mapping is particularly important in the area of cultural heritage. Constructing a realistic texture remains a challenge in HBIM; because the standard texture and materials provided in BIM libraries do not allow for reliable representation of heritage structures, mapping and sharing information are not always truthful. Thereby, at the second level, the workflow proposed true orthophoto texturing method for HBIM models by combining close-range imagery and laser data. True orthophotos have uniform scale that depicts all objects in their respective planimetric positions, providing reliable and realistic mapping. The process begins with the development of a Digital Surface Model (DSM) by sampling TLS 3D points in a regular grid, with each cell uniquely associated with a model point. Then each DSM cell is projected in the corresponding perspective imagery in order to map the relevant spectral information. The methods allow for flexible data fusion and image capture using either a TLS-installed camera or a separate camera at the optimal time and viewpoint for radiometric data. The developed workflows demonstrated adequate results in terms of complete and realistic textured HBIM, allowing for a better understanding of the complex heritage structures.

show abstract

Computer Vision Meets Image Processing and UAS PhotoGrammetric Data Integration: From HBIM to the eXtended Reality Project of Arco della Pace in Milan and Its Decorative Complexity

Cited by 14 publications

References 54 publications

The Evolution of Interactivity, Immersion and Interoperability in HBIM: Digital Model Uses, VR and AR for Built Cultural Heritage

The Evolution of Interactivity, Immersion and Interoperability in HBIM: Digital Model Uses, VR and AR for Built Cultural Heritage

A Semiautomatic Multi-Label Color Image Segmentation Coupling Dirichlet Problem and Colour Distances

As-Textured As-Built BIM Using Sensor Fusion, Zee Ain Historical Village as a Case Study

Contact Info

Product

Resources

About