On-Site 4-in-1 Alignment: Visualization and Interactive CAD Model Retrofitting Using UAV, LiDAR’s Point Cloud Data, and Video

Abstract

Acquisition of 3D point cloud data (PCD) using a laser scanner and aligning it with a video frame is a new approach that is efficient for retrofitting comprehensive objects in heavy pipeline industrial facilities. This work contributes a generic framework for interactive retrofitting in a virtual environment and an unmanned aerial vehicle (UAV)-based sensory setup design to acquire PCD. The framework adopts a 4-in-1 alignment using a point cloud registration algorithm for a pre-processed PCD alignment with the partial PCD, and frame-by-frame registration method for video alignment. This work also proposes a virtual interactive retrofitting framework that uses pre-defined 3D computer-aided design models (CAD) with a customized graphical user interface (GUI) and visualization of a 4-in-1 aligned video scene from a UAV camera in a desktop environment. Trials were carried out using the proposed framework in a real environment at a water treatment facility. A qualitative and quantitative study was conducted to evaluate the performance of the proposed generic framework from participants by adopting the appropriate questionnaire and retrofitting task-oriented experiment. Overall, it was found that the proposed framework could be a solution for interactive 3D CAD model retrofitting on a combination of UAV sensory setup-acquired PCD and real-time video from the camera in heavy industrial facilities.

A Scoping Review on Virtual Reality-Based Industrial Training

“…Immersive environments and 3D representations make users more interested and committed to their training, (ii) speed, due to the creative and attractive way that this digital tool offers, workers can obtain and retain information in an efficient way. VR allows for training through emotional response, the best method to not forget what has been learned [68,69]. (iii) Measurability, because it works with computer-generated environments, researchers can easily obtain any required statistics, such as the time that it takes an operator to carry out a certain activity, the most common accidents or the procedure with less difficulty, (iv) reduction of work accidents, the use of VR offers a much safer scenario, in which users can practice obtaining the necessary skill without the need to risk their integrity, (v) personalization, scenarios can adapt to the requirements of each worker, and, (vi) reduction of costs, VR helps to reduce infrastructure, materials, time, and personnel expenses that are required by real simulations [70].…”

The Role of UAS–GIS in Digital Era Governance. A Systematic Literature Review

“…These make plausible the image of future smart cities where drone flights will become a normality, similar to road vehicles today [17], together with other technologies that include wireless sensor networks (WSNs), the Internet of Things (IoT), cloud computing, fog computing, and big data ana-lytics. Among the expected applications in the literature, based on the use of UAV/UAS technologies, we mention: traffic monitoring and management, health emergency services, disaster management, security and crowd monitoring, UAS-based infrastructure inspections, agriculture management and environmental monitoring, tourism support, UAS-based surveying, merchandise order delivery, UAS-aided wireless communication, UAS taxi, virtual retrofitting applications, cinematography, human-robot interaction-based applications, UAS-based fog computing, both for urban and for rural residential environments [18][19][20][21].…”