Applications of 3D Reconstruction in Virtual Reality-Based Teleoperation: A Review in the Mining Industry

Abstract

Although multiview platforms have enhanced work efficiency in mining teleoperation systems, they also induce “cognitive tunneling” and depth-detection issues for operators. These issues inadvertently focus their attention on a restricted central view. Fully immersive virtual reality (VR) has recently attracted the attention of specialists in the mining industry to address these issues. Nevertheless, developing VR teleoperation systems remains a formidable challenge, particularly in achieving a realistic 3D model of the environment. This study investigates the existing gap in fully immersive teleoperation systems within the mining industry, aiming to identify the most optimal methods for their development and ensure operator’s safety. To achieve this purpose, a literature search is employed to identify and extract information from the most relevant sources. The most advanced teleoperation systems are examined by focusing on their visualization types. Then, various 3D reconstruction techniques applicable to mining VR teleoperation are investigated, and their data acquisition methods, sensor technologies, and algorithms are analyzed. Ultimately, the study discusses challenges associated with 3D reconstruction techniques for mining teleoperation. The findings demonstrated that the real-time 3D reconstruction of underground mining environments primarily involves depth-based techniques. In contrast, point cloud generation techniques can mostly be employed for 3D reconstruction in open-pit mining operations.

Towards Optimal Image Processing-based Internet of Things Monitoring Approaches for Sustainable Cities

“…Furthermore, the swift proliferation of urbanization has resulted in unparalleled rates of population growth and urban expansion [17]. With the increasing migration of citizens from rural to urban areas in pursuit of economic prospects and better living conditions, cities are facing the challenge of absorbing expanding populations while preserving livability and quality of life [18].…”

Blasthole Location Detection Using Support Vector Machine and Convolutional Neural Networks on UAV Images and Photogrammetry Models

“…Drill and blast activities impact all these processes in a mine, influencing shovel productivity, equipment maintenance, highwall stability, ore recovery, and the related costs across all these processes. Therefore, it is necessary to utilize novel technologies, such as sensors, unmanned aerial vehicle (UAV), image processing, virtual reality, and teleoperation to address these issues [1][2][3][4].…”

Enhanced High-Definition Video Transmission for Unmanned Driving in Mining Environments

“…Overcoming the challenge of achieving low-latency transmission of high-definition videos using 5G technology is considered a primary concern for unmanned driving in mines [15]. Currently, conventional 5G primarily assigns time slots for eMBB (Enhanced Mobile Broadband) [16], with a standard downlink allocation of 70% and an uplink allocation of 30%, which proves inadequate for extensive uplink scenarios, particularly high-definition video transmission from underground to the surface [17]. Furthermore, unmanned vehicles require collaboration with tunnel infrastructures during one-dimensional movement to offload computing tasks; however, the existing coordination algorithms [18,19] lack optimization for overall low latency.…”