Advanced Assistive Maintenance Based on Augmented Reality and 5G Networking

Abstract

Internet of Things (IoT) applications play a relevant role in today’s industry in sharing diagnostic data with off-site service teams, as well as in enabling reliable predictive maintenance systems. Several interventions scenarios, however, require the physical presence of a human operator: Augmented Reality (AR), together with a broad-band connection, represents a major opportunity to integrate diagnostic data with real-time in-situ acquisitions. Diagnostic information can be shared with remote specialists that are able to monitor and guide maintenance operations from a control room as if they were in place. Furthermore, integrating heterogeneous sensors with AR visualization displays could largely improve operators’ safety in complex and dangerous industrial plants. In this paper, we present a complete setup for a remote assistive maintenance intervention based on 5G networking and tested at a Vodafone Base Transceiver Station (BTS) within the Vodafone 5G Program. Technicians’ safety was improved by means of a lightweight AR Head-Mounted Display (HDM) equipped with a thermal camera and a depth sensor to foresee possible collisions with hot surfaces and dangerous objects, by leveraging the processing power of remote computing paired with the low latency of 5G connection. Field testing confirmed that the proposed approach can be a viable solution for egocentric environment understanding and enables an immersive integration of the obtained augmented data within the real scene.

Evaluation of the HoloLens for Medical Applications Using 5G-connected Mobile Devices

“…Different wireless solutions will be tested for latency and data rates. Furthermore, other areas, i.e., telemaintenance, elearning, e-commerce (marketing) and tourism offer additional possibilities for smart glasses [79]- [84]. Involvement and testing of other AR glasses need to be explored in the future.…”

Industrial Internet of Things over 5G: A Practical Implementation

“…Focusing on 5G-enabled end devices, the authors in [15] explore a hardware-based on-demand sensing mechanism that aims to eliminate the energy waste caused by a sensor working in sleep mode. On the other hand, Verde et al [16] use augmented reality to present an assistive maintenance framework connected to a 5G network via customerpremises equipment (CPE). Nevertheless, although proposing an end device with the required sensorisation for the identified use case, none of these solutions explore the use of 5G new radio (5G NR) for industrial applications using NPNs.…”

Applications of Mixed Reality for Smart Aviation Industry: Opportunities and Challenges

“…The applicability of the developed framework was tested in the laboratory and real-world industrial scenarios with good performance. Verde et al [31] combined the Internet of Things (IoT) and MR to create a dependable predictive maintenance system for off-site service. With IoT, engineers can share diagnostic information, and experts can monitor and guide maintenance operations remotely via the controller.…”