ETÄLÄ - Virtual Reality Assisted Telepresence System for Remote Control and Maintenance

Harmo, Panu; Halme, Aarne; Virekoski, Petri; Halinen, Matias; Pitkänen, Hannu

doi:10.1016/s1474-6670(17)39278-9

Cited by 7 publications

(7 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another challenge is provided by the industrial environment, since the real case scenario and target object could be far from the original representations of the procedure, maintainers may need help to correctly perform their task. The Etälä project [17] proposed tele-assistance and AR to establish a communication channel between local maintainers and remote experts. A similar approach was adopted in [18], where AR and VR were used to remotely support both trainees and technicians.…”

Section: State Of the Artmentioning

confidence: 99%

A State Validation System for Augmented Reality Based Maintenance Procedures

2019

View full text Add to dashboard Cite

Maintenance has been one of the most important domains for augmented reality (AR) since its inception. AR applications enable technicians to receive visual and audio computer-generated aids while performing different activities, such as assembling, repairing, or maintenance procedures. These procedures are usually organized as a sequence of steps, each one involving an elementary action to be performed by the user. However, since it is not possible to automatically validate the users actions, they might incorrectly execute or miss some steps. Thus, a relevant open problem is to provide users with some sort of automated verification tool. This paper presents a system, used to support maintenance procedures through AR, which tries to address the validation problem. The novel technology consists of a computer vision algorithm able to evaluate, at each step of a maintenance procedure, if the user correctly completed the assigned task or not. The validation occurs by comparing an image of the final status of the machinery, after the user has performed the task, and a virtual 3D representation of the expected final status. Moreover, in order to avoid false positives, the system can identify both motions in the scene and changes in the camera’s zoom and/or position, thus enhancing the robustness of the validation phase. Tests demonstrate that the proposed system can effectively help the user in detecting and avoiding errors during the maintenance process.

show abstract

Section: State Of the Artmentioning

confidence: 99%

A State Validation System for Augmented Reality Based Maintenance Procedures

2019

View full text Add to dashboard Cite

show abstract

“…How data is managed in the AR-based application? Examples include scenario-oriented/processoriented (e.g., [51]), knowledge-based (e.g., [50]), or virtual model-based (e.g., [52]) data retrieval. (4) Human-System Interaction.…”

Section: Designmentioning

confidence: 99%

“…How does an AR-based application provide collaboration among users? Examples include using a microphone and a remote laser pointer (e.g., [52]). If abnormalities can be diagnosed using the proposed mobile AR-based approach, a real-time fault diagnosis system could be developed as an advanced tool to diagnose problems in an aluminium smelter as shown in Figure 8.…”

Section: Designmentioning

confidence: 99%

Aluminium Process Fault Detection and Diagnosis

Majid

Taylor

Chen

et al. 2015

Advances in Materials Science and Engineering

View full text Add to dashboard Cite

The challenges in developing a fault detection and diagnosis system for industrial applications are not inconsiderable, particularly complex materials processing operations such as aluminium smelting. However, the organizing into groups of the various fault detection and diagnostic systems of the aluminium smelting process can assist in the identification of the key elements of an effective monitoring system. This paper reviews aluminium process fault detection and diagnosis systems and proposes a taxonomy that includes four key elements: knowledge, techniques, usage frequency, and results presentation. Each element is explained together with examples of existing systems. A fault detection and diagnosis system developed based on the proposed taxonomy is demonstrated using aluminium smelting data. A potential new strategy for improving fault diagnosis is discussed based on the ability of the new technology, augmented reality, to augment operators’ view of an industrial plant, so that it permits a situation-oriented action in real working environments.

show abstract

“…Other AR research fields cover maintenance, repair, and assembly, with the goal of reducing time, costs, and the error rate [19][20][21]. Operators would need to conduct continuous attention switches between the manual and device during some complex tasks, which may involve a high cognitive load.…”

Section: Introductionmentioning

confidence: 99%

A Multi-User Collaborative AR System for Industrial Applications

Wang

2022

Sensors

View full text Add to dashboard Cite

Augmented reality (AR) applications are increasingly being used in various fields (e.g., design, maintenance, assembly, repair, training, etc.), as AR techniques help improve efficiency and reduce costs. Moreover, collaborative AR systems extend applicability, allowing for collaborative environments for different roles. In this paper, we propose a multi-user collaborative AR system (aptly called the “multi-user collaborative system”, or MUCSys); it is composed of three ends—MUCStudio, MUCView, and MUCServer. MUCStudio aims to construct industrial content with CAD model transformation, simplification, database update, marker design, scene editing, and exportation, while MUCView contains sensor data analysis, real-time localization, scene loading, annotation editing, and virtual–real rendering. MUCServer—as the bridge between MUCStudio and MUCView—presents collaborative and database services. To achieve this, we implemented the algorithms of local map establishment, global map registration, optimization, and network synchronization. The system provides AR services for diverse industrial processes via three collaborative ways—remote support, collaborative annotation, and editing. According to the system, applications for cutting machines were presented to improve efficiency and reduce costs, covering cutting head designs, production line sales, and cutting machine inspections. Finally, a user study was performed to prove the usage experience of the system.

show abstract

ETÄLÄ - Virtual Reality Assisted Telepresence System for Remote Control and Maintenance

Cited by 7 publications

References 0 publications

A State Validation System for Augmented Reality Based Maintenance Procedures

A State Validation System for Augmented Reality Based Maintenance Procedures

Aluminium Process Fault Detection and Diagnosis

A Multi-User Collaborative AR System for Industrial Applications

Contact Info

Product

Resources

About