AR-Enhanced Human-Robot-Interaction - Methodologies, Algorithms, Tools

Andersson, Nils; Argyrou, Angelos; Nägele, Frank; Ubis, Fernando; Campos, Urko Esnaola; Zarate, Maite Ortiz de; Wilterdink, Robert

doi:10.1016/j.procir.2016.03.022

Cited by 20 publications

(10 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…By augmenting the physical environment with virtual objects, AR further enhances information perception and situational awareness, giving the users a live view of the manufacturing environment. AR has been applied in many areas in manufacturing, including assembly and human-robot interaction [3][4][5].…”

Section: Related Workmentioning

confidence: 99%

Haptic and visual augmented reality interface for programming welding robots

Yew

Ong

et al. 2017

Adv. Manuf.

View full text Add to dashboard Cite

It is a challenging task for operators to program a remote robot for welding manipulation depending only on the visual information from the remote site. This paper proposes an intuitive user interface for programming welding robots remotely using augmented reality (AR) with haptic feedback. The proposed system uses a depth camera to reconstruct the surfaces of workpieces. A haptic input device is used to allow users to define welding paths along these surfaces. An AR user interface is developed to allow users to visualize and adjust the orientation of the welding torch. Compared with the traditional robotic welding path programming methods which rely on prior CAD models or contact between the robot end-effector and the workpiece, this proposed approach allows for fast and intuitive remote robotic welding path programming without prior knowledge of CAD models of the workpieces. The experimental results show that the proposed approach is a user-friendly interface and can assist users in obtaining an accurate welding path.

show abstract

Section: Related Workmentioning

confidence: 99%

Haptic and visual augmented reality interface for programming welding robots

Yew

Ong

et al. 2017

Adv. Manuf.

View full text Add to dashboard Cite

show abstract

“…The system is compatible with HMD (Hololens), tablet PCs (Android and Windows), and also laptops and uses marker-based tracking. In a different study, Andersson et al [18] proposed a system that visualizes robot joint states and trajectory in AR via HMD (PENNY), tablets (Windows, iOS, and Android), and also PC and markerless-based tracking was performed using keypoints estimation. Similarly, other HRI research related to programming of industrial robots via AR have been conducted [29]- [32] but these researches are excluded as they do not indicate robot features that such as robot trajectories that may be used for diagnosis purposes.…”

Section: Resultsmentioning

confidence: 99%

“…However, there is little relevant work done on the applications of AR for the maintenance of robots. These researches are typically conducted in a controlled laboratory environment rather than a production environment [18]. This review paper will focus on AR tracking techniques used in maintenance of robots.…”

Section: Introductionmentioning

confidence: 99%

A Review on Augmented Reality Tracking Methods for Maintenance of Robots

et al. 2020

View full text Add to dashboard Cite

Augmented reality (AR) in maintenance is a broad subject with many nuances when it comes to their implementation. The applications of these systems range from maintenance of large-scale assets such as buildings to smaller scale assets such as robots. Applications of AR in maintenance typically serves as a visual guide to assist users in diagnosis or steps needed to be performed for maintenance. In this paper, the tracking methods utilized in AR-based maintenance for robots are qualitatively evaluated. The reviewed works in this paper are between the years of 2015 to 2020 to ensure that the AR tracking methods are relatively state of the art. It is found that applications of AR-based maintenance for robots are uncommon in the scope defined in this research especially in the industrial environment as most reviewed works are conducted in a laboratory setting. In addition to that, it is found that marker-based tracking methods are commonly utilized in these applications.

show abstract

“…Other works have described frameworks and architectural designs of solutions, e.g. [18] and [19]. However, there is not enough information about their solutions and implementations for comparison or use to guide a new solution.…”

Section: Related Literaturementioning

confidence: 99%

Analysis, design and development of a framework focused on augmented reality applications: Medical rounds case

Flores¹,

Martínez²,

Morales-Rocha³

2021

EAI Endorsed Transactions on Creative Technologies

View full text Add to dashboard Cite

Augmented reality is a technology that opens doors to experience interactions with virtual and real-world elements. It provides an opportunity to acquire knowledge and practical skills through software. However, it is not an easy task to determine the qualities and features that an augmented reality framework must possess to lay the foundations to build a structure focused on augmented reality. Therefore, in this work, we propose a framework focused on augmented reality applications without a specific domain area. We conduct a review of different frameworks for augmented reality. In order to define the characteristics, components, and the overall structure of our framework, a review of the most relevant literature in the field was carried out. As a result, we designed a framework focused on augmented reality without a specific domain area. Finally, we conclude that the structures, components, and features for an augmented reality framework vary greatly depending on the requirements or characteristics used for each approach.

show abstract

AR-Enhanced Human-Robot-Interaction - Methodologies, Algorithms, Tools

Cited by 20 publications

References 12 publications

Haptic and visual augmented reality interface for programming welding robots

Haptic and visual augmented reality interface for programming welding robots

A Review on Augmented Reality Tracking Methods for Maintenance of Robots

Analysis, design and development of a framework focused on augmented reality applications: Medical rounds case

Contact Info

Product

Resources

About