Online and Offline Robot Programming via Augmented Reality Workspaces

Thoo, Yong Joon; Maceiras, Jeremy; Abbet, Philip; Racca, Mattia; Girgin, Hakan; Calinon, Sylvain

doi:10.48550/arxiv.2107.01884

Cited by 1 publication

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…An AR interface (Thoo et al, 2021) for smartphones was developed, combining both online and offline robot programming methods. By manipulating a virtual robot in the end-effector space, that interface provides users the ability to control the robot in real-time as well as program robot tasks offline.…”

Section: Ar-based Robot Programmingmentioning

confidence: 99%

“…Leveraging AR, researchers have proposed a variety of interfaces for planning robot motion. For example, smartphone-based AR interfaces are developed for robot programming (Fuste et al, 2020;Thoo et al, 2021). The safety issue is emphasized in human-robot collaboration, where AR is utilized and has the potential to tackle this problem (Michalos et al, 2016;Ong et al, 2020;Tsamis et al, 2021).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

HA$$R^{2}$$bot: a human-centered augmented reality robot programming method with the awareness of cognitive load

2023

View full text Add to dashboard Cite

In the era of Industry 4.0, manufacturing enterprises are actively adopting collaborative robots (Cobots) in their productions. Current online and offline robot programming methods are difficult to use and require extensive experience or skills. On the other hand, the manufacturing industries are experiencing a labor shortage. An essential question, therefore, is: how would a new robot programming method help novice users complete complex tasks effectively, efficiently, and intuitively? To answer this question, we proposed HA bot, a novel human-centered augmented reality programming interface with awareness of cognitive load. Using NASA’s system design theory and the cognitive load theory, a set of guidelines for designing an AR-based human-robot interaction system is obtained through a human-centered design process. Based on these guidelines, we designed and implemented a human-in-the-loop workflow with features for cognitive load management. The effectiveness and efficiency of HA bot are verified in two complex tasks compared with existing online programming methods. We also evaluated HA bot quantitatively and qualitatively through a user study with 16 participants. According to the user study, compared with existing methods, HA bot has higher efficiency, a lower overall cognitive load, lower cognitive loads for each type, and higher safety.

show abstract

Section: Ar-based Robot Programmingmentioning

confidence: 99%