Concept of an Intuitive Human-Robot-Collaboration via Motion Tracking and Augmented Reality

Augmented Reality for Human–Robot Collaboration and Cooperation in Industrial Applications: A Systematic Literature Review

“…Hald et al [ 108 ] for a drawing application (toy problem), where the objective was to assess the operators’ trust towards the robot as the robotic manipulator speed changes, takes on the Rethink Robotics’ Sawyer cobot. Finally, Luipers and Richert [ 112 ] uses an ABB YuMi for handover tasks.…”

“…Hald et al [ 108 ] projects over the paper the lines that the robot is going to draw. Similarly, Luipers and Richert [ 112 ] also intends to show the user the cobot planned path so the user can be aware of the robot’s intended motion. Schmitt et al [ 110 ] projects in the workstation colored areas, being green and red for human and robot workspaces, respectively, and yellow for a collaborative task, where they share the same working area.…”

“…Most of the papers, such as Makris et al [ 92 ], Michalos et al [ 91 ], Gkournelos et al [ 98 ], Michalos et al [ 99 ], Papanastasiou et al [ 105 ], Andersen et al [ 93 ], Kalpagam et al [ 49 ], Kyjanek et al [ 104 ], Chan et al [ 88 ], Hald et al [ 108 ], Luipers and Richert [ 112 ], Schmitt et al [ 110 ], and Andronas et al [ 113 ], present only safety informational content and do not act directly to prevent accidents or collisions. Therefore, they can be classified as passive approaches.…”

“…Moreover, it also presents to the user a 3D holographic visualization of the part being assembled, highlighting where it should be mounted. The same concept is presented in Luipers and Richert [ 112 ] where the author intends to use an AR feature to guide the user throughout an assembly operation by projecting a textual description of the current step. Lotsaris et al [ 111 ] on its turn makes use of multiple workbenches, so the developed application presents, in addition to the textual description of the task to be performed, indications showing in which workbench the task should be performed.…”

“…Luipers and Richert [ 112 ] presents a concept of an AR feature to give feedback to the user on the assembly status, which steps were concluded or not, as well as the overall progress of the process. Ji et al [ 101 ] goes a little further exhibiting production-related information, such as the running time of the task, the expected remaining time to conclude it, which task is being performed, the current and total number of steps, and how many components are available to be assembled.…”