Augmented Reality with Multi-view Merging for Robot Teleoperation

Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces

“…Internal Status [479] Robot's Capability [66] Object Status [21] Sensor/Camera Data [377] Plan and Target [136] Simulation [76] Interactive Content [386] Virtual Background [8] [ 13,15,18,19,66,86,98,101,124,158,195,262,282,285,302,324,332,375,474,479,481] [4, 15,21,24,38,47,79,84,89,102,114,143,149,150,153,171,174,178,182,184,185,201,216,…”

Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces

“…Internal Status [479] Robot's Capability [66] Object Status [21] Sensor/Camera Data [377] Plan and Target [136] Simulation [76] Interactive Content [386] Virtual Background [8] [ 13,15,18,19,66,86,98,101,124,158,195,262,282,285,302,324,332,375,474,479,481] [4, 15,21,24,38,47,79,84,89,102,114,143,149,150,153,171,174,178,182,184,185,201,216,2...…”

“…Figure 10 suggests that there are less explored application domains, which can be investigated in the future, which include design and creative tasks, remote collaboration, and workspace applications. Manufacturing: joint assembly [21,30,43,138,289], grasping and manipulation [ [67,79,153,185,379], tutorial and simulation [52], welding [313] Maintenance: maintenance of robots [144,252], remote repair [31,48], performance monitoring [126,128], setup and calibration [352], debugging [373] Safety and Inspection: nuclear detection [15], drone monitoring [76,114,171,482], safety feature [44,66,104,379,385], ground monitoring [211,269,479] Automation and Teleoperation: interactive programming interface [118,131,136,177,270,288,324,496] Logistics: package delivery [265] Aerospace: surface exploration [54], teleoperated manipulator…”

Multi-View Merging for Robot Teleoperation With Virtual Reality

“…The local view is aligned and superimposed into the global view as a 3D point cloud, allowing the operator to view and operate from the same perspective. Our preliminary work showed that our approach can provide the operator with essential 3D information for manipulation tasks across multiple scales [19] while remaining computationally lightweight.…”