Creating a Shared Reality with Robots

Muhammad, Faizan; Hassan, Amel; Cleaver, Andre; Sinapov, Jivko

doi:10.1109/hri.2019.8673191

Cited by 24 publications

(11 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Prior work in this domain has explored the use of augmented reality (AR) for more efficient human-robot interaction and visualization of the robot's state and intent. However, these works have relied on colocalization through detection of landmark objects [8], or the use of fiducial markers mounted on the robot [9]. While these approaches for colocalization are sufficient to perform AR visualization, they do not provide further spatial understanding for the AR device Fig.…”

Section: A Colocalizing the Human And Robotmentioning

confidence: 99%

Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together

Delmerico,

Poranne,

Bogo

et al. 2022

Preprint

View full text Add to dashboard Cite

Spatial computing-the ability of devices to be aware of their surroundings and to represent this digitally-offers novel capabilities in human-robot interaction. In particular, the combination of spatial computing and egocentric sensing on mixed reality devices enables them to capture and understand human actions and translate these to actions with spatial meaning, which offers exciting new possibilities for collaboration between humans and robots. This paper presents several human-robot systems that utilize these capabilities to enable novel robot use cases: mission planning for inspection, gesture-based control, and immersive teleoperation. These works demonstrate the power of mixed reality as a tool for human-robot interaction, and the potential of spatial computing and mixed reality to drive the future of human-robot interaction.

show abstract

Section: A Colocalizing the Human And Robotmentioning

confidence: 99%

Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together

Delmerico,

Poranne,

Bogo

et al. 2022

Preprint

View full text Add to dashboard Cite

show abstract

“…This includes 1) sensor data from the internal or external sensors, 2) camera or video feed, 3) information about external objects, 4) depth map or 3D reconstructed scene of the environment. Examples include camera feeds for remote drone operations [171], the world in miniature of the environment [4], sensor stream data of the environment [15], visualization of obstacles [263], a local cost map for search task [305], a 3D reconstructed view of the environment [114,332], a warning sign projected onto an object that…”

Section: Information-2 External Information About the Environmentmentioning

confidence: 99%

“…-Proximity: Finally, proximity is used as an implicit form of interaction to communicate with robots [14,182,305]. For example, the AR's trajectory will be updated to show the robot's intent when the a passerby approaches the robot [458].…”

Section: Only Output Implicit Explicit and Indirect Explicit And Directmentioning

confidence: 99%

“…Evaluation through Demonstration: Evaluation through demonstration is a technique to see how well a system will potentially work in certain situations. The most common approach from our findings include showing example applications [84,127,142,209,245,325,366,382,418,476] and proof-of-concept demonstrations of a system [24,55,117,162,199,221,270,305,375,479].…”

Section: Evaluation Strategiesmentioning

confidence: 99%

See 1 more Smart Citation

Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces

Suzuki,

Karim,

Xia

et al. 2022

Preprint

View full text Add to dashboard Cite

“…AR provides computer-generated graphics on a user's view of the real world. In the context of mobile robots, the AR robotics system enables users and robots to communicate through a shared reality space that merges the robot's visual world with the human's (Muhammad et al, 2019). The system consists of different visualizations that represent sensory and cognitive data that is rendered on the user interface.…”

Section: Related Workmentioning

confidence: 99%

HAVEN: A Unity-based Virtual Robot Environment to Showcase HRI-based Augmented Reality

Cleaver,

Tang,

Chen

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

Due to the COVID-19 pandemic, conducting Human-Robot Interaction (HRI) studies in person is not permissible due to social distancing practices to limit the spread of the virus. Therefore, a virtual reality (VR) simulation with a virtual robot may offer an alternative to real-life HRI studies. Like a real intelligent robot, a virtual robot can utilize the same advanced algorithms to behave autonomously. This paper introduces HAVEN (HRI-based Augmentation in a Virtual robot Environment using uNity), a VR simulation that enables users to interact with a virtual robot. The goal of this system design is to enable researchers to conduct HRI Augmented Reality studies using a virtual robot without being in a real environment. This framework also introduces two common HRI experiment designs: a hallway passing scenario and humanrobot team object retrieval scenario. Both reflect HAVEN's potential as a tool for future AR-based HRI studies.

show abstract

Creating a Shared Reality with Robots

Cited by 24 publications

References 4 publications

Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together

Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together

Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces

HAVEN: A Unity-based Virtual Robot Environment to Showcase HRI-based Augmented Reality

Contact Info

Product

Resources

About