Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI

Abstract

Background: Augmented Reality (AR) represents an innovative technology to improve data visualization and strengthen the human perception. Among Human–Machine Interaction (HMI), medicine can benefit most from the adoption of these digital technologies. In this perspective, the literature on orthopedic surgery techniques based on AR was evaluated, focusing on identifying the limitations and challenges of AR-based healthcare applications, to support the research and the development of further studies. Methods: Studies published from January 2018 to December 2021 were analyzed after a comprehensive search on PubMed, Google Scholar, Scopus, IEEE Xplore, Science Direct, and Wiley Online Library databases. In order to improve the review reporting, the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used. Results: Authors selected sixty-two articles meeting the inclusion criteria, which were categorized according to the purpose of the study (intraoperative, training, rehabilitation) and according to the surgical procedure used. Conclusions: AR has the potential to improve orthopedic training and practice by providing an increasingly human-centered clinical approach. Further research can be addressed by this review to cover problems related to hardware limitations, lack of accurate registration and tracking systems, and absence of security protocols.

Extended Reality in Neurosurgical Education: A Systematic Review

“…A quick search of both PubMed and PROSPERO revealed seven systematic reviews revolving around topics close to the one addressed by our review [5,[40][41][42][43][44][45]. Two of them [40,41] address the use of simulation models as a tool in neurosurgical education, including all kinds of simulation systems such as 3D-printed, cadaveric, and animal models.…”

“…However, in their review, only a modest number of studies (n = 9) were included, even encompassing both educational and preoperative applications of VR techniques. Although the 2016 review by Barsom et al [44] and the 2022 review by Innocente et al [45] studied the application of holographic techniques within neurosurgical education among other medical fields, their overall scope was strictly limited to augmented reality techniques while neglecting all other technologies belonging to the XR spectrum. In summary, to the best of our knowledge, this systematic review is the first to specifically target the educational application of XR techniques within the field of cranial neurosurgery, while still collecting the highest number of studies, compared to the aforementioned studies.…”

Development of a Human–Robot Interface for Cobot Trajectory Planning Using Mixed Reality

“…Moreover, visualization and interaction with digital cobot twins is made possible by implementing mixed reality [14]. Head-mounted display devices (HMD) using this technology enable the integration of effective and easy-to-understand human-machine interfaces (HMI) [15]. In this way, an operator can perform tasks in a shared environment in which virtual and real robots operate in synchrony to carry out specific tasks [16].…”

A Metaverse Platform for Preserving and Promoting Intangible Cultural Heritage

“…The metaverse is also enabling the employment of a truly human-centered approach, fostering human augmentation by providing users with new ways to interact with and experience digital settings. The expression "Augmented Humans" [4] refers to the adoption of methods and technology that enhance physical, cognitive, or sensory skills beyond what is common for humans. This paradigm shift is transforming various aspects of daily life and industries, such as education [5] and healthcare [6], by providing immersive learning environments, virtual training simulations, and new forms of entertainment.…”