What Is Your Reality? Virtual, Augmented, and Mixed Reality in Plastic Surgery Training, Education, and Practice

Lee, Gordon K.; Moshrefi, Shawn; Fuertes, Víctor; Veeravagu, Laksman; Nazerali, Rahim; Lin, Samuel J.

doi:10.1097/prs.0000000000007595

Cited by 27 publications

(21 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Compared with traditional surgical training, virtual surgery system constructs an authentic and highly interactive virtual environment to enhance the efficiency and effectiveness of surgery learning and training [1,24]. With the introduction of collision detection, real-time image and haptic feedback, the immersion of VR-based virtual surgery system has been further improved [12][13][14]. Previous studies have confirmed that VRbased simulators with or without force feedback support effective learning reified as faster completion of surgery and less injury [20,[25][26][27].…”

Section: Discussionmentioning

confidence: 99%

“…Although existing VR-related surgery training system have significantly improved the authenticity of anatomical structures and morphology, the realization of human touch that comes with visual and haptic feedback and construction of physical model based on anatomical human tissue characteristics, especially soft tissue, is still the challenge for surgical simulation [13,14]. On the other hand, the input equipment such like mouse or digital gloves is required as indirect man-machine interaction tools during virtual operation, which is different from the real surgery performed by hands grasping surgical instrument [15][16][17][18].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A virtual surgical prototype system based on gesture recognition for virtual surgical training in maxillofacial surgery

et al. 2022

View full text Add to dashboard Cite

Background Virtual reality (VR) technology is an ideal alternative of operation training and surgical teaching. However, virtual surgery is usually carried out using the mouse or data gloves, which affects the authenticity of virtual operation. A virtual surgery system with gesture recognition and real-time image feedback was explored to realize more authentic immersion. Method Gesture recognition technology proposed with an efficient and real-time algorithm and high fidelity was explored. The recognition of hand contour, palm and fingertip was firstly realized by hand data extraction. Then, an Support Vector Machine classifier was utilized to classify and recognize common gestures after extraction of feature recognition. The algorithm of collision detection adopted Axis Aligned Bounding Box binary tree to build hand and scalpel collision models. What’s more, nominal radius theorem (NRT) and separating axis theorem (SAT) were applied for speeding up collision detection. Based on the maxillofacial virtual surgical system we proposed before, the feasibility of integration of the above technologies in this prototype system was evaluated. Results Ten kinds of signal static gestures were designed to test gesture recognition algorithms. The accuracy of gestures recognition is more than 80%, some of which were over 90%. The generation speed of collision detection model met the software requirements with the method of NRT and SAT. The response time of gesture] recognition was less than 40 ms, namely the speed of hand gesture recognition system was greater than 25 Hz. On the condition of integration of hand gesture recognition, typical virtual surgical procedures including grabbing a scalpel, puncture site selection, virtual puncture operation and incision were carried out with realization of real-time image feedback. Conclusion Based on the previous maxillofacial virtual surgical system that consisted of VR, triangular mesh collision detection and maxillofacial biomechanical model construction, the integration of hand gesture recognition was a feasible method to improve the interactivity and immersion of virtual surgical operation training.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

A virtual surgical prototype system based on gesture recognition for virtual surgical training in maxillofacial surgery

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Similarly, adding a visual layer to a simulation increases the fidelity of procedural training for venous access or surgical techniques ( 44 , 45 ). Multiple studies have used AR-assisted surgical techniques to enhance surgical planning and navigation ( 46 – 48 ).…”

Section: Augmented Realitymentioning

confidence: 99%

Virtual, Augmented, and Alternate Reality in Medical Education: Socially Distanced but Fully Immersed

2021

View full text Add to dashboard Cite

Background Advancements in technology continue to transform the landscape of medical education. The need for technology-enhanced distance learning has been further accelerated by the coronavirus disease (COVID-19) pandemic. The relatively recent emergence of virtual reality (VR), augmented reality (AR), and alternate reality has expanded the possible applications of simulation-based education (SBE) outside of the traditional simulation laboratory, making SBE accessible asynchronously and in geographically diverse locations. Objective In this review, we will explore the evidence base for use of emerging technologies in SBE as well as the strengths and limitations of each modality in a variety of settings. Methods PubMed was searched for peer-reviewed articles published between 1995 and 2021 that focused on VR in medical education. The search terms included medical education, VR, simulation, AR, and alternate reality. We also searched reference lists from selected articles to identify additional relevant studies. Results VR simulations have been used successfully in resuscitation, communication, and bronchoscopy training. In contrast, AR has demonstrated utility in teaching anatomical correlates with the use of diagnostic imaging, such as point-of-care ultrasound. Alternate reality has been used as a tool for developing clinical reasoning skills, longitudinal patient panel management, and crisis resource management via multiplayer platforms. Conclusion Although each of these modalities has a variety of educational applications in health profession education, there are benefits and limitations to each that are important to recognize prior to the design and implementation of educational content, including differences in equipment requirements, cost, and scalability.

show abstract

“…Furthermore, multimodal imaging is required to formulate a differential diagnosis in tumor surgery applications or vascular malformations by providing diagnostic evidence on soft tissues [ 6 ]. Computer-aided design software allows for the manipulation of patient anatomical data, yet it is limited in usability by its technical complexity and often prohibitive cost [ 2 , 4 , 7 , 8 ].…”

Section: Introductionmentioning

confidence: 99%

Virtual Reality and Augmented Reality in Plastic and Craniomaxillofacial Surgery: A Scoping Review

et al. 2023

View full text Add to dashboard Cite

Virtual reality (VR) and augmented reality (AR) have evolved since their introduction to medicine in the 1990s. More powerful software, the miniaturization of hardware, and greater accessibility and affordability enabled novel applications of such virtual tools in surgical practice. This scoping review aims to conduct a comprehensive analysis of the literature by including all articles between 2018 and 2021 pertaining to VR and AR and their use by plastic and craniofacial surgeons in a clinician-as-user, patient-specific manner. From the initial 1637 articles, 10 were eligible for final review. These discussed a variety of clinical applications: perforator flaps reconstruction, mastectomy reconstruction, lymphovenous anastomosis, metopic craniosynostosis, dermal filler injection, auricular reconstruction, facial vascularized composite allotransplantation, and facial artery mapping. More than half (60%) involved VR/AR use intraoperatively with the remainder (40%) examining preoperative use. The hardware used predominantly comprised HoloLens (40%) and smartphones (40%). In total, 9/10 Studies utilized an AR platform. This review found consensus that VR/AR in plastic and craniomaxillofacial surgery has been used to enhance surgeons’ knowledge of patient-specific anatomy and potentially facilitated decreased intraoperative time via preoperative planning. However, further outcome-focused research is required to better establish the usability of this technology in everyday practice.

show abstract

What Is Your Reality? Virtual, Augmented, and Mixed Reality in Plastic Surgery Training, Education, and Practice

Cited by 27 publications

References 14 publications

A virtual surgical prototype system based on gesture recognition for virtual surgical training in maxillofacial surgery

A virtual surgical prototype system based on gesture recognition for virtual surgical training in maxillofacial surgery

Virtual, Augmented, and Alternate Reality in Medical Education: Socially Distanced but Fully Immersed

Virtual Reality and Augmented Reality in Plastic and Craniomaxillofacial Surgery: A Scoping Review

Contact Info

Product

Resources

About