Exploration of Visuo-haptic Interactions to Support Learning Leopold's Maneuvers Process in Virtual Reality

Abstract

Immersive technologies have been utilized in nursing education and other disciplines as effective learning and teaching tools. Many virtual reality (VR) simulations provide users immersive experiences through audiovisual stimuli. However, these systems do not enable haptic and tangible interactions, preventing them from utilizing higher multisensory stimuli for learning.There is a need in nursing education for more realistic VR experiences that allow direct hand manipulation in the acquisition of assessment skills, especially Leopold's Maneuvers which require palpating the patient's abdomen. To meet this need, a haptic-enabled virtual reality simulation called Leopold's Maneuvers VR was developed. This application utilized a set of commercial haptic gloves called SenseGlove to allow users to touch and feel the virtual patient's abdomen and fetus in the virtual exam room. To investigate the quality of haptic interactions from Leopold's Maneuvers VR, two sets of user studies were conducted. Study 1 was an explorative haptic experience study to investigate the effectiveness and usability of the haptic interactions. Study1 included three tasks to evaluate four different haptic device settings and a subjective poststudy questionnaire to measure sense of presence for each device. Four different haptic device settings consisted of VIVE controller, SenseGlove, Custom-made Vibration glove, and the combination of Vibration glove and SenseGlove. The results show that SenseGlove showed the highest performance in task 1 and Vibration glove showed highest performance in task 2 and 3.According to the quantitative analysis, the combination of the SenseGlove and the Vibration glove provided the highest presence.Study 2 was conducted with three of the haptic devices which showed high performance and presence. Study 2 investigated haptic interactions in the Leopold's Maneuvers process using iii Leopold's Maneuvers VR application. Most participants showed improvements in Leopold's Maneuvers knowledge after using the application and expressed positive feedback about using haptic devices in the application. This implies that the application may prove to be an effective educational tool in nursing education. In the future, we would like to improve the application based on the user feedback and conduct user studies with more students. iv DEDICATION This thesis is dedicated to my family, who have provided me with great love, support, and care during this journey. No words can express how grateful I am to them for always being there for me and encouraging me. v ACKNOWLEDGEMENTS I would like to thank my committee chair, Dr. Jinsil Hwaryoung Seo, for her guidance and continuous support throughout this research. I would also want to thank my committee members, Caleb Kicklighter and Dr. Elizabeth Wells-Beede, for their encouragement and insightful feedback.A special thanks goes to the developers, Jack Greene and Tomas Arguello for bringing this idea to life. I would also like to thank the Texas A&M Department of Visualization, the department ...

Digital Transformation in Nursing Education: A Systematic Review on Computer-Aided Nursing Education Pedagogies, Recent Advancements and Outlook on the Post-COVID-19 Era

“…Two studies ( [56] and [73]) are not included in Table 10, as their authors did not report Mean and SD in their findings, 2021 Mobile application with AR Quasi-experimental [73] 2021 AR-enabled smartphone application Quasi-experimental [106] 2021 AR Qualitative [77] 2021 Mobile application with VR and haptics RCT [79] 2021 Multimodal RCT [113] 2021 Haptics desktop system Qualitative [117] 2021 VR with haptics Qualitative [119] 2021 VR with haptics Qualitative [118] 2021 AR application with haptics Qualitative [75] 2021 3D holograms Quasi-experimental [115] 2021 XR smart glasses Qualitative [109] 2021 MR and holograms Qualitative [112] 2022 MR and holograms Qualitative [105] 2022 AR with holograms Qualitative [93] 2022 AI Desktop system Qualitative [78] 2022 Haptics RCT [104] 2022 AR Desktop system Qualitative [72] 2022 AR-enabled smartphone application Quasi-experimental [88] 2022 VR Desktop system Qualitative [62] 2022 Mobile chatbot RCT [63] 2022 AI chatbot Quasi-experimental [64] 2022 AI chatbot Quasi-experimental [92] 2022 AI chatbot Qualitative [54] 2022 Mobile application Quasi-experimental [60] 2022 [48] 2022 Desktop 3D system Quasi-experimental [57] 2023 Interactive mobile application Quasi-experimental [68] 2023 An app incorporating VR RCT [121] 2023 AI system Qualitative [74] 2023 AR mobile application RCT [70] 2023 AR enabled system RCT [111] 2023 MR and holograms Qualitative [114] 2023 Multimodal Qualitative [44] CAI system Nursing care of diabetic pregnant patients.…”

“…Also, some concerns about the physical characteristics of the hardware, such as headset weight, were seen as a limitation [118]. A VR simulation with haptics, called "Leopold's Manoeuvres VR", to monitor fetus development by palpating a "human abdomen" was developed by [119]. A Sense Glove worn by the user allows haptic feedback in force and vibration.…”

“…However, the noise caused by the glove distracted the users from their immersive state. It also was reported that the glove weighed too much [119].…”

“…[118] AR application with Haptics Condition recognition (Edema). [119] Haptics(with VR) Monitor fetus development. [120] Non-immersive VR Airway management.…”

Smart Glasses Use Experience of Nursing Graduate Students: Qualitative Study

“…For complex skills, favorable consequences are expected to be higher, allowing students to experience a sense of accomplishment and complete exercises perfectly, which would lead to improved competency in core nursing skills (11). Technological advances involving wearable devices, such as smart glasses, have been applied in many nursing education programs (12)(13)(14). In their study, Kim et al used smart glasses on nursing students in blood transfusion and intradermal injection applications.…”