Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study

Abstract

Background: Trainees in Otolaryngology-Head and Neck Surgery must gain proficiency in a variety of challenging temporal bone surgical techniques. Traditional teaching has relied on the use of cadavers; however, this method is resource-intensive and does not allow for repeated practice. Virtual reality surgical training is a growing field that is increasingly being adopted in Otolaryngology. CardinalSim is a virtual reality temporal bone surgical simulator that offers a high-quality, inexpensive adjunct to traditional teaching methods. The objective of this study was to establish the face and content validity of CardinalSim through a national study. Methods: Otolaryngologists and resident trainees from across Canada were recruited to evaluate CardinalSim. Ethics approval and informed consent was obtained. A face and content validity questionnaire with questions categorized into 13 domains was distributed to participants following simulator use. Descriptive statistics were used to describe questionnaire results, and either Chi-square or Fishers exact tests were used to compare responses between junior residents, senior residents, and practising surgeons. Results: Sixty-two participants from thirteen different Otolaryngology-Head and Neck Surgery programs were included in the study (32 practicing surgeons; 30 resident trainees). Face validity was achieved for 5 out of 7 domains, while content validity was achieved for 5 out of 6 domains. Significant differences between groups (p-value of < 0.05) were found for one face validity domain (realistic ergonomics, p = 0.002) and two content validity domains (teaching drilling technique, p = 0.011 and overall teaching utility, p = 0.006). The assessment scores, global rating scores, and overall attitudes towards CardinalSim, were universally positive. Open-ended questions identified limitations of the simulator. Conclusion: CardinalSim met acceptable criteria for face and content validity. This temporal bone virtual reality surgical simulation platform may enhance surgical training and be suitable for patient-specific surgical rehearsal for practicing Otolaryngologists.

Virtual reality improves the accuracy of simulated preoperative planning in temporal bones: a feasibility and validation study

“…After completing the tasks, the subjects evaluated the subjective validity of both the methods using a modified fivepoint Likert-type survey (see Online Resource 2.). Similar surveys have been previously used in temporal bone simulator studies [18][19][20]. The questionnaire included 20 domains in which one represented not true/realistic/useful and five represented very true/realistic/useful.…”

The user experience design of a novel microscope within SurgiSim, a virtual reality surgical simulator

“…When paired with increased accessibility due to decreased hardware size and costs, the potential to advance microscope-specific training abounds. However, commercially available temporal bone surgery simulators, such as the Voxel-Man® (Voxel-Man Group, Hamburg, Germany), are expensive and not yet routinely incorporated into surgical practice [ 6 , 20 ].…”

“…"SurgiSim" is a VR platform, built on the original "Cardinal-Sim" platform, developed for the patient-specific exploration and manipulation of anatomy generated from clinical imaging studies [4][5][6]. It is a collaborative multi-institutional effort between the University of Calgary, Western University, and Stanford University.…”

High-Fidelity Virtual Reality Simulation for the Middle Cranial Fossa Approach—Modules for Surgical Rehearsal and Education

“…33 This is especially significant in an era where residency curricula have shifted to competency-based training where mastery of set procedures must be met rather than simply based on duration of training years. 3,14 VR is a fitting educational adjunct given resource limitations, restrictions to work hours, and variability of clinical exposure. 14 In our climate of advancing technology, VR training modules can be shared collaboratively across distant sites and training programs.…”