Re‐defining the virtual reality dental simulator: Demonstrating concurrent validity of clinically relevant assessment and feedback

Abstract

Introduction Virtual reality (VR) dental simulators are gaining momentum as a useful tool to educate dental students. To date, no VR dental simulator exercise has been designed which is capable of reliably providing validated, meaningful clinical feedback to dental students. This study aims to measure the concurrent validity of the assessment and the provision of qualitative feedback, pertaining to cavity preparations by VR dental simulators. Methods A cavity preparation exercise was created on a VR dental simulator, and assessment criteria for cavity preparations were developed. The exercise was performed 10 times in order to demonstrate a range of performances, and for each, the simulator feedback was recorded. The exercises were subsequently three‐dimensionally printed, and 12 clinical teachers were asked to assess the preparations according to the same criteria. Inter‐rater reliability (IRR) between clinical teachers was measured using a free‐marginal multirater kappa value. Clinical teacher assessment responses were compared with the VR simulator responses and percentage agreements calculated. Results IRR values for each exercise ranged from 0.39 to 0.77 (69.39%‐88.48%). The assessment of smoothness (κfree 0.58, 78.79%) and ability to follow the outline (κfree 0.56, 77.88%) demonstrated highest agreement between clinical teachers, whilst the assessment of undercut (κfree 0.15, 57.58%) and depth (κfree 0.28, 64.09%) had the lowest agreement. The modal percentage agreement between clinical teachers and the VR simulator was, on average, 78% across all exercises. Conclusion The results of this study demonstrate that it is possible to provide reliable and clinically relevant qualitative feedback via a VR dental simulator. Further research should look to employ this technique across a broader range of exercises that help to develop other complex operative dental skills.

The Current Situation and Future Prospects of Simulators in Dental Education

“…They also allow digital objective evaluation and tutorial feedback [34,52] by recording the training processes [53]. In addition, training in dental simulators is more clinically relevant [54] because they recreate situations that are similar to those encountered in a real clinical environment [14]. It is certain that dental simulators can eliminate the risk of treatment and enhance the safety of patients [55,56].…”

Combining virtual reality and 3D‐printed models to simulate patient‐specific dental operative procedures—A study exploring student perceptions

“…26 However, recent developments in providing clinically relevant feedback with dental simulators may impact on this preference as the technology improves. 45…”

Effectiveness of Virtual Reality and Interactive Simulators on Dental Education Outcomes: Systematic Review

“…Many of the required dental education competency skills are challenging to acquire, and mandates repeated training and long practice. 4 Since the breakthrough of the novel coronavirus SARS-Co-V-2 (severe acute respiratory syndrome coronavirus 2) in late 2019, 5 all essential activities were affected, calling for social distancing, and the traditional dental teaching models of one-on-one pedagogical design had to be partially replaced by digital or virtual setups to avoid the gathering of the youth in closed spaces.…”