A Novel Virtual Reality Medical Image Display System for Group Discussions of Congenital Heart Disease: Development and Usability Testing

Abstract

Background The complex 3-dimensional (3D) nature of anatomical abnormalities in congenital heart disease (CHD) necessitates multidisciplinary group discussions centered around the review of medical images such as magnetic resonance imaging. Currently, group viewings of medical images are constrained to 2-dimensional (2D) cross-sectional displays of 3D scans. However, 2D display methods could introduce additional challenges since they require physicians to accurately reconstruct the images mentally into 3D anatomies for diagnosis, staging, and planning of surgery or other therapies. Virtual reality (VR) software may enhance diagnosis and care of CHD via 3D visualization of medical images. Yet, present-day VR developments for medicine lack the emphasis on multiuser collaborative environments, and the effect of displays and level of immersion for diagnosing CHDs have not been studied. Objective The objective of the study was to evaluate and compare the diagnostic accuracies and preferences of various display systems, including the conventional 2D display and a novel group VR software, in group discussions of CHD. Methods A total of 22 medical trainees consisting of 1 first-year, 10 second-year, 4 third-year, and 1 fourth-year residents and 6 medical students, who volunteered for the study, were formed into groups of 4 to 5 participants. Each group discussed three diagnostic cases of CHD with varying structural complexity using conventional 2D display and group VR software. A group VR software, Cardiac Review 3D, was developed by our team using the Unity engine. By using different display hardware, VR was classified into nonimmersive and full-immersive settings. The discussion time, diagnostic accuracy score, and peer assessment were collected to capture the group and individual diagnostic performances. The diagnostic accuracies for each participant were scored by two experienced cardiologists following a predetermined answer rubric. At the end of the study, all participants were provided a survey to rank their preferences of the display systems for performing group medical discussions. Results Diagnostic accuracies were highest when groups used the full-immersive VR compared with the conventional and nonimmersive VR (χ22=9.0, P=.01) displays. Differences between the display systems were more prominent with increasing case complexity (χ22=14.1, P<.001) where full-immersive VR had accuracy scores that were 54.49% and 146.82% higher than conventional and nonimmersive VR, respectively. The diagnostic accuracies provided by the two cardiologists for each participant did not statistically differ from each other (t=–1.01, P=.31). The full-immersive VR was ranked as the most preferred display for performing group CHD discussions by 68% of the participants. Conclusions The most preferred display system among medical trainees for visualizing medical images during group diagnostic discussions is full-immersive VR, with a trend toward improved diagnostic accuracy in complex anatomical abnormalities. Immersion is a crucial feature of displays of medical images for diagnostic accuracy in collaborative discussions.

Clinical Value of Virtual Reality versus 3D Printing in Congenital Heart Disease

“…Although two-dimensional (2D) and three-dimensional (3D) rendering of the medical imaging datasets allow presentation of extra-and intracardiac structures, they are still limited to be viewed on 2D screens which do not depict the depth of the objects, and hence do not realistically convey the 3D views of anomalies. The interpretation of the heart patho-morphology still relies on operators' imagination to some extent [2,[4][5][6][7][8][9][10][11][12][13].…”

Virtual reality three-dimensional echocardiographic imaging for planning surgical atrioventricular valve repair

“…There are case reports using virtual reality in surgical planning, demonstrating some of the benefits and interest in this field for adoption into congenital heart disease 17 and other forms of structural heart disease and planning placements of ventricular assist devices. 18 Importantly, the ability to share image visualization is key to promoting wider discussion, 19 as is usually needed in planning complex cases. Structured evaluations with validation of these techniques will help inform the wider uptake of these methods into standard of care.…”

Investigating the Feasibility of Virtual Reality (VR) for Teaching Cardiac Morphology

“…In the field of CHD, VR can be used to view 3D models when planning complex surgeries [6,7]. The integration of VR in courses for teaching CHD is, however, still in its infancy [8][9][10]. Current commercial solutions typically rely on artistic 3D models, not derived from 3D patient images.…”