Do 3-D Printed Handheld Models Improve Surgeon Reliability for Recognition of Intraarticular Distal Radius Fracture Characteristics?

Abstract

Background For fracture care, radiographs and two-dimensional (2-D) and three-dimensional (3-D) CT are primarily used for preoperative planning and postoperative evaluation. Intraarticular distal radius fractures are technically challenging to treat, and meticulous preoperative planning is paramount to improve the patient’s outcome. Three-dimensionally printed handheld models might improve the surgeon’s interpretation of specific fracture characteristics and patterns preoperatively and could therefore be clinically valuable; however, the additional value of 3-D printed handheld models for fractures of the distal radius, a high-volume and commonly complex fracture due to its intraarticular configuration, has yet to be determined. Questions/purposes (1) Does the reliability of assessing specific fracture characteristics that guide surgical decision-making for distal radius fractures improve with 3-D printed handheld models? (2) Does surgeon agreement on the overall fracture classification improve with 3-D printed handheld models? (3) Does the surgeon’s confidence improve when assessing the overall fracture configuration with an additional 3-D model? Methods We consecutively included 20 intraarticular distal radius fractures treated at a Level 1 trauma center between May 2018 and November 2018. Ten surgeons evaluated the presence or absence of specific fracture characteristics (volar rim fracture, die punch, volar lunate facet, dorsal comminution, step-off > 2 mm, and gap > 2 mm), fracture classification according to the AO/Orthopaedic Trauma Association (OTA) classification scheme, and their confidence in assessing the overall fracture according to the classification scheme, rated on a scale from 0 to 10 (0 = not at all confident to 10 = very confident). Of 10 participants regularly treating distal radius fractures, seven were orthopaedic trauma surgeons and three upper limb surgeons with experience levels ranging from 1 to 25 years after completion of residency training. Fractures were assessed twice, with 1 month between each assessment. Initially, fractures were assessed using radiographs and 2-D and 3-D CT images (conventional assessment); the second time, the evaluation was based on radiographs and 2-D and 3-D CT images with an additional 3-D handheld model (3-D printed handheld model assessment). On both occasions, fracture characteristics were evaluated upon a surgeon’s own interpretation, without specific instruction before assessment. We provided a sheet demonstrating the AO/OTA classification scheme before evaluation on each session. Multi-rater Fleiss’s kappa was used to determine intersurgeon reliability for assessing fracture characteristics and classification. Confidence regarding assessment of the overall fracture classification was assessed using a paired t-test. Results We found that 3-D printed models of intraarticular distal radius fractures led to no change in kappa values for the reliability of all characteristics: volar rim (conventional kappa 0.19 [95% CI 0.06 to 0.32], kappa for 3-D handheld model 0.23 [95% CI 0.11 to 0.36], difference of kappas 0.04 [95% CI -0.14 to 0.22]; p = 0.66), die punch (conventional kappa 0.38 [95% CI 0.15 to 0.61], kappa for 3-D handheld model 0.50 [95% CI 0.23 to 0.78], difference of kappas 0.12 [95% CI -0.23 to 0.47]; p = 0.52), volar lunate facet (conventional kappa 0.31 [95% CI 0.14 to 0.49], kappa for 3-D handheld model 0.48 [95% CI 0.23 to 0.72], difference of kappas 0.17 [95% CI -0.12 to 0.46]; p = 0.26), dorsal comminution (conventional kappa 0.36 [95% CI 0.13 to 0.58], kappa for 3-D handheld model 0.31 [95% CI 0.11 to 0.51], difference of kappas -0.05 [95% CI -0.34 to 0.24]; p = 0.74), step-off > 2 mm (conventional kappa 0.55 [95% CI 0.29 to 0.82], kappa for 3-D handheld model 0.58 [95% CI 0.31 to 0.85], difference of kappas 0.03 [95% CI -0.34 to 0.40]; p = 0.87), gap > 2 mm (conventional kappa 0.59 [95% CI 0.39 to 0.79], kappa for 3-D handheld model 0.69 [95% CI 0.50 to 0.89], difference of kappas 0.10 [95% CI -0.17 to 0.37]; p = 0.48). Although there appeared to be categorical improvement in kappa values for some fracture characteristics, overlapping CIs indicated no change. Fracture classification did not improve (conventional diagnostics: kappa 0.27 [95% CI 0.14 to 0.39], conventional diagnostics with an additional 3-D handheld model: kappa 0.25 [95% CI 0.15 to 0.35], difference of kappas: -0.02 [95% CI -0.18 to 0.14]; p = 0.81). There was no improvement in self-assessed confidence in terms of assessment of overall fracture configuration when a 3-D model was added to the evaluation process (conventional diagnostics 7.8 [SD 0.79 {95% CI 7.2 to 8.3}], 3-D handheld model 8.5 [SD 0.71 {95% CI 8.0 to 9.0}], difference of score: 0.7 [95% CI -1.69 to 0.16], p = 0.09). Conclusions Intersurgeon reliability for evaluating the characteristics of and classifying intraarticular distal radius fractures did not improve with an additional 3-D model. Further studies should evaluate the added value of 3-D printed handheld models for teaching surgical residents and medical trainees to define the future role of 3-D printing in caring for fractures of the distal radius. Level of Evidence Level II, diagnostic study.

The role of 3-dimensional printed models in the management of the distal radius fractures

“…Compared to Langerhuizen et al 11 who observed no improvement in the reliability for classifying fracture characteristics of AO/OTA types B and C distal radius fractures with 3D printed models, we achieved satisfactory results for evaluating the morphology and preoperative planning for AO/OTA type C distal radius fractures, with an improved overall intra-observer agreement from fair to moderate for the AO/OTA classification and questions: “How many fragments are dislocated?” and “How many fragments have to be fixed?” ( P < .05). In the overall inter-observer agreement, the kappa values improved from slight to fair for the questions “How many fragments are dislocated?” and “How many fragments have to be fixed?” ( P < .05).…”

“… 10 In contrast, another study where 3D printed models were added has reported no improvements in reliability for the recognition of fracture characteristics and classification of AO/OTA B type C distal radius fractures. 11 …”

Are 3D-printed Models of Tibial Plateau Fractures a Useful Addition to Understanding Fractures for Junior Surgeons?

“…Forty-four patients without a good-quality preoperative CT scan and those with a bone disease (such as osteoporosis or osteogenesis imperfecta) were excluded. Previous studies on the additional value of 3D-printed models were based on approximately 20 fractures and could not demonstrate a clinically relevant improvement [ 2 , 11 ]. To ensure that observers could stay focused during the classification process and that a possible clinically relevant improvement could be achieved, we decided to include 40 patients with a tibial plateau fracture.…”

“…The value of 3D-printed models in classifying and assessing fractures is controversial. Studies on intraarticular distal radius fractures and distal humerus fractures show that 3D-printed models do not improve interobserver agreement [ 1 , 11 ]. A similar study on acetabular fractures demonstrated that 3D-printed models improve interobserver agreement in classification compared with conventional radiographs, but not compared with CT [ 13 ].…”

A Novel Instant 3-Dimensional Printing System for Postoperative Fracture Patients: A Comparative Cohort Study

“…Given such disadvantages, attention has turned to other approaches better able to address these issues [ 9 ]. Recently, 3-dimensional (3D) printing has been introduced, and found to be useful in many areas of medicine [ 10 ]. For example, Zhou et al reported the application of a 3D-printed template to assist sacroiliac screw placement, improving the operation’s safety profile [ 11 ].…”