Registration System Errors Perception in Augmented Reality Based on RGB-D Cameras

Tokunaga, Daniel Makoto; Corrêa, Cléber Gimenez; Bernardo, F.M.M.; Bernardes, João Luiz; Ranzini, Edith; Nunes, Fátima L. S.; Tori, Romero

doi:10.1007/978-3-319-21067-4_14

Cited by 2 publications

(2 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, different drawbacks and limitations have been reported in the literature, such as depth of perception and registration errors [ 17 , 32 ].…”

Section: Discussionmentioning

confidence: 99%

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Ruggiero

Cercenelli

Emiliani

et al. 2023

JCM

View full text Add to dashboard Cite

Background: Augmented reality (AR) allows the overlapping and integration of virtual information with the real environment. The camera of the AR device reads the object and integrates the virtual data. It has been widely applied to medical and surgical sciences in recent years and has the potential to enhance intraoperative navigation. Materials and methods: In this study, the authors aim to assess the accuracy of AR guidance when using the commercial HoloLens 2 head-mounted display (HMD) in pediatric craniofacial surgery. The Authors selected fronto-orbital remodeling (FOR) as the procedure to test (specifically, frontal osteotomy and nasal osteotomy were considered). Six people (three surgeons and three engineers) were recruited to perform the osteotomies on a 3D printed stereolithographic model under the guidance of AR. By means of calibrated CAD/CAM cutting guides with different grooves, the authors measured the accuracy of the osteotomies that were performed. We tested accuracy levels of ±1.5 mm, ±1 mm, and ±0.5 mm. Results: With the HoloLens 2, the majority of the individuals involved were able to successfully trace the trajectories of the frontal and nasal osteotomies with an accuracy level of ±1.5 mm. Additionally, 80% were able to achieve an accuracy level of ±1 mm when performing a nasal osteotomy, and 52% were able to achieve an accuracy level of ±1 mm when performing a frontal osteotomy, while 61% were able to achieve an accuracy level of ±0.5 mm when performing a nasal osteotomy, and 33% were able to achieve an accuracy level of ±0.5 mm when performing a frontal osteotomy. Conclusions: despite this being an in vitro study, the authors reported encouraging results for the prospective use of AR on actual patients.

show abstract

“…However, different drawbacks and limitations have been reported in the literature, such as depth of perception and registration errors [ 17 , 32 ].…”

Section: Discussionmentioning

confidence: 99%

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Ruggiero

Cercenelli

Emiliani

et al. 2023

JCM

View full text Add to dashboard Cite

show abstract

“…AR is a promising technology for craniofacial surgeons to obtain a “see-through” effect in the operating room. However, some problems with AR, such as depth perception ( 27 ) and registration errors ( 28 ), i.e. the difference between virtual content and actual reality resulting in bias for users, still remain.…”

Section: Discussionmentioning

confidence: 99%

Augmented Reality to Assist Skin Paddle Harvesting in Osteomyocutaneous Fibular Flap Reconstructive Surgery: A Pilot Evaluation on a 3D-Printed Leg Phantom

et al. 2022

View full text Add to dashboard Cite

BackgroundAugmented Reality (AR) represents an evolution of navigation-assisted surgery, providing surgeons with a virtual aid contextually merged with the real surgical field. We recently reported a case series of AR-assisted fibular flap harvesting for mandibular reconstruction. However, the registration accuracy between the real and the virtual content needs to be systematically evaluated before widely promoting this tool in clinical practice. In this paper, after description of the AR based protocol implemented for both tablet and HoloLens 2 smart glasses, we evaluated in a first test session the achievable registration accuracy with the two display solutions, and in a second test session the success rate in executing the AR-guided skin paddle incision task on a 3D printed leg phantom.MethodsFrom a real computed tomography dataset, 3D virtual models of a human leg, including fibula, arteries and skin with planned paddle profile for harvesting, were obtained. All virtual models were imported into Unity software to develop a marker-less AR application suitable to be used both via tablet and via HoloLens 2 headset. The registration accuracy for both solutions was verified on a 3D printed leg phantom obtained from the virtual models, by repeatedly applying the tracking function and computing pose deviations between the AR-projected virtual skin paddle profile and the real one transferred to the phantom via a CAD/CAM cutting guide. The success rate in completing the AR-guided task of skin paddle harvesting was evaluated using CAD/CAM templates positioned on the phantom model surface.ResultsOn average, the marker-less AR protocol showed comparable registration errors (ranging within 1-5 mm) for tablet-based and HoloLens-based solution. Registration accuracy seems to be quite sensitive to ambient light conditions. We found a good success rate in completing the AR-guided task within an error margin of 4 mm (97% and 100% for tablet and HoloLens, respectively). All subjects reported greater usability and ergonomics for HoloLens 2 solution.ConclusionsResults revealed that the proposed marker-less AR based protocol may guarantee a registration error within 1-5 mm for assisting skin paddle harvesting in the clinical setting. Optimal lightening conditions and further improvement of marker-less tracking technologies have the potential to increase the efficiency and precision of this AR-assisted reconstructive surgery.

show abstract

Registration System Errors Perception in Augmented Reality Based on RGB-D Cameras

Cited by 2 publications

References 21 publications

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Augmented Reality to Assist Skin Paddle Harvesting in Osteomyocutaneous Fibular Flap Reconstructive Surgery: A Pilot Evaluation on a 3D-Printed Leg Phantom

Contact Info

Product

Resources

About