Robust Laparoscopic Instruments Tracking Using Colored Strips

Mamone, Virginia; Viglialoro, Rosanna Maria; Cutolo, Fabrizio; Cavallo, Filippo; Guadagni, Simone; Ferrari, Vincenzo

doi:10.1007/978-3-319-60928-7_11

Cited by 10 publications

(6 citation statements)

References 17 publications

(22 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The simulation sessions will be administered until the procedure is correctly performed without the AR support and the objective of the desired performance is achieved. The latter will be evaluated trough the automatic evaluation system that extracts: the task execution time, the time spent outside the field of view camera instruments, the path length and the jerk, developed in our previous work [48]. Our study has some limitations.…”

Section: Discussionmentioning

confidence: 99%

Augmented Reality to Improve Surgical Simulation: Lessons Learned Towards the Design of a Hybrid Laparoscopic Simulator for Cholecystectomy

Viglialoro

Esposito

Condino

et al. 2019

IEEE Trans. Biomed. Eng.

Self Cite

View full text Add to dashboard Cite

Hybrid surgical simulators based on augmented reality (AR) solutions benefit from the advantages of both the box trainers and the virtual reality simulators. This paper reports on the results of a long development stage of a hybrid simulator for laparoscopic cholecystectomy that integrates real and the virtual components. We first outline the specifications of the AR simulator and then we explain the strategy adopted for implementing it based on a careful selection of its simulated anatomical components, and characterized by a real-time tracking of both a target anatomy and of the laparoscope. The former is tracked by means of an electromagnetic field generator, while the latter requires an additional camera for video tracking. The new system was evaluated in terms of AR visualization accuracy, realism, and hardware robustness. Obtained results show that the accuracy of AR visualization is adequate for training purposes. The qualitative evaluation confirms the robust-ness and the realism of the simulator. In conclusion, the proposed AR simulator satisfies all the initial specifications in terms of anatomical appearance, modularity, reusability, minimization of spare parts cost, and ability to record surgical errors and to track in real-time the Calot's triangle and the laparoscope. Thus, the proposed system could be an effective training tool for learning the task of identification and isolation of Calot's triangle in laparoscopic cholecystectomy. Moreover, the presented strategy could be applied to simulate other surgical procedures involving the task of identification and isolation of generic tubular structures, such as blood vessels, biliary tree, and nerves, which are not directly visible.

show abstract

Section: Discussionmentioning

confidence: 99%

Augmented Reality to Improve Surgical Simulation: Lessons Learned Towards the Design of a Hybrid Laparoscopic Simulator for Cholecystectomy

Viglialoro

Esposito

Condino

et al. 2019

IEEE Trans. Biomed. Eng.

Self Cite

View full text Add to dashboard Cite

show abstract

“…where N refers to the total number of samples in the processed motion. The normalized jerk (J norm ) is expressed in Equation ( 9) [41,42]:…”

Section: Performance Metricsmentioning

confidence: 99%

A Projected AR Serious Game for Shoulder Rehabilitation Using Hand-Finger Tracking and Performance Metrics: A Preliminary Study on Healthy Subjects

Viglialoro,

Turini,

Carbone

et al. 2023

Electronics

View full text Add to dashboard Cite

Research studies show that serious games can increase patient motivation regardless of age or illness and be an affordable and promising solution with respect to conventional physiotherapy. In this paper, we present the latest evolution of our system for shoulder rehabilitation based on hand-finger tracking and projected augmented reality. This version integrates metrics to assess patient performance, monitors the game progress, and allows the selection of the game visualization mode (standard on-screen or projected augmented reality). Additionally, the new software tracks the velocity, acceleration, and normalized jerk of the arm-hand movements of the user. Specifically, sixteen healthy volunteers (eight technical and eight rehabilitation experts) tested our current prototype. The results showed that the serious game is engaging, its design is ergonomically sound, and the overall system could be a useful tool in shoulder rehabilitation. However, clinical validation is needed to assess that the serious game has the same effects as the selected therapy. This is the preliminary step toward laying the foundation for future studies that investigate abnormalities in shoulder movements by using hand-finger tracking.

show abstract

“…The acquired sets were automatically processed to estimate the 2D target visualization error (TVE2D), that is: the offset, expressed in pixels, between the virtual and real objects in the image plane (i.e., the centroids of the virtual landmarks, and the corresponding real 3D-printed landmarks). The Real Set and the AR Set were processed in the hue-saturationvalue (HSV) color space that allows a robust segmentation even when the target objects show non-uniformities in illumination, shadows, or shading [37]. The image processing, performed in MATLAB, included the following steps:…”

Section: Evaluation Of the Camera Calibration And Ar Visualizationmentioning

confidence: 99%

Hybrid Spine Simulator Prototype for X-ray Free Pedicle Screws Fixation Training

et al. 2021

Self Cite

View full text Add to dashboard Cite

Simulation for surgical training is increasingly being considered a valuable addition to traditional teaching methods. 3D-printed physical simulators can be used for preoperative planning and rehearsal in spine surgery to improve surgical workflows and postoperative patient outcomes. This paper proposes an innovative strategy to build a hybrid simulation platform for training of pedicle screws fixation: the proposed method combines 3D-printed patient-specific spine models with augmented reality functionalities and virtual X-ray visualization, thus avoiding any exposure to harmful radiation during the simulation. Software functionalities are implemented by using a low-cost tracking strategy based on fiducial marker detection. Quantitative tests demonstrate the accuracy of the method to track the vertebral model and surgical tools, and to coherently visualize them in either the augmented reality or virtual fluoroscopic modalities. The obtained results encourage further research and clinical validation towards the use of the simulator as an effective tool for training in pedicle screws insertion in lumbar vertebrae.

show abstract

Robust Laparoscopic Instruments Tracking Using Colored Strips

Cited by 10 publications

References 17 publications

Augmented Reality to Improve Surgical Simulation: Lessons Learned Towards the Design of a Hybrid Laparoscopic Simulator for Cholecystectomy

Augmented Reality to Improve Surgical Simulation: Lessons Learned Towards the Design of a Hybrid Laparoscopic Simulator for Cholecystectomy

A Projected AR Serious Game for Shoulder Rehabilitation Using Hand-Finger Tracking and Performance Metrics: A Preliminary Study on Healthy Subjects

Hybrid Spine Simulator Prototype for X-ray Free Pedicle Screws Fixation Training

Contact Info

Product

Resources

About