Laparoscopic video analysis for training and image-guided surgery

Abstract

Automatic analysis of Minimally Invasive Surgical video has the potential to drive new solutions for alleviating needs of safe and reproducible training programs, objective and transparent evaluation systems and navigation tools to assist surgeons and improve patient safety. Surgical video is an always available source of information, which can be used without any additional intrusive hardware in the operating room. This paper is focused on surgical video analysis methods and techniques. It describes authors' contributions in two key aspects, the 3D reconstruction of the surgical field and the segmentation and tracking of tools and organs based on laparoscopic video images. Results are given to illustrate the potential of this field of research, like the calculi of the 3D position and orientation of a tool from its 2D image, or the translation of a preoperative resection plan into a hepatectomy surgical procedure using the shading information of the image. Research efforts are required to further develop these technologies in order to harness all the valuable information available in any video-based surgery.tool tracking, organ reconstruction

Methods and Tools for Objective Assessment of Psychomotor Skills in Laparoscopic Surgery

“…On advanced phases, where cognitive and judgment abilities gain importance, and training gradually moves to the OR, tracking of movements becomes more complicated. As sensorbased tracking systems may interfere in the surgical workflow, we believe the use of endoscopic video information for computer-vision based tracking will be the solution [98]. Moreover, despite current limitations on validation studies, automatic analysis techniques will enhance these systems, allowing to determine not only surgical expertise, but also to unfold and quantify hidden aspects of surgical skill, like the level of automation of tasks (i.e., novices spending much more time in an idle "thinking" state) or the optimal combination of both efficiency and quality metrics for a given task.…”

“…An alternative approach for passive and unobtrusive tracking is the analysis of the laparoscopic videos, which allows registering movements employing computer visión techniques [98]. The non-invasive characteristics of an assessment system based on these technologies makes it fit for any potential training scenario inside and outside the OR.…”

EVA: Laparoscopic Instrument Tracking Based on Endoscopic Video Analysis for Psychomotor Skills Assessment

“…An alternative to active tracking is the analysis of the endoscopic images to determine the spatial position of the surgical instruments [14]. The noninvasive and unobtrusive nature of a tracking system based on computer vision techniques makes it suitable for training purposes (both in laboratory settings and the operating room) and for image-guided surgical navigation [ 14,15].…”

TELMA: Technology-enhanced learning environment for minimally invasive surgery

“…The evolution of technology-enhanced learning (TEL) has led to the development of learning management systems, like .LRN and Moodle, which enable organizations to plan and track their learning needs; as well as learning content management systems [10,11], which provide tools to deliver instructor-led synchronous and asynchronous online training, allowing content creation, reuse, search, delivery, and management. Combined with the strengths provided by laparoscopic videos [12], e-learning in surgery is an effective way of breaking time, space, and cost barriers by offering online or blended education alternatives that are potentially more viable and feasible than on-site courses.…”