Computer vision in surgery: from potential to clinical value

Abstract

Hundreds of millions of operations are performed worldwide each year, and the rising uptake in minimally invasive surgery has enabled fiber optic cameras and robots to become both important tools to conduct surgery and sensors from which to capture information about surgery. Computer vision (CV), the application of algorithms to analyze and interpret visual data, has become a critical technology through which to study the intraoperative phase of care with the goals of augmenting surgeons’ decision-making processes, supporting safer surgery, and expanding access to surgical care. While much work has been performed on potential use cases, there are currently no CV tools widely used for diagnostic or therapeutic applications in surgery. Using laparoscopic cholecystectomy as an example, we reviewed current CV techniques that have been applied to minimally invasive surgery and their clinical applications. Finally, we discuss the challenges and obstacles that remain to be overcome for broader implementation and adoption of CV in surgery.

Artificial Intelligence for context-aware surgical guidance in complex robot-assisted oncological procedures: An exploratory feasibility study

“…For instance, algorithms for identification of seminal vesicles and the small intestine were trained on comparably small datasets of 336 and 104 annotated images, respectively (Appendix D), while over 1000 annotated images were used to train models in the aforementioned work. Integration of more and diverse – ideally multicentric – training data would likely improve segmentation performance and increase clinical relevance of respective models [34]. One of the main reasons for scarcity of annotated laparoscopic datasets is the high annotation effort required for an integration of clinically meaningful knowledge into a dataset [35].…”

Novel Application of Real-Time Editable 3D-reconstructed Imaging in a Mixed-Reality Holographic Overlay Using a Video Pass-through Head-Mounted Display – A Pathway to future Navigation in Thoracic Surgery?

“…6 Additionally, intelligent image processing software providing autonomous segmentation and classification, increasingly implemented in mixed reality environments, could show to become highly beneficial for the development of image-guided visual navigation in a broad spectrum of surgical fields. 7…”

The Use of Artificial Intelligence Tools to Prepare Medical School Applications

“…7 Medical AI tools have since evolved to incorporate more complex methods, such as deep learning, that have yielded automated preliminary reads in diagnostic radiology and pathology as well as advanced surgical guidance systems. 8,9…”