Fast Part-Based Classification for Instrument Detection in Minimally Invasive Surgery

Abstract

Abstract. Automatic visual detection of instruments in minimally invasive surgery (MIS) can significantly augment the procedure experience for operating clinicians. In this paper, we present a novel technique for detecting surgical instruments by constructing a robust and reliable instrument-part detector. While such detectors are typically slow to use, we introduce a novel early stopping scheme for multiclass ensemble classifiers which acts as a cascade and significantly reduces the computational requirements at test time, ultimately allowing it to run at framerate. We evaluate the effectiveness of our approach on instrument detection in retinal microsurgery and laparoscopic image sequences and demonstrate significant improvements in both accuracy and speed.

See It With Your Own Eyes: Markerless Mobile Augmented Reality for Radiation Awareness in the Hybrid Room

“…In the context of the OR, object detection techniques have been mostly applied to the task of visual detection and tracking of surgical instruments in minimally invasive surgery [21]- [23]. In this paper we tackle a particular problem, which, to our knowledge, has not yet been explored in the community and has many potential applications.…”

Surgical tool tracking by on-line selection of structural correlation filters

“…Additionally, the authors did not use an information about structure of the tool, and hence only a global orientation parameter was used. In some other works the orientation of surgical tool was inexplicitly taken into account, for instance by examing variuous orientations of evaluation window [24].…”

“…EXPERIMENTS We evaluate our tracker on the task of in-vivo tracking of the center of a single instrument in (i) Retinal Microsurgery (dataset with 3 sequences [26]), and (ii) Laparoscopy (dataset with 1 sequence [24]). Both datasets and tool center annotations are publicly available.…”

Online tracking and retargeting with applications to optical biopsy in gastrointestinal endoscopic examinations

“…In surgical vision, detection and tracking have been topics of particular interest, which include both surgical instrument tracking or detection (Sznitman et al, 2012(Sznitman et al, , 2013(Sznitman et al, , 2014Reiter et al, 2014), and tissue tracking (Mountney et al, 2007;Mountney and Yang, 2008;Richa et al, 2011Richa et al, , 2012Giannarou et al, 2013). In this paper, we propose an Online Tracking and Retargeting (OTR) framework for optical biopsy.…”