Learning-based classification of informative laryngoscopic frames

Abstract

Background and Objective Early-stage diagnosis of laryngeal cancer is of primary importance to reduce patient morbidity. Narrow-band imaging (NBI) endoscopy is commonly used for screening purposes, reducing the risks linked to a biopsy but at the cost of some drawbacks, such as large amount of data to review to make the diagnosis. The purpose of this paper is to present a strategy to perform automatic selection of informative endoscopic video frames, which can reduce the amount of data to process and potentially increase diagnosis performance. Methods A new method to classify NBI endoscopic frames based on intensity, keypoint and image spatial content features is proposed. Support vector machines with the radial basis function and the one-versus-one scheme are used to classify frames as informative, blurred, with saliva or specular reflections, or underexposed. Results When Email address: sara.moccia@iit.it, sara.moccia@polimi.it (Sara Moccia) Preprint submitted to Computer Methods and Programs in Biomedicine February 9, 2018tested on a balanced set of 720 images from 18 different laryngoscopic videos, a classification recall of 91% was achieved for informative frames, significantly overcoming three state of the art methods (Wilcoxon rank-signed test, significance level = 0.05). Conclusions Due to the high performance in identifying informative frames, the approach is a valuable tool to perform informative frame selection, which can be potentially applied in different fields, such us computer-assisted diagnosis and endoscopic view expansion.

Machine learning based identification of relevant parameters for functional voice disorders derived from endoscopic high-speed recordings

“…In recent years machine learning based approaches have grown in popularity in voice research [25][26][27] . Machine learning was also used in combination with parameters to separate healthy from disordered voices [28][29][30] .…”

Toward Improving Safety in Neurosurgery with an Active Handheld Instrument

“…As deep-learning models work (at least if considering the layers at the top of the network architectures) as edge detectors, vessel segmentation may not be accurate in case of image blurring. Therefore, to avoid the processing of blurred frames, frame-selection strategies, such as the one proposed in [45], should be integrated. This way, the processing of uninformative frames, in which vessels are not clearly visible, would be avoided.…”

A Review on Advances in Intra-operative Imaging for Surgery and Therapy: Imagining the Operating Room of the Future

“…Anatomical structures, as well as surgical tools, can be automatically identified (segmented) or tracked over time to provide surgeons with decision support and context awareness. Exemplary applications include vertebrae [201] segmentation on fluoroscopy images, tissues and surgical tools tracking [202] in 3D US, vessel segmentation [203], organ segmentation and tumor margin assessment in laparoscopic imaging [204,205,206], surgical tool detection in video la- paroscopy [207], cancerous tissue [208] and organs at risk [209,210,211], panorama stitching to enlarge the field of view [212], surface reconstruction in plastic surgery [213], identification in planning radiotherapy CT, brachitherapy [214] and biopsy [81] needles segmentation in iMRI, and pyramidal tract reconstruction [215]. -Physiological parameter estimation: medical images have been used also to esteem some physical and physiological parameters not directly measurable.…”