Artificial intelligence in clinical endoscopy: Insights in the field of videomics

Abstract

Artificial intelligence is being increasingly seen as a useful tool in medicine. Specifically, these technologies have the objective to extract insights from complex datasets that cannot easily be analyzed by conventional statistical methods. While promising results have been obtained for various -omics datasets, radiological images, and histopathologic slides, analysis of videoendoscopic frames still represents a major challenge. In this context, videomics represents a burgeoning field wherein several methods of computer vision are systematically used to organize unstructured data from frames obtained during diagnostic videoendoscopy. Recent studies have focused on five broad tasks with increasing complexity: quality assessment of endoscopic images, classification of pathologic and nonpathologic frames, detection of lesions inside frames, segmentation of pathologic lesions, and in-depth characterization of neoplastic lesions. Herein, we present a broad overview of the field, with a focus on conceptual key points and future perspectives.

Video-Assisted Cleft Palate Surgery: Preclinical Comparison Between Endoscope- and Exoscope-Based Approaches

“…16, 17 Finally, 4k digital images provided by both systems could offer potential advantages in terms of analyzing large data set using artificial intelligence, a field still limitedly explored in Head and Neck surgery. 18…”

Intraoperative Imaging Techniques to Improve Surgical Resection Margins of Oropharyngeal Squamous Cell Cancer: A Comprehensive Review of Current Literature

“…Use of AI technology has been established for differentiating between benign and malignant polyps in colonoscopies [66]. The technology shows promising potential for future use in the oral cavity and oropharynx [67,68]. NBI does have its limitations: it is only suitable for determining superficial margins as its two bandwidths are absorbed by the hemoglobin in the superficial layers of the mucosa, thus the penetration of the NBI light (however greater than that demonstrated by WL) is limited to the upper layers of the epithelium and mucosa (180-250 µm) due to the soft tissue absorption phenomenon [69].…”

Deep learning in endoscopia: l’importanza della standardizzazione

“…In recent years, there has been an explosion of interest in the use of deep learning (DL) for medical image analysis. Different DL architectures have been proposed to address a variety of tasks, including image classification, object detection, segmentation and characterisation 1 . These advancements have led to significant progress in assisting clinicians in the evaluation of endoscopic frames, giving birth to a field of artificial intelligence-associated applications called “videomics” 2 .…”