Hyperspectral imaging for colon cancer classification in surgical specimens: towards optical biopsy during image-guided surgery

Automatic Recognition of Colon and Esophagogastric Cancer with Machine Learning and Hyperspectral Imaging

“…In the broader field of CAD, HSI has been investigated to improve the diagnosis and resection of various types of cancerous lesions. It has been applied to detect gastrointestinal cancer [9][10][11][12][13]13], tongue cancer [14] oral cancer [15], skin tumors [16] breast cancer [17], and brain cancer [18]. All of these approaches use supervised learning, where regions of cancer and healthy tissue are identified in the training dataset and paired with the histopathology analysis.…”

Trends in Deep Learning for Medical Hyperspectral Image Analysis

“…Cell classification using convolutional neural networks in medical hyperspectral imagery [45] Classification Hyperspectral imaging for cancer detection and classification [47] Medical hyperspectral imaging: a review [7] Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging [35] Deep learning based classification for head and neck cancer detection with hyperspectral imaging in an animal model [55] Convolutional neural network for medical hyperspectral image classification with kernel fusion [51] Classification Blood cell classification based on hyperspectral imaging with modulated Gabor and CNN [52] Medical hyperspectral image classification based on end-to-end fusion deep neural network [53] Tissue classification of oncologic esophageal resectates based on hyperspectral data [49] Computer-assisted medical image classification for early diagnosis of oral cancer employing deep learning algorithm [57] Design of a multilayer neural network for the classification of skin ulcers' hyperspectral images: a proof of concept [48] Hyperspectral imaging based method for fast characterization of kidney stone types [46] Design of a multilayer neural network for the classification of skin ulcers' hyperspectral images: a proof of concept [83] Non-invasive skin cancer diagnosis using hyperspectral imaging for in-situ clinical support [50] Hyperspectral imaging for colon cancer classification in surgical specimens: towards optical biopsy during image-guided surgery [84] Deep learning applied to hyperspectral endoscopy for online spectral classification [85] Spectral-spatial recurrent-convolutional networks for in-vivo hyperspectral tumor type classification [56] Blood stain classification with hyperspectral imaging and deep neural networks [54] Hyperspectral imaging for glioblastoma surgery: improving tumor identification using a deep spectral-spatial approach [58] Dual-modality endoscopic probe for tissue surface shape reconstruction and hyperspectral imaging enabled by deep neural networks [62] Detection Probe-based rapid hybrid hyperspectral and tissue surface imaging aided by fully convolutional networks [63] A dual stream network for tumor detection in hyperspectral images [59] Adaptive deep learning for head and neck cancer detection using hyperspectral imaging [67] Detection Hyperspectral imaging of head and neck squamous cell carcinoma for can...…”

“…Hyperspectral system for imaging of skin chromophores and blood oxygenation [79] Other Estimation of tissue oxygen saturation from RGB images and sparse hyperspectral signals based on conditional generative adversarial network [78] Conditional generative adversarial network for synthesizing hyperspectral images of breast cancer cells from digitized histology [81] Generating hyperspectral skin cancer imagery using generative adversarial neural network [82] CNN-based model used for endoscopic image reconstruction to enhance surgical guidance [62] Classifying cancerous tissue samples from neck and head regions using CNN [35] Detection of neck and head cancerous cells via classification using CNN [55] Improvisation of CNN using kernel fusion implemented for cell classification [51] Implementation of CNN for blood cell classification [52] Two-channel CNN for solving limited-samples problem for CNN models [53] Use of CNN to detect squamous cell carcinoma between samples from different patients [65] CNN used for detection of oral cancer [57] Using specular glare in MHSI along with CNN to detect squamous cell carcinoma [66] Another study for CNN to detect squamous cell carcinoma [61] Detection of brain tumor with the aid of CNN [71] CNN Detecting carcinoma thyroid sample with the aid of CNN [60] Different CNN models compared to one another for classifying skin cancer from patient data HIS [72] CNN utilized to classify and detect squamous cell carcinoma [68] CNN used to classify and detect breast cancer cells [70] CNN implemented for detection of Glioblastoma cells from Hematoxylin & Eosin tissue sample [86] In-vivo Laryngeal cancer detection based on CNN [69] Convolutional based RetinaNet model implemented to classify and detect tumors in epithelial tissue [87] Implemented a hybrid CNN model to classify colon tumor in order to aid surgical guidance [84] Five-layer CNN applied to classify endoscopy HSI [85] Study of classification for blood and similar appearing substances from HSI with CNN,RNN, MLP [54] Proposed framework of 3D-2D CNN-based approach to classify brain tumors [58] ANN Implementation of ANN and SVM for cancerous cell HSI <...>…”

Hyperspectral Imaging for Glioblastoma Surgery: Improving Tumor Identification Using a Deep Spectral-Spatial Approach

“…The changes in the cellular morphology and metabolism can be detected as changes in the absorption and reflectance of light within tissue and thus consequentially detected with the HSI camera. HSI in combination with cutting-e.g., machine learning and deep learning algorithms [9][10][11] has been used to detect prostate [12], breast [13,14], colon [11,15], oral, tongue [16][17][18][19][20][21], cervix [22], and skin cancer [23,24]. In this scenario, brain tumors are extremely difficult to identify with the naked eye, because they deeply infiltrate the healthy brain tissue [25].…”

“…Roy et al proposed a fusion of 3D-2D CNN, a so-called Hybrid-SpectraNet (HybridSN), to jointly discriminate the features from both spectral and spatial information [30]. We have previously applied a modified version of the HybridSN, to assess colon cancer margins [15].…”