Development and validation of a classification and scoring system for the diagnosis of oral squamous cell carcinomas through confocal laser endomicroscopy

Oetter

et al. 2017

Sci Rep

Self Cite

232

180

Oral Squamous Cell Carcinoma (OSCC) is a common type of cancer of the oral epithelium. Despite their high impact on mortality, sufficient screening methods for early diagnosis of OSCC often lack accuracy and thus OSCCs are mostly diagnosed at a late stage. Early detection and accurate outline estimation of OSCCs would lead to a better curative outcome and a reduction in recurrence rates after surgical treatment. Confocal Laser Endomicroscopy (CLE) records sub-surface micro-anatomical images for in vivo cell structure analysis. Recent CLE studies showed great prospects for a reliable, real-time ultrastructural imaging of OSCC in situ. We present and evaluate a novel automatic approach for OSCC diagnosis using deep learning technologies on CLE images. The method is compared against textural feature-based machine learning approaches that represent the current state of the art. For this work, CLE image sequences (7894 images) from patients diagnosed with OSCC were obtained from 4 specific locations in the oral cavity, including the OSCC lesion. The present approach is found to outperform the state of the art in CLE image recognition with an area under the curve (AUC) of 0.96 and a mean accuracy of 88.3% (sensitivity 86.6%, specificity 90%).

Section: Discussionmentioning

confidence: 95%

Section: Introductionmentioning

confidence: 99%

Automatic Classification of Cancerous Tissue in Laserendomicroscopy Images of the Oral Cavity using Deep Learning

Oetter

et al. 2017

Sci Rep

Self Cite

232

180

“…It is questionable, if an 100% accurate classification of epithelial tissue is possible using CLE alone, as even experts in the field of CLE were not able to classify cancerous tissue perfectly (Goncalves et al, 2017;Oetter et al, 2016). Due to the low penetration depth of CLE, it is sometimes possible to overlook tumors that spread within the submucosa.…”

Section: Discussionmentioning

confidence: 99%

“…In this imaging method, laser light is emitted and applied on tissue using a fibre-optic bundle that is typically inserted through the accessory channel of an endoscope (Chauhan et al, 2014). The resolution of CLE is high, providing magnifications of up to 1000x (Oetter et al, 2016) and enabling sub-cellular imaging. A contrast agent (fluorescein) is applied intravenously prior to the examination in order to stain the intercellular gap and hence outline the cell borders.…”

Section: Introductionmentioning

confidence: 99%

Patch-based Carcinoma Detection on Confocal Laser Endomicroscopy Images - A Cross-site Robustness Assessment

Goncalves

Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies

et al. 2018

Self Cite

Deep learning technologies such as convolutional neural networks (CNN) provide powerful methods for image recognition and have recently been employed in the field of automated carcinoma detection in confocal laser endomicroscopy (CLE) images. CLE is a (sub-)surface microscopic imaging technique that reaches magnifications of up to 1000x and is thus suitable for in vivo structural tissue analysis. In this work, we aim to evaluate the prospects of a priorly developed deep learning-based algorithm targeted at the identification of oral squamous cell carcinoma with regard to its generalization to further anatomic locations of squamous cell carcinomas in the area of head and neck. We applied the algorithm on images acquired from the vocal fold area of five patients with histologically verified squamous cell carcinoma and presumably healthy control images of the clinically normal contra-lateral vocal cord. We find that the network trained on the oral cavity data reaches an accuracy of 89.45% and an area-underthe-curve (AUC) value of 0.955, when applied on the vocal cords data. Compared to the state of the art, we achieve very similar results, yet with an algorithm that was trained on a completely disjunct data set. Concatenating both data sets yielded further improvements in cross-validation with an accuracy of 90.81% and AUC of 0.970. In this study, for the first time to our knowledge, a deep learning mechanism for the identification of oral carcinomas using CLE Images could be applied to other disciplines in the area of head and neck. This study shows the prospect of the algorithmic approach to generalize well on other malignant entities of the head and neck, regardless of the anatomical location and furthermore in an examiner-independent manner.

“…6 It was reported, that probe-based CLE (pCLE) can also successfully be used for assessment of malignancy of SCC of the vocal folds 8,10 as well as in epithelium of the oral cavity. 7 However, it is also known that interpretation of CLE images requires significant training. 11 An automatic interpretation and classification of CLE images could thus help to spread this non-invasive method in screening more widely, and also improve identifying the exact location of tumor (margins) in pre-or intra-operative use.…”

Section: Introductionmentioning

confidence: 99%

Transferability of Deep Learning Algorithms for Malignancy Detection in Confocal Laser Endomicroscopy Images from Different Anatomical Locations of the Upper Gastrointestinal Tract

Goncalves

Biomedical Engineering Systems and Technologies

et al. 2019

Self Cite

Squamous Cell Carcinoma (SCC) is the most common cancer type of the epithelium and is often detected at a late stage. Besides invasive diagnosis of SCC by means of biopsy and histo-pathologic assessment, Confocal Laser Endomicroscopy (CLE) has emerged as noninvasive method that was successfully used to diagnose SCC in vivo. For interpretation of CLE images, however, extensive training is required, which limits its applicability and use in clinical practice of the method.To aid diagnosis of SCC in a broader scope, automatic detection methods have been proposed. This work compares two methods with regard to their applicability in a transfer learning sense, i.e. training on one tissue type (from one clinical team) and applying the learnt classification system to another entity (different anatomy, different clinical team). Besides a previously proposed, patch-based method based on convolutional neural networks, a novel classification method on image level (based on a pre-trained Inception V.3 network with dedicated preprocessing and interpretation of class activation maps) is proposed and evaluated.The newly presented approach improves recognition performance, yielding accuracies of 91.63% on the first data set (oral cavity) and 92.63% on a joint data set. The generalization from oral cavity to the second data set (vocal folds) lead to similar area-under-the-ROC curve values than a direct training on the vocal folds data set, indicating good generalization.