An automatic nuclei segmentation method based on deep convolutional neural networks for histopathology images

Abstract

Background: Since nuclei segmentation in histopathology images can provide key information for identifying the presence or stage of a disease, the images need to be assessed carefully. However, color variation in histopathology images, and various structures of nuclei are two major obstacles in accurately segmenting and analyzing histopathology images. Several machine learning methods heavily rely on hand-crafted features which have limitations due to manual thresholding. Results: To obtain robust results, deep learning based methods have been proposed. Deep convolutional neural networks (DCNN) used for automatically extracting features from raw image data have been proven to achieve great performance. Inspired by such achievements, we propose a nuclei segmentation method based on DCNNs. To normalize the color of histopathology images, we use a deep convolutional Gaussian mixture color normalization model which is able to cluster pixels while considering the structures of nuclei. To segment nuclei, we use Mask R-CNN which achieves state-of-the-art object segmentation performance in the field of computer vision. In addition, we perform multiple inference as a post-processing step to boost segmentation performance. We evaluate our segmentation method on two different datasets. The first dataset consists of histopathology images of various organ while the other consists histopathology images of the same organ. Performance of our segmentation method is measured in various experimental setups at the object-level and the pixel-level. In addition, we compare the performance of our method with that of existing state-of-the-art methods. The experimental results show that our nuclei segmentation method outperforms the existing methods. Conclusions: We propose a nuclei segmentation method based on DCNNs for histopathology images. The proposed method which uses Mask R-CNN with color normalization and multiple inference post-processing provides robust nuclei segmentation results. Our method also can facilitate downstream nuclei morphological analyses as it provides high-quality features extracted from histopathology images.

Clearing spheroids for 3D fluorescent microscopy: combining safe and soft chemicals with deep convolutional neural network

“…Also, a specific interest of the deep learning-based approach, by contrast with a standard image processing pipeline composed of denoising step [31] followed by a segmentation step [32,33], is to offer an end-to-end learning process where all the pipeline is optimized at the same time. Several architectures were developed to segment nuclei by integrating two or more channels in the output of deep learning architecture or by applying post processing methods to the predicted segmentation maps to enhance segmentation quality [34][35][36][37][38][39][40]. Deep learning methods were applied to segment entire spheroids of different sizes, shapes, and illumination conditions [41] and also to segment nuclei of 3D spheroid images [42].…”

Machine Learning Algorithms, Applied to Intact Islets of Langerhans, Demonstrate Significantly Enhanced Insulin Staining at the Capillary Interface of Human Pancreatic β Cells

“…Deep learning methods have demonstrated success at the cellular level in segmentation applications of a range of cell types, including bacteria and mammalian cells from phase contrast images [17], HeLa cells from DIC microscopy images [18], neuronal membranes in electron microscopy images [19], yeast cells [6], and circulating tumour cells [20]. At the subcellular level, deep learning algorithms have also precisely segmented the nuclei and cytoplasm in fibroblasts, HeLa, HepG2 cells [2,21,22].…”

Location and identification of oak wood defect by deep learning

“…Segmentation techniques are widely used in medicine, where, due to the benefits of segmentation, human cells are studied, and it is possible to identify harmful cells or cancer [5]. Another industry where segmentation techniques are beneficial, is mechanical engineering [6].…”