International challenges have become the de facto standard for comparative assessment of image analysis algorithms. Although segmentation is the most widely investigated medical image processing task, the various challenges have been organized to focus only on specific clinical tasks. We organized the Medical Segmentation Decathlon (MSD)—a biomedical image analysis challenge, in which algorithms compete in a multitude of both tasks and modalities to investigate the hypothesis that a method capable of performing well on multiple tasks will generalize well to a previously unseen task and potentially outperform a custom-designed solution. MSD results confirmed this hypothesis, moreover, MSD winner continued generalizing well to a wide range of other clinical problems for the next two years. Three main conclusions can be drawn from this study: (1) state-of-the-art image segmentation algorithms generalize well when retrained on unseen tasks; (2) consistent algorithmic performance across multiple tasks is a strong surrogate of algorithmic generalizability; (3) the training of accurate AI segmentation models is now commoditized to scientists that are not versed in AI model training.

A robust lung segmentation method using a deep convolutional neural network (CNN) was developed and evaluated on highresolution computed tomography (HRCT) and volumetric CT of various types of diffuse interstitial lung disease (DILD). Chest CT images of 617 patients with various types of DILD, including cryptogenic organizing pneumonia (COP), usual interstitial pneumonia (UIP), and nonspecific interstitial pneumonia (NSIP), were scanned using HRCT (1-2-mm slices, 5-10-mm intervals) and volumetric CT (sub-millimeter thickness without intervals). Each scan was segmented using a conventional image processing method and then manually corrected by an expert thoracic radiologist to create gold standards. The lung regions in the HRCT images were then segmented using a two-dimensional U-Net architecture with the deep CNN, using separate training, validation, and test sets. In addition, 30 independent volumetric CT images of UIP patients were used to further evaluate the model. The segmentation results for both conventional and deep-learning methods were compared quantitatively with the gold standards using four accuracy metrics: the Dice similarity coefficient (DSC), Jaccard similarity coefficient (JSC), mean surface distance (MSD), and Hausdorff surface distance (HSD). The mean and standard deviation values of those metrics for the HRCT images were 98.84 ± 0.55%, 97.79 ± 1.07%, 0.27 ± 0.18 mm, and 25.47 ± 13.63 mm, respectively. Our deep-learning method showed significantly better segmentation performance (p < 0.001), and its segmentation accuracies for volumetric CT were similar to those for HRCT. We have developed an accurate and robust U-Net-based DILD lung segmentation method that can be used for patients scanned with different clinical protocols, including HRCT and volumetric CT.

Lung lobe segmentation in chest CT has been used for the analysis of lung functions and surgical planning. However, accurate lobe segmentation is difficult as 80% of patients have incomplete and/or fake fissures. Furthermore, lung diseases such as chronic obstructive pulmonary disease (COPD) can increase the difficulty of differentiating the lobar fissures. Lobar fissures have similar intensities to those of the vessels and airway wall, which could lead to segmentation error in automated segmentation. In this study, a fully automated lung lobe segmentation method with 3D U-Net was developed and validated with internal and external datasets. The volumetric chest CT scans of 196 normal and mild-to-moderate COPD patients from three centers were obtained. Each scan was segmented using a conventional image processing method and manually corrected by an expert thoracic radiologist to create gold standards. The lobe regions in the CT images were then segmented using a 3D U-Net architecture with a deep convolutional neural network (CNN) using separate training, validation, and test datasets. In addition, 40 independent external CT images were used to evaluate the model. The segmentation results for both the conventional and deep learning methods were compared quantitatively to the gold standards using four accuracy metrics including the Dice similarity coefficient (DSC), Jaccard similarity coefficient (JSC), mean surface distance (MSD), and Hausdorff surface distance (HSD). In internal validation, the segmentation method achieved high accuracy for the DSC, JSC, MSD, and HSD (0.97 ± 0.02, 0.94 ± 0.03, 0.69 ± 0.36, and 17.12 ± 11.07, respectively). In external validation, high accuracy was also obtained for the DSC, JSC, MSD, and HSD (0.96 ± 0.02, 0.92 ± 0.04, 1.31 ± 0.56, and 27.89 ± 7.50, respectively). This method took 6.49 ± 1.19 s and 8.61 ± 1.08 s for lobe segmentation of the left and right lungs, respectively. Although various automatic lung lobe segmentation methods have been developed, it is difficult to develop a robust segmentation method. However, the deep learning-based 3D U-Net method showed reasonable segmentation accuracy and computational time. In addition, this method could be adapted and applied to severe lung diseases in a clinical workflow.