Development and validation of bone-suppressed deep learning classification of COVID-19 presentation in chest radiographs

Background Apart from invasive pathological examination, there is no effective method to differentiate breast diffuse large B-cell lymphoma (DLBCL) from breast invasive ductal carcinoma (IDC). In this study, we aimed to develop and validate an effective deep learning radiomics model to discriminate between DLBCL and IDC. Methods A total of 324 breast nodules from 236 patients with baseline 18 F-fluorodeoxyglucose ( 18 F-FDG) positron emission tomography/computed tomography (PET/CT) were retrospectively analyzed. After grouping breast DLBCL and breast IDC patients, external and internal datasets were divided according to the data collected by different centers. Preprocessing was then used to process the original PET/CT images and an attention-based aggregate convolutional neural network (AACNN) model was designed. The AACNN model was trained using patches of CT or PET tumor images and optimized with an improved loss function. The final ensemble predictive model was built using distance weight voting. Finally, the model performance was evaluated and statistically verified. Results A total of 249 breast nodules from Fudan University Shanghai Cancer Center (FUSCC) and 75 breast nodules from Shanghai Proton and Heavy Ion Center (SPHIC) were selected as internal and external datasets, respectively. On the internal testing, our method yielded an area under the curve (AUC), accuracy (ACC), sensitivity (SEN), specificity (SPE), positive predictive value (PPV), negative predictive value (NPV), and harmonic mean of precision and sensitivity (F1) of 0.886, 83.0%, 80.9%, 85.0%, 84.8%, 81.2%, and 0.828, respectively. Meanwhile on the external testing, the results were 0.788, 71.6%, 61.4%, 84.7%, 84.0%, 62.6%, and 0.709, respectively. Conclusions Our study outlines a deep learning radiomics method which can automatically, noninvasively, and accurately differentiate breast DLBCL from breast IDC, which will be more in line with the needs and strategies of precision medicine, individualized diagnosis, and treatment.

Section: Discussionmentioning

confidence: 99%

End-to-end deep learning radiomics: development and validation of a novel attention-based aggregate convolutional neural network to distinguish breast diffuse large B-cell lymphoma from breast invasive ductal carcinoma

Chen,

Liu,

Wang

et al. 2023

“…For the COVID-19 classification of chest radiograph images, most research is based on modifications to classification models to improve COVID-19 detection accuracy. The categories can be divided into binary and multiple classification tasks (11)(12)(13). For binary classification task, it is mainly based on the discrimination between COVID-19 and normal or the COVID-19 and other pneumonias.…”

Section: Introductionmentioning

confidence: 99%

Deep learning attention-guided radiomics for COVID-19 chest radiograph classification

Yang¹,

Ren²,

Ni³

et al. 2023

Self Cite

Background: Accurate assessment of coronavirus disease 2019 (COVID-19) lung involvement through chest radiograph plays an important role in effective management of the infection. This study aims to develop a two-step feature merging method to integrate image features from deep learning and radiomics to differentiate COVID-19, non-COVID-19 pneumonia and normal chest radiographs (CXR).Methods: In this study, a deformable convolutional neural network (deformable CNN) was developed and used as a feature extractor to obtain 1,024-dimensional deep learning latent representation (DLR) features.Then 1,069-dimensional radiomics features were extracted from the region of interest (ROI) guided by deformable CNN's attention. The two feature sets were concatenated to generate a merged feature set for classification. For comparative experiments, the same process has been applied to the DLR-only feature set for verifying the effectiveness of feature concatenation.Results: Using the merged feature set resulted in an overall average accuracy of 91.0% for three-class classification, representing a statistically significant improvement of 0.6% compared to the DLR-only classification. The recall and precision of classification into the COVID-19 class were 0.926 and 0.976, respectively. The feature merging method was shown to significantly improve the classification performance as compared to using only deep learning features, regardless of choice of classifier (P value <0.0001). Three classes' F1-score were 0.892, 0.890, and 0.950 correspondingly (i.e., normal, non-COVID-19 pneumonia, COVID-19).Conclusions: A two-step COVID-19 classification framework integrating information from both DLR and radiomics features (guided by deep learning attention mechanism) has been developed. The proposed feature merging method has been shown to improve the performance of chest radiograph classification as compared to the case of using only deep learning features.

“…Software-based methods use image processing technology to suppress bone signals. The various algorithms are categorized as traditional machine learning and deep learning methods (16)(17)(18)(19)(20). The more commonly used machine learning bone signal suppression methods include artificial neural networks (21)(22)(23), K-nearest neighbor regression (24), principal component analysis (PCA) (25), and segmentation-based unsupervised methods (26,27).…”

Section: Introductionmentioning

confidence: 99%

Artificial intelligence-assisted multistrategy image enhancement of chest X-rays for COVID-19 classification

Sun¹,

Ren²,

Teng³

et al. 2023

Background: The coronavirus disease 2019 (COVID-19) led to a dramatic increase in the number of cases of patients with pneumonia worldwide. In this study, we aimed to develop an AI-assisted multistrategy image enhancement technique for chest X-ray (CXR) images to improve the accuracy of COVID-19 classification. Methods: Our new classification strategy consisted of 3 parts. First, the improved U-Net model with a variational encoder segmented the lung region in the CXR images processed by histogram equalization. Second, the residual net (ResNet) model with multidilated-rate convolution layers was used to suppress the bone signals in the 217 lung-only CXR images. A total of 80% of the available data were allocated for training and validation. The other 20% of the remaining data were used for testing. The enhanced CXR images containing only soft tissue information were obtained. Third, the neural network model with a residual cascade was used for the super-resolution reconstruction of low-resolution bone-suppressed CXR images. The training and testing data consisted of 1,200 and 100 CXR images, respectively. To evaluate the new strategy, improved visual geometry group (VGG)-16 and ResNet-18 models were used for the COVID-19 classification task of 2,767 CXR images. The accuracy of the multistrategy enhanced CXR images was verified through comparative experiments with various enhancement images. In terms of quantitative verification, 8-fold cross-validation was performed on the bone suppression model. In terms of evaluating the COVID-19 classification, the CXR images obtained by the improved method were used to train 2 classification models.Results: Compared with other methods, the CXR images obtained based on the proposed model had better performance in the metrics of peak signal-to-noise ratio and root mean square error. The super-resolution CXR images of bone suppression obtained based on the neural network model were also anatomically close to the real CXR images. Compared with the initial CXR images, the classification accuracy rates of the internal and external testing data on the VGG-16 model increased by 5.09% and 12.81%, respectively, while the values increased by 3.51% and 18.20%, respectively, for the ResNet-18 model. The numerical results were better than those of the single-enhancement, double-enhancement, and no-enhancement CXR images. Conclusions:The multistrategy enhanced CXR images can help to classify COVID-19 more accurately than the other existing methods.