Deep and Hybrid Learning Technique for Early Detection of Tuberculosis Based on X-ray Images Using Feature Fusion

Abstract

Tuberculosis (TB) is a fatal disease in developing countries, with the infection spreading through direct contact or the air. Despite its seriousness, the early detection of tuberculosis by means of reliable techniques can save the patients’ lives. A chest X-ray is a recommended screening technique for locating pulmonary abnormalities. However, analyzing the X-ray images to detect abnormalities requires highly experienced radiologists. Therefore, artificial intelligence techniques come into play to help radiologists to perform an accurate diagnosis at the early stages of TB disease. Hence, this study focuses on applying two AI techniques, CNN and ANN. Furthermore, this study proposes two different approaches with two systems each to diagnose tuberculosis from two datasets. The first approach hybridizes two CNN models, which are Res-Net-50 and GoogLeNet techniques. Prior to the classification stage, the approach applies the principal component analysis (PCA) algorithm to reduce the features’ dimensionality, aiming to extract the deep features. Then, the SVM algorithm is used for classifying features with high accuracy. This hybrid approach achieved superior results in diagnosing tuberculosis based on X-ray images from both datasets. In contrast, the second approach applies artificial neural networks (ANN) based on the fused features extracted by ResNet-50 and GoogleNet models and combines them with the features extracted by the gray level co-occurrence matrix (GLCM), discrete wavelet transform (DWT) and local binary pattern (LBP) algorithms. ANN achieved superior results for the two tuberculosis datasets. When using the first dataset, the ANN, with ResNet-50, GLCM, DWT and LBP features, achieved an accuracy of 99.2%, a sensitivity of 99.23%, a specificity of 99.41%, and an AUC of 99.78%. Meanwhile, with the second dataset, ANN, with the features of ResNet-50, GLCM, DWT and LBP, reached an accuracy of 99.8%, a sensitivity of 99.54%, a specificity of 99.68%, and an AUC of 99.82%. Thus, the proposed methods help doctors and radiologists to diagnose tuberculosis early and increase chances of survival.

Early Diagnosis of Oral Squamous Cell Carcinoma Based on Histopathological Images Using Deep and Hybrid Learning Approaches

“…Moreover, CNN models require a huge data set during the training phase to obtain promising results and prevent overfitting problems. Therefore, the data set does not contain a sufficient number of images to train the data set and is somewhat balanced; despite the number of images in the data set classes being close, the data augmentation technique was applied for two purposes: First, to increase the histological images of the data set during the training phase to overcome overfitting problems [ 36 ]. Second, to address the issue of imbalance of the data set by increasing the histological images of the minority classes more than the classes of the majority.…”

AI Techniques of Dermoscopy Image Analysis for the Early Detection of Skin Lesions Based on Combined CNN Features

“…CNNs consist of many convolutional and pooling layers ending in a series of fully connected layers. The convolutional layers receive an image of size m × n × z , where m and n are the width and height of the image and z is the number of color channels [ 34 ]. The number of convolutional layers differs from one network to another, and each convolutional layer usually consists of many filters of size f × f × z .…”

Hybrid Techniques for the Diagnosis of Acute Lymphoblastic Leukemia Based on Fusion of CNN Features

“…External energy is the combination of energy that controls the circumference of WBC cells within the image. Internal energy controls deformable changes [ 36 ]. where I refers to gray intensity, outside and inside refer to the regions outside and inside the contour C , m 1 and m 2 refer to mean intensity, outside and inside respectively, β refers to parameter, and length ( C ) refers to the length of contour C .…”