You are viewing a javascript disabled version of the site. Please enable Javascript for this site to function properly.
Go to headerGo to navigationGo to searchGo to contentsGo to footer
In content section. Select this link to jump to navigation

Computer aid screening of COVID-19 using X-ray and CT scan images: An inner comparison

Abstract

The objective of this study is to conduct a critical analysis to investigate and compare a group of computer aid screening methods of COVID-19 using chest X-ray images and computed tomography (CT) images. The computer aid screening method includes deep feature extraction, transfer learning, and machine learning image classification approach. The deep feature extraction and transfer learning method considered 13 pre-trained CNN models. The machine learning approach includes three sets of handcrafted features and three classifiers. The pre-trained CNN models include AlexNet, GoogleNet, VGG16, VGG19, Densenet201, Resnet18, Resnet50, Resnet101, Inceptionv3, Inceptionresnetv2, Xception, MobileNetv2 and ShuffleNet. The handcrafted features are GLCM, LBP & HOG, and machine learning based classifiers are KNN, SVM & Naive Bayes. In addition, the different paradigms of classifiers are also analyzed. Overall, the comparative analysis is carried out in 65 classification models, i.e., 13 in deep feature extraction, 13 in transfer learning, and 39 in the machine learning approaches. Finally, all classification models perform better when applying to the chest X-ray image set as comparing to the use of CT scan image set. Among 65 classification models, the VGG19 with SVM achieved the highest accuracy of 99.81%when applying to the chest X-ray images. In conclusion, the findings of this analysis study are beneficial for the researchers who are working towards designing computer aid tools for screening COVID-19 infection diseases.

1Introduction

The COVID-19 is a deadly acute disease caused by SARS-Cov-2 coronavirus and was first reported in Wuhan province, China, in December 2019. COVID-19 outbreaks continue to spread worldwide, with over 18.6 million people across 200 countries [1]. “At present COVID-19 pandemic is the most pressing issue confronting our whole world due to its massive negative impact on public health [2].” Although governments and rulers imposing various new schemes, policies and created new lifestyles to combat COVID-19. Science and technology have a major contribution in implementing these new schemes and policies [3].

On the other hand, recently, artificial intelligence and computer-aided screening have been widely adopted and successfully applied to accelerate biomedical research and development [4]. Machine learning, deep learning, and transfer learning have been used in many applications, including data classification [5] and image detection and segmentation [6]. There exist numerous open online databases, including chest X-Ray and CT scan datasets. Various studies have recently pointed out that X-Ray and CT scan images play an essential evaluation in screening and diagnosing COVID- 19 infection. The epidemic of Coronavirus Disease 2019 (COVID-19) has recently spread widely around the globe. Owing to a vast number of infected patients and extensive medical practice, computer-aided diagnostics with modern algorithms such as Image Processing, Machine Learning, Deep Learning, and Transfer Learning are required and could significantly reduce clinicians’ efforts and enhance the diagnostic process. X-ray and CT scans have been used as insightful tools for the diagnosis of various disorders. Various studies have recently pointed out that X-Ray and CT images play an essential evaluation in screening and diagnosing COVID-19 infection.

Using X-ray images, a deep learning-based methodology is proposed for detecting COVID-19 infected patients. In the study, the classification model “Resnet50 plus SVM” has shown impressive results, i.e., accuracy (95.38%), FPR (95.52), F1 score 91.41%, and MCC & Kappa are 90.76%[7].” Similarly, for the detection of coronavirus pneumonia infected patient, CNN based models are suggested including Resnet50, Resnet101, Resnet152, InceptionV3, and Inception-ResNetV2 [8].” Among which Resnet50 model provides the highest accuracy of 99.5%. Based on deep Bayes-SqueezeNet, one study [9] proposed a methodology for diagnosing coronavirus disease 2019 with the support of chest X-Ray radiographs. The SqueezeNet is tuned with the lightest network along with a Bayesian optimization additive. Using the DarkNet model, another study [10] had presented 17 Convolutional layers for evaluating binary classification, i.e., COVID vs. No-finding and multi-class classification, i.e., COVID vs. No-findings vs. Pneumonia. The highest accuracy obtained was for binary classification of 98.08%in the study, whereas it was about 87.07%for multi-class classification.

Based on the performance of CT scans, study [11] had suggested that CT was also a good method for diagnosis and management of COVID-19. For optimize management and rapid diagnosis of COVID-19, the chest CT scans had a low missed diagnosis of COVID-19, i.e., 3.9%and 2/51, which may be useful as a standard method. Again, a deep learning model was proposed to segment and quantify the infected lungs with the support of CT scans [12]. The study included 549 CT images and the Dice similarity 2 coefficient concept was adopted and obtained 91.6%. Also, mentioned that delineation time is reduced by about four times. The innovative frequency domain algorithm (FFT)-Gabor was suggested by [13] for the digital test of COVID-19 patients using CT scan images with machine learning. The results obtained in the study were quite promising with 95.37%accuracy along with sensitivity and specificity of 95.99%and 94.76%, respectively. According to the study, FFT-Gabor supports the visual examination as well as in the final diagnostic.

The National Cancer Institute conducted a National Lung Screening Trial (NLST) and reported that X-Ray imaging is better than CT scan images for the screening of any lung-related diseases [14]. “X-rays or scans produce an image of the organs and structures (heart, lungs, and airways) in the chest. They can detect blockages, inflammation, and excess fluid. X-rays (radiography) use a small amount of radiation to produce a 2-D image. They are usually carried out in hospitals using fixed equipment by a radiographer but may also be carried out using a portable machine. Computed tomography (CT) scans use a computer to merge multiple X-ray images from different angles to produce a 2-D image converted to a 3-D image. They require highly specialized equipment and are carried out in the hospital by a specialist radiographer [14].” Again, the operational setting variability is more in the CT scan machine than the X-ray machines. So, there are chances of more variations of CT scan images than the X-Ray images. In addition, computer diagnosis in any learning method takes 2-D images as its input. But the CT scan is a 3-D image. When it converts to 2-D slices, there is a chance of loss of information. “Also, according to COCHRANE, chest CT correctly identified an infection in 93%of people with confirmed COVID-19 but incorrectly identified infections in 82%of people who were not infected with COVID-19 (suspected) [15]. This finding indicates that chest CT is sensitive but not specific for the diagnosis of COVID-19 in suspected patients, meaning that CT may not be capable of differentiating SARS-CoV-2 infection from other causes of respiratory illness [15].” Further, because of large scale data availability, easy X-Ray imaging, low cost, widely available X-Ray imaging machines, and significantly less variability within X-Ray images, the X-Ray image is preferable to use computer aid diagnosis towards screening of COVID-19.

As still there are many confusions towards the contribution of X-ray and CT scan images for the screening of COVID-19 based on computer aid tools, we are motivated to do a comparative study. The main objective of this article is to provide a comparative analysis of various models of machine learning, deep learning, and transfer learning used for screening of COVID-19 using X-Ray and CT scan images. This comparative analysis provides a complete remark about the contribution of X-ray and CT scan images towards the screening of COVID-19 based on computer aid diagnosis. The remaining of the article is as follows. Section 2 describes the data samples with their resources. The methodology is presented in section 3. Section 4 offers experimental outcomes. The contribution of this research is discussed in section 5. Finally, section 6 concludes the article.

2Image data

To build a consistent and robust model, it is essential to ensure the same number of samples while considering all the cases for each class. For this study, we have used the chest X-ray and CT scan image available in Github [16] and Kaggle repository [17]. The publicly accessible database comprises X-Ray and CT scans for both the class, i.e., Non-COVID-19 images and COVID-19 infected images. Figure 1 illustrated the COVID-19 and non-COVID-19 X-ray and CT scan images. The image samples involved in this comparative analysis are detailed in Table 1.

Fig. 1

Medical image samples (a) COVID-19 X-ray (b) Non-COVID-19 X-ray (c) COVID-19 CT Scan (d) Non-COVID-19 CT Scan.

Medical image samples (a) COVID-19 X-ray (b) Non-COVID-19 X-ray (c) COVID-19 CT Scan (d) Non-COVID-19 CT Scan.
Table 1

The distribution of study samples

DatasetClassNo. of samples
X-RayCOVID-19350
Non-COVID-19350
CT ScanCOVID-19350
Non-COVID-19350

3Methodology

In this section, the details of the methods adopted for the screening of COVID-19 using X-ray and CT Scan images are presented in appropriate subheadings.

3.1Deep feature extraction approach

Deep feature extraction is based on the extraction of features acquired from a pre-trained CNN. The deep features are extracted from fully connected layer and feed to the classifier for training purposes. Here, all the 13 pre-trained networks are considered for deep features extraction including alexnet, googlenet, vgg16, vgg19, densenet201, resnet18, resnet50, resnet101, inceptionv3, inceptionresnetv2, xception, mobilenetv2 and shufflenet. The deep features of a pre-trained network fed to the SVM for classification. The classification model in the deep feature extraction approach is illustrated in Fig. 2.

Fig. 2

Deep Feature Extraction Approach for Screening of COVID-19.

Deep Feature Extraction Approach for Screening of COVID-19.

The deep features of CNN models are extracted from a particular layer, and a feature vector is obtained. The mathematics behind the process of feature extraction from the CNN model is explained in [18]. The features are fed to the SVM classifier for the classification of COVID-19 and non-COVID-19. The details of the feature layer and feature vector of CNN models are illustrated in Table 2. “The CNN is a multilayer structure network, and each layer produces a response. The layers extract the essential image feature and pass it to the next layer. The activation in GPU with a minibatch size of 64 and GPU memory has enough space to fit the image dataset. The activation output is in the form of the column to fit in linear SVM training. To train the SVM, the function ‘fit class error-correcting output codes (‘fitcecoc’) is used. This function returns the full trained multi-class error-correcting output of the model. The function ‘fitcecoc’ uses K(K-1)/2, binary SVM model, using One-Vs-All coding design. Here, K is a unique class label. Because of error-correcting output codes and one-Vs-all coding design of SVM, the performance of classification models is enhanced [19].”

Table 2

Details of feature layer and feature vector of CNN models

CNN ModelsFeature LayerFeature VectorCNN modelsFeature LayerFeature Vector
AlexNetfc64096Xceptionpredictions1000
Vgg16fc64096Resnet18Fc10001000
Vgg19Fc64096Resnet50Fc10001000
Inceptionv3predictions1000Resnet101Fc10001000
MobileNetV2Logits1000Densenet201Fc10001000
ShuffleNetNode_2021000Inceptionresnetv2predictions1000
GoogleNetloss3-classifier1000

3.2Transfer learning approach

The transfer learning approach is a subset of machine learning that utilizes pre-collected knowledge from the established model. This section deals with the screening of COVID-19 in the transfer learning approach. In this approach 13 pre-trained network such as alexnet, googlenet, vgg16, vgg19, densenet201, resnet18, resnet50, resnet101, inceptionv3, inceptionresnetv2, xception, mobilenetv2 and shufflenet are evaluated. The classification model in the transfer learning approach is illustrated in Fig. 3.

Fig. 3

Transfer Learning Approach for Screening of COVID-19.

Transfer Learning Approach for Screening of COVID-19.

3.3Machine learning approach

The screening of COVID-19 using the machine learning approach includes HOG, LBP, and GLCM features. “The histogram of oriented gradients (HOG) is a feature descriptor used in computer vision and image processing for object detection. The technique counts occurrences of gradient orientation in localized portions of an image [20].” “Local binary patterns (LBP) are a type of visual descriptor used for classification in computer vision [21].” “A statistical method of examining texture that considers the spatial relationship of pixels is the Gray-level co-occurrence matrix (GLCM), also known as the Gray-level spatial dependence matrix [22, 23].” Using these features, the classifier such as Naïve bayes, KNN, and SVM with their different paradigms are evaluated. The machine learning classifiers are evaluated with the similar approach adopted in deep feature extraction and transfer learning approaches, i.e., training: testing ratio is 80:20.

4Experimental results

This section provides a comparative analysis of various models of deep learning, transfer learning and machine learning approach using X-Ray and CT scan images for the screening of COVID-19. The exploration study was actualized utilizing the MATLAB 2019a. All the applications were run on a laptop, i.e., HP Pavilion Core i5 5th Generation with basic NVIDIA GEFORCE GTX 1050Ti. Each classifier’s performance is measured using six evaluation indicators, namely accuracy, sensitivity, specificity, false-positive rate (FPR), F1 Score and computational time in both deep learning feature extraction and transfer learning approach. The accuracy and area under the curve (AUC) are used in the machine learning approach to measure the performance of the classifiers. The most reliable classifier, namely support vector machine (SVM), is employed to classify the COVID-19 and non-COVID-19 images in the deep feature extraction method. Here we are not adopting any augmentation technique to increase the volume of the dataset. The introduction of augmentation techniques to increase the dataset has many disadvantages, such as (1) easy generation of anatomically incorrect samples (2) not trivial to implement (3) mode collapse problem. Further, our main aim is to provide the efficacy of X-ray and CT scan images towards coronavirus diagnosis. The data samples are split randomly into 80:20 proportions for training and testing, respectively. All the images are resized to 227×  227×  3 dimensions. The evaluation indicators are expressed in (1) to (6) equations.

(1)
Accuracy=TP+TNTP+FP+TN+FN
(2)
Sensitivity=TPTP+FN
(3)
Specificity=TNTN+FP
(4)
FPR=FPFP+TN
(5)
Precision=TPTP+FP
(6)
F1Score=2×sensitivity×precisionsensitivity+precision

where TP = true positive, TN = true negative, FP = false positive, and FN = false negative.

The hyperparameters used in all of the experiments in deep feature extraction and transfer learning approaches are: “solver type: stochastic gradient descent, the initial learning rate is 0.001, learning rate policy: Step (decreases by a factor of 10 every 50/5 epochs), momentum: 0.9, drop out is 0.2, Number of Epochs is 50 and minibatch size: 64”. Subsection 4.1, subsection 4.2, and subsection 4.3 presented the experimental result outcomes of deep feature extraction, transfer learning, and machine learning approach for classification of COVI19 and NON-COVID respectively.

4.1Results based on deep feature extraction methods

In this subsection, 13 pre-trained CNN models based on deep feature extraction approach using X-Ray and CT Scan images are examined. We have made 30 independent runs for the experiments, and its mean & standard deviation of all evaluation indicators was recorded in Table 3.

Table 3

Comparative Results of X-ray and CT Scan Images in Deep Feature Extraction with SVM Approach

Pre-Trained ModelX-ray ImageCT Scan Image
AccuracySensitivitySpecificityFPRF1 ScoreComputational Time (in Second)AccuracySensitivitySpecificityFPRF1 ScoreComputational Time (in second)
AlexNet0.991±0.0050.991±0.0110.999±0.0030.001±0.0030.995±0.00528.48±0.880.698±0.0720.623±0.2570.773±0.2060.227±0.2060.643±0.16620.017±2.046
MobileNetV20.996±0.0060.991±0.0111.0±0.00.0±0.00.996±0.00638.34±0.600.750±0.0300.731±0.1050.772±0.0610.230±0.0610.743±0.03835.503±0.35
ShuffleNet0.993±0.0060.987±0.0131.0±0.00.0±0.00.993±0.00732.22±9.3670.753±0.0620.695±0.1980.810±0.1370.190±0.1370.721±0.12825.700±1.812
Densenet2010.996±0.0050.993±0.0101.0±0.00.0±0.00.996±0.005131.1 + 8.30.783±0.0430.748±0.1390.890±0.1580.181±0.1580.771±0.054151.1±6.6
GoggleNet0.996±0.0040.914±0.0081.0±0.00.0±0.00.996±0.00828.768±0.2670.723±0.0540.735±0.1850.711±0.1890.289±0.1890.717±0.08925.18±0.32
Inception Resnet V20.994±0.0070.988±0.0141.0±0.00.0±0.00.9942±0.0073171.6±2.90.753±0.0490.747±0.1480.758±0.1660.241±0.1670.746±0.075175.93±2.5
InceptionV30.994±0.0060.988±0.0131.0±0.00.0±0.00.994±0.00779.442±3.8410.744±0.0460.783±0.1100.704±0.1440.295±0.1440.752±0.04777.863±0.561
Resnet180.996±0.0050.992±0.0070.999±0.0050.001±0.0050.996±0.00531.62±9.980.739±0.0610.692±0.1970.786±0.1960.213±0.1960.713±0.10626.56±0.17
Resnet500.997±0.0050.993±0.0111.0±0.00.0±0.00.996±0.00631.680±2.2650.783±0.0690.739±0.1850.827±0.1750.173±0.1750.762±0.11053.44±11.15
Resnet1010.990±0.0070.985±0.0110.996±0.0090.004±0.0100.991±0.00777.56±0.010.767±0.0640.738±0.1820.797±0.1590.203±0.1590.749±0.10679.35±1.88
VGG 160.9945±0.0050.990±0.0090.998±0.0080.001±0.0080.995±0.00595.37±2.550.813±0.0500.769±0.1320.857±0.0830.142±0.0830.799±0.07895.46±1.24
VGG190.998±0.0030.996±0.0071.0±0.00.0±0.00.998±0.003111.869±1.2560.813±0.0380.803±0.1340.823±0.1290.177±0.1290.807±0.051115.911±1.528
X ception0.993±0.0060.986±0.0131.0±0.00.0±0.00.993±0.007105.810±0.0130.752±0.0480.743±0.1560.762±0.1510.238±0.1510.743±0.080110.51±4.64

*The results recorded are the mean and std. dev. of 30 independent runs of each classification models.

It is observed from Table 3; each classification model performed better in the case of X-ray images compared to CT scan images. There is no doubt the computational time is more in the X-ray image than CT scan image in some classification models. Still, the other evaluation indicators like accuracy, sensitivity, specificity, and F1score have better value. Again, the FPR is always less in the X-ray image than the CT scan image in all classification models. Further, among all classification models based on the deep feature extraction method, vgg19 achieved 99.81%accuracy utilizing X-ray image datasets. Again, with the same classification model using CT scan images resulted in 81.35%accuracy.

4.2Results based on transfer learning approach

In this subsection, we performed fine-tuning based on transfer learning using pre-trained CNN models. A total of 13 pre-trained CNN models in the transfer learning approach using X-Ray and CT Scan images are examined. We have made 30 independent runs for the experiments, and its mean & standard deviation of all evaluation indicators was recorded in Table 4.

Table 4

Comparative Results of X-ray and CT Scan Images in Transfer Learning Approach

Pre-Trained ModelX-ray ImageCT Scan Image
AccuracySensitivitySpecificityFPRF1 ScoreComputational Time (in Second)AccuracySensitivitySpecificityFPRF1 ScoreComputational Time (in second)
AlexNet0.984±0.0140.980±0.0210.988±0.0170.012±0.0170.984±0.01465.04±7.320.621±0.0620.369±0.0750.611±0.0640.363±0.0.0750.611±0.06436.87±4.78
MobileNet V20.986±0.0130.983±0.0150.989±0.0180.011±0.0180.986±0.01366.209±8.6520.642±0.0430.638±0.0620.646±0.0660.354±0.0660.640±0.04539.02±5.28
ShuffleNet0.985±0.0120.975±0.0210.994±0.0120.006±0.0120.984±0.01265.84±8.120.642±0.0410.641±0.0550.643±0.0630.357±0.0630.641±0.04239.19±7.73
Densenet2010.986±0.0090.981±0.0120.990±0.0140.010±0.0140.985±0.00976.58±9.0150.633±0.0560.618±0.0740.648±0.0750.352±0.0750.6263±0.05950.94±6.31
GoggleNet0988±0.0110.985±0.0140.991±0.0170.009±0.0170.988±0.01165.152±10.0340.611±0.0590.619±0.0660.603±0.0810.396±0.0810.615±0.05837.82±4.90
Inception Resnet V20.984±0.0100.982±0.0150.987±0.0170.013±0.0170.984±0.01582.01±9.010.630±0.0420.630±0.0570.631±0.0450.369±0.0450.629±0.0555.53±4.04
InceptionV30.996±0.0090.985±0.0140.993±0.0110.007±0.0110.989±0.00980.91±21.010.621±0.0570.614±0.07480.629±0.0740.371±0.0740.618±0.06039.32±4.17
Resnet180.985±0.0050.983±0.0070.979±0.0040.001±0.0040.975±0.00433.66±9.980.639±0.0620.632±0.1970.767±0.1950.223±0.1950.613±0.10535.46±0.17
Resnet500.982±0.0160.798±0.0170.985±0.0190.015±0.0190.982±0.01565.75±9.390.644±0.0550.628±0.0720.660±0.0610.339±0.0610.637±0.05939.073±4.757
Resnet1010.987±0.0100.985±0.0160.988±0.0130.012±0.0130.987±0.01175.171±10.6600.612±0.0640.591±0.0780.634±0.0810.366±0.0810.603±0.06839.93±3.81
VGG 160.984±0.0100.985±0.0130.988±0.0150.012±0.0150.986±0.01181.68±21.650.634±0.0420.638±0.0710.658±0.0480.342±0.0480.644±0.05147.33±12.64
VGG190.984±0.0110.978±0.0120.990±0.0160.010±0.0160.984±0.01178.96±13.740.648±0.0420.617±0.0750.652±0.0560.347±0.0550.627±0.05439.95±4.56
X ception0.987±0.0100.981±0.0020.994±0.0090.006±0.0090.987±0.01075.83±12.080.617±0.0610.603±0.0750.615±0.0750.369±0.0750.611±0.06436.78±4.78

*The results recorded are the mean and std. dev. of 30 independent runs of each classification models.

It is observed from Table 4; the classification model based on the transfer learning approach performed better in the case of X-ray images compared to CT scan images like the deep feature extraction method. Further, among all classification models based on transfer learning approaches, Inceptionv3 achieved the highest accuracy of 98.95%using X-ray images. Again, 62.17%of accuracy was achieved by Inceptionv3 in the case of CT scan images. Furthermore, using CT scan images, VGG19 achieved the highest accuracy in the transfer learning approach, i.e., 64.80%.

4.3Results based on machine learning approach

In this subsection, the three machine learning classifiers, namely naïve Bayes, SVM and KNN are examined to classify COVID-19 and non-COVID-19 images with their different paradigms. The evaluation process is the same as deed feature extraction and transfer learning approach, i.e., training and testing ratio is 80:20. The performance of classification models in machine learning approaches is in terms of accuracy and AUC. Table 5 noted the measures of classification models.

Table 5

Comparative Results of X-ray and CT Scan Images in machine learning Approach

ClassifierX-ray ImageCT Scan Image
GLCMHOGLBPGLCMHOGLBP
AccuracyAUCAccuracyAUCAccuracyAUCAccuracyAUCAccuracyAUCAccuracyAUC
(%)(%)(%)(%)(%)(%)
Naïve BayesKernel Naïve Bayes980.9992.90.9592.10.9569.30.76600.6867.10.7
SVMLinear SVM99.3197.1197.9163.60.6566.40.7482.90.88
Quadratic SVM99.3199.3199.5183.60.9267.10.7785.70.89
Cubic SVM99.0199.0199.1183.60.8867.10.7285.00.87
Fine Gaussian SVM99.1197.90.9999.0185.00.9557.10.7383.60.92
Medium Gaussian SVM99.2198.6197.9177.10.8567.90.7581.40.86
Coarse Gaussian SVM98.6195.00.9992.1164.30.6769.30.7467.10.74
KNNFine KNN98.60.9994.30.9997.90.9885.00.8571.40.7180.70.81
Medium KNN98.60.9988.60.9894.30.9974.30.8370.00.7573.60.84
Coarse KNN92.9182.10.9083.60.9965.00.7266.40.7165.70.72
Cosine KNN97.90.9993.60.9995.70.9876.60.8260.00.6979.30.84
Cubic KNN98.60.9991.40.9894.30.9874.30.8267.90.7371.40.83
Weighted KNN98.60.9992.90.9996.40.9981.40.9174.30.7576.40.88

It was observed from Table 5; the effectiveness of X-ray images is better than the CT Scan images towards the diagnosis of coronaviruses irrespective of the classifiers and handcrafted features. Further, the highest accuracy achieved in the machine learning approach is the quadratic SVM with LBP features using X-ray images, i.e., 99.50%. However, in the case of CT scan images, that same classification model resulted in 85.70%accuracy. As an example, the screenshot of the confusion matrix and ROC plot resulted from quadratic SVM with LBP feature using X-Ray images is illustrated in Fig. 4 and Fig. 5, respectively. Thus, the results of analysis and comparison of 65 classification models in this study indicate that developing computer aided classification models using chest X-ray images can achieve better performance than using CT scan images to screen COVID-19 infected diseases.

Fig. 4

Confusion Matrix of Quadratic SVM classifier with LBP features using X-ray images.

Confusion Matrix of Quadratic SVM classifier with LBP features using X-ray images.
Fig. 5

ROC curve of Quadratic SVM classifier with LBP features using X-ray images.

ROC curve of Quadratic SVM classifier with LBP features using X-ray images.

5Discussion

Various studies have pointed out that chest X-ray images [24] and CT [25] images can play an essential evaluation role for screening and diagnosing COVID- 19 infection [26] using various methods and techniques such as Structured Latent Multi-View Representation Learning [27], CXR features [28], Deep features and Bayesian Optimization [29] and nCOVnet [30], etc. Studies related to detection and early diagnosis of coronavirus using CT scans and X-ray images are continuing. Table 6 illustrated the various techniques with their achievements for screening COVID-19.

Table 6

Various techniques with their achievements for the screening of COVID-19

ReferenceDatasetsClass/SubjectsMethodsAccuracy (%)
Hemdan et al. [31]X-RayCOVID-19 (positive): 25CovidX Network90
Normal: 25
Wang and Wong [32]X-RayCOVID-19 (positive): 53Covid Network92.4
Healthy:8066
COVID-19 (negative): 5526
Ghoshal et al. [33]X-RayCOVID-19(positive): 25Convolutional Neural Network92.9
Others - #Not available
Ioannis et al. [34]X-RayCOVID-19(positive): 224VGG-19 Network93.48
Healthy: 504
Pneumonia: 700
Sethy et al. [7]X-RayCOVID-19 (positive): 25ResNet-50 and Support Vector Machine95.38
COVID-19 (negative): 25
Narin et al. [8]X-RayCOVID-19 (positive): 50ResNet-50 and Deep CNN98
COVID-19 (negative): 50
Tulin et al. [10]X-RayNo Findings: 500DarkCovidNet98.08
COVID-19 (positive): 125
Pneumonia: 500
Wang et al. [35]CT ScanCOVID-19 (positive): 195M-Inception82.9
COVID-19 (negative): 258
Ying et al. [36]CT ScanHealthy: 708DRE-Net86
COVID-19 (positive): 777
Xu et al. [37]CT ScanHealthy: 175Location Attention +  ResNet86.7
COVID-19 (positive): 219
Viral pneumonia: 224
Zheng et al. [38]CT ScanCOVID-19 (positive): 3133D Deep Network +  UNet90.8
COVID-19 (negative): 219
Chen et al. [39]CT ScanCOVID-19 (positive): 51UNet plus +  Network95.2
Others: 55
Purohit et al. [40]X-RayCOVID-19 (positive): 536Multi-image Augmentation +  CNN99.44
COVID-19 (negative): 536
CT ScanCOVID-19 (positive): 276095.38
COVID-19 (negative): 2760
In the deep feature Extraction approach, the maximum accuracy achieved by VGG19 + SVM99.81%
In transfer, learning approach the maximum accuracy achieved by inceptionV399.64%
Proposed workX-RayCOVID-19:350 Non-COVID-19:350In the machine learning approach, the maximum accuracy achieved by LBP feature +  quadratic SVM99.5%
CT ScanCOVID-19:350 Non-COVID-19:350In the deep feature Extraction approach, the maximum accuracy achieved by VGG19 + SVM81.35%
In transfer, learning approach the maximum accuracy achieved by VGG1964.80%
In the machine learning approach, the maximum accuracy achieved by LBP feature +  quadratic SVM85.7%

It is observed from state-of-art, the maximum accuracy achieved using X-Ray images is 99.44%and using CT scan images is 95.38%[40]. Here, the researcher used 536 X-ray images of COVID-19 and non-COVID-19, resulted 99.44%. But, 95.38%of accuracy is resulted using 2760 CT scan images of COVID-19 and non-COVID-19. Hence, there is a conflict between various researchers regarding the X-ray and CT scans, i.e., which plays as an informatics tool for the early detection and diagnosis of COVID-19 disease. In this research, the same number of X-ray and CT scan images is applied in various classification models based on deep feature extraction, transfer learning, and machine learning approaches. So, we prepare two sets of datasets, i.e., the X-Ray dataset & CT scan dataset. The X-Ray dataset consists of 700 X-Ray images, which include 350 non-COVID-19 and 350 COVID-19. Similarly, the CT scan dataset consists of 700 X-Ray images, which have 350 non-COVID-19 and 350 COVID-19. This research includes 65 classification methods, i.e.,13 deep extraction, 13 transfer learning, and 39 machine learning methods.

In the deep feature extraction approach, the maximum accuracy achieved by VGG19 + SVM using X-ray images is 99.81%, which is higher than the existing work. However, the same classification model resulted 81.35%accuracy using CT scan images. In the transfer learning approach, the maximum accuracy achieved by inceptionV3 using X-ray images is 99.64%. But, 64.80%of accuracy is resulted by VGG19 using CT scan images in the transfer learning approach. Also, in the machine learning approach, the maximum accuracy achieved by LBP feature +  quadratic SVM in the case of X-ray as well as CT scan images and resulted 99.5%and 85.7%of accuracy. Hence, it is clear that comparing two popular image modalities of the classification models, chest X-ray images are more useful for screening of COVID-19.

6Conclusion

The comparative study for the screening of COVID19 in deep feature extraction, transfer learning, and machine learning approach is carried out. Here, 65 classification models are evaluated to judge the betterment among the X-ray and CT scan images. It is implicated from the experimentation, with the same dimension of the X-ray and CT scan dataset, the X-ray images are better for computer aid diagnosis. This comparative study clarifies the limitations and supremacy of X-ray and CT scan images towards the computer aid diagnosis system design. Also, this article offers the performance ability of different classification models for the screening of COVID-19. Among all classification models based on deep feature extraction with SVM, the VGG19 with SVM achieved the highest accuracy of 99.81%using X-ray images. Again, with the same classification model, using CT scan images resulted in 81.35%accuracy. Further, among all classification models based on transfer learning approaches, Inceptionv3 achieved the highest accuracy of 99.64%using X-ray images. Again, 62.17%of accuracy was achieved by Inceptionv3 in the case of CT scan images. Similarly, the highest accuracy achieved in the machine learning approach is the quadratic SVM with LBP features using X-ray images, i.e., 99.50%. But, in the case of CT scan images, that same classification model resulted in 85.7%accuracy. Hence, overall, the VGG19 with SVM performs better using X-ray images.

This comparative study offers additional insight among the research community working towards the development of computer aid diagnosis system for screening COVID19. This comparative analysis implicated the contribution of X-ray images is more effective than CT scan images for the screening of COVID-19. Further, X-ray is cost-effective and readily available at rural or small hospitals. We want to share our study findings, given the urgent need for different strategies to manage the COVID-19 patients better and diminish the spread of SARS-CoV-2 and its prognosis in the current pandemic context.

Funding

None.

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Ethical approval

This article does not contain any studies with human participants or animals performed by any authors.

References

[1] 

WHO: Novel Coronavirus, http://www.who.int/csr/don/archive/disease/novel_coronavirus/en/ last accessed: 2020/08/06.

[2] 

Toğaçar M. , Ergen B. , Cömert Z. , COVID-19 detection using deep learning models to exploit Social Mimic Optimization and structured chest X-ray images using fuzzy color and stacking approaches, Computers in Biology and Medicine 121 (2020), 103805.

[3] 

Ceylan Z. , Estimation of COVID-19 prevalence in Italy, Spain, and France, Science of the Total Environment 729 (2020), 138817.

[4] 

Alimadadi A. , Aryal S. , Manandhar I. , et al., Artificial intelligence and machine learning to fight COVID-19, Physiological Genomics 52 (2020), 200–202.

[5] 

Pirouz B. , ShaffieeHaghshenas S. , ShaffieeHaghshenas S. , Piro P. , Investigating a serious challenge in the sustainable development process: Analysis of confirmed cases of COVID-19 (new type of coronavirus) through a binary classification using artificial intelligence and regression analysis, Sustainability 12 (2020), 2427.

[6] 

Cohen J.P. , Morrison P. , Dao L. , et al.COVID-19 image data collection: prospective predictions are the future, Arvix preprint. ArXiv: 2006.11988. (2020).

[7] 

Sethy P.K. , Behera S.K. , Ratha P.K. , Biswas P. Detection of coronavirus disease (COVID-19) based on deep features and support vector machine, International Journal of Mathematical, Engineering and Management Sciences 5 (2020), 643–651.

[8] 

Narin A. , Kaya C. , Pamuk Z. , Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks, ArXiv preprint. ArXiv: 2003.10849 (2020).

[9] 

Ucar F. , Korkmaz D. , COVIDiagnosis-Net: Deep Bayes-SqueezeNet based diagnosis of the coronavirus disease (COVID-19) from X-ray images, Medical Hypotheses 140 (2020), 109761.

[10] 

Ozturk T. , Talo M. , Yildirim E.A. , et al., , Automated detection of COVID-19 cases using deep neural networks with X-ray images, Computers in Biology and Medicine 121 (2020), 103792.

[11] 

Lei P. , Huang Z. , Liu G. , et al., Clinical and computed tomographic (CT) images characteristics in the patients with COVID-19 infection: What should radiologists need to know? Journal of X-ray Science and Technology 28 (2020), 369–381.

[12] 

Shan F. , Gao Y. , Wang J. , et al., Lung infection quantification of COVID-19 in CT Images with deep learning, arXiv preprint arXiv:2003.04655. (2020).

[13] 

Al-karawi D. , Al-Zaidi S. , Polus N. , Jassim S. , Machine learning analysis of chest CT scan images as a complementary digital test of coronavirus (COVID-19) patients, medRxiv. 2020.04.13.20063479, (2020).

[14] 

National Cancer Institute: National Lung Screening Trial (NLST), https://www.cancer.gov/types/lung/research/nlst last accessed 2020/11/06.

[15] 

Cochrane: Featured Review: Thoracic imaging tests for the diagnosis of COVID-19, https://www.cochrane.org/news/featured-review-thoracic-imaging-tests-diagnosis-covid-19, last accessed 2020/11/06.

[16] 

GitHub: GitHub, https://github.com/last accessed 2020/11/06.

[17] 

Kaggle: Kaggle, https://www.kaggle.com/, last accessed 2020/11/06.

[18] 

Wiatowski T. , Bolcskei H. A mathematical theory of deep convolutional neural networks for feature extraction, IEEE Trans Inf Theory 64(3) (2018), 1845–1866.

[19] 

Sethy P.K. , Barpanda N.K. , Rath A.K. , et al., Deep feature based rice leaf disease identification using support vector machine, Computers and Electronics in Agriculture 175 (2020), 105527.

[20] 

Dong G. , Liu H. , Feature engineering for machine learning and data analytics. 2018 (Eds.). CRC Press.

[21] 

Nosaka R. , Ohkawa Y. , Fukui K. , Feature extraction based on co-occurrence of adjacent local binary patterns. In Pacific-Rim Symposium on Image and Video Technology (2012), pp. 82–91.

[22] 

Mohanaiah P. , Sathyanarayana P. , GuruKumar L. , Image texture feature extraction using GLCM approach, International Journal of Scientific and Research Publications 3(5) (2013)1–5.

[23] 

Gao C.C. , Hui X.W. , GLCM-based texture feature extraction, Computer Systems & Applications 6(048) (2010).

[24] 

Tuncer T. , Dogan S. , Ozyurt F. , An automated residual exemplar local binary pattern and iterative ReliefF based corona detection method using lung X-ray image, Chemometrics and Intelligent Laboratory Systems 203 (2020), 104054.

[25] 

Li Z. , Zeng B. , Lei P. , et al., Differentiating pneumonia with and without COVID-19 using chest CT images: from qualitative to quantitative, Journal of X-ray Science and Technology 28 (2020), 583–589.

[26] 

Lalmuanawma S. , Hussain J. , Chhakchhuak L. , Applications of machine learning and artificial intelligence for Covid-19 (SARS-CoV-2) pandemic: A review. Chaos, Solitons and Fractals 139 (2020), 110059.

[27] 

Kang H. , Xia L. , Yan F. , et al., Diagnosis of coronavirus disease (COVID-19) with structured latent multi-view representation learning, IEEE Transactions on Medical Imaging 39 (2020), 2606–2614.

[28] 

Oh Y. , Park S. , Ye J.C. , Deep learning COVID-19 features on CXR using limited training data sets, IEEE Transactions on Medical Imaging 39 (2020), 2688–2700.

[29] 

Nour M. , Cömert Z. , Polat K. , A novel medical diagnosis model for COVID-19 infection detection based on deep features and Bayesian optimization, Applied Soft Computing Journal (2020), 106580.

[30] 

Panwar H. , Gupta P.K. , Siddiqui M.K. , et al., Application of deep learning for fast detection of COVID-19 in X-Rays using nCOVnet, Chaos, Solitons and Fractals 138 (2020), 109944.

[31] 

Hemdan E.E.-D. , Shouman M.A. , Karar M.E. ,COVIDX-Net: A framework of deep learning classifiers to diagnose COVID-19 in X-ray images, Arxiv preprint. ArXiv: 2003.11055. (2020).

[32] 

Wang L. , Wong A. , COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images, Arxiv preprint. ArXiv: 2003.09871. 1–12 (2020).

[33] 

Ghoshal B. , Tucker A. , Estimating uncertainty and interpretability in deep learning for coronavirus (COVID-19) detection. Arvix preprint. ArXiv: 2003.10769. (2020).

[34] 

Apostolopoulos I.D. , Mpesiana T.A. , Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks, Physical and Engineering Sciences in Medicine 43 (2020), 635–640.

[35] 

Wang S. , Kang B. , Ma J. , et al., A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19), medRxiv. 2020.02.14.20023028, (2020).

[36] 

Song Y. , Zheng S. , Li L. , et al., Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images, medRxiv. 2020.02.23.20026930, (2020).

[37] 

Xu X. , Jiang X. , Ma C. , et al., A deep learning system to screen novel coronavirus disease 2019 pneumonia, Engineering 6 (2020), 1122–1129.

[38] 

Wang X. , Deng X. , Fu Q. , et al., A weakly-supervised framework for COVID-19 classification and lesion localization from chest CT, IEEE Transactions on Medical Imaging 39 (2020), 2615–2625.

[39] 

Chen J. , Wu L. , Zhang J. , et al., Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective study, medRxiv. 2020.02.25.20021568, (2020).

[40] 

Purohit K. , Kesarwani A. , Kisku D.R. , Dalui M. , COVID-19 detection on chest X-ray and CT scan images using multi-image augmented deep learning model, bioRxiv. 2020.07.15.205567, (2020).