A new deep learning pipeline to detect Covid-19 on chest X-ray images using local binary pattern, dual tree complex wavelet transform and convolutional neural networks

In this study, which aims at early diagnosis of Covid-19 disease using X-ray images, the deep-learning approach, a state-of-the-art artificial intelligence method, was used, and automatic classification of images was performed using convolutional neural networks (CNN). In the first training-test data set used in the study, there were 230 X-ray images, of which 150 were Covid-19 and 80 were non-Covid-19, while in the second training-test data set there were 476 X-ray images, of which 150 were Covid-19 and 326 were non-Covid-19. Thus, classification results have been provided for two data sets, containing predominantly Covid-19 images and predominantly non-Covid-19 images, respectively. In the study, a 23-layer CNN architecture and a 54-layer CNN architecture were developed. Within the scope of the study, the results were obtained using chest X-ray images directly in the training-test procedures and the sub-band images obtained by applying dual tree complex wavelet transform (DT-CWT) to the above-mentioned images. The same experiments were repeated using images obtained by applying local binary pattern (LBP) to the chest X-ray images. Within the scope of the study, four new result generation pipeline algorithms having been put forward additionally, it was ensured that the experimental results were combined and the success of the study was improved. In the experiments carried out in this study, the training sessions were carried out using the k-fold cross validation method. Here the k value was chosen as 23 for the first and second training-test data sets. Considering the average highest results of the experiments performed within the scope of the study, the values of sensitivity, specificity, accuracy, F-1 score, and area under the receiver operating characteristic curve (AUC) for the first training-test data set were 0,9947, 0,9800, 0,9843, 0,9881 and 0,9990 respectively; while for the second training-test data set, they were 0,9920, 0,9939, 0,9891, 0,9828 and 0,9991; respectively. Within the scope of the study, finally, all the images were combined and the training and testing processes were repeated for a total of 556 X-ray images comprising 150 Covid-19 images and 406 non-Covid-19 images, by applying 2-fold cross. In this context, the average highest values of sensitivity, specificity, accuracy, F-1 score, and AUC for this last training-test data set were found to be 0,9760, 1,0000, 0,9906, 0,9823 and 0,9997; respectively.

[1]  Fredy Martinez,et al.  Performance Evaluation of the NASNet Convolutional Network in the Automatic Identification of COVID-19 , 2020, International Journal on Advanced Science, Engineering and Information Technology.

[2]  Yüksel Özbay,et al.  A novel method for lung segmentation on chest CT images: complex-valued artificial neural network with complex wavelet transform , 2010, Turkish Journal of Electrical Engineering and Computer Sciences.

[3]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[4]  Mohit Bhandari,et al.  Deep learning COVID-19 detection bias: accuracy through artificial intelligence , 2020, International Orthopaedics.

[5]  Juan Pedro Dominguez-Morales,et al.  COVID-XNet: A Custom Deep Learning System to Diagnose and Locate COVID-19 in Chest X-ray Images , 2020, Applied Sciences.

[6]  Jialong Chen,et al.  A novel face recognition algorithm based on the combination of LBP and CNN , 2018, 2018 14th IEEE International Conference on Signal Processing (ICSP).

[7]  Jiayue Fu,et al.  Vehicle and wheel detection: a novel SSD-based approach and associated large-scale benchmark dataset , 2020, Multimedia Tools and Applications.

[8]  Muhammad Mohsin Riaz,et al.  Dual-tree complex wavelet transform and SVD based medical image resolution enhancement , 2014, Signal Process..

[9]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection , 2020, ArXiv.

[10]  Ugurhan Kutbay,et al.  A novel comparative study using multi-resolution transforms and convolutional neural network (CNN) for contactless palm print verification and identification , 2020, Multimedia Tools and Applications.

[11]  Shaikh Anowarul Fattah,et al.  CovXNet: A multi-dilation convolutional neural network for automatic COVID-19 and other pneumonia detection from chest X-ray images with transferable multi-receptive feature optimization , 2020, Computers in Biology and Medicine.

[12]  Ruben Morales-Menendez,et al.  Application of deep learning for fast detection of COVID-19 in X-Rays using nCOVnet , 2020, Chaos, Solitons & Fractals.

[13]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[14]  S. Lindstrom,et al.  First Case of 2019 Novel Coronavirus in the United States , 2020, The New England journal of medicine.

[15]  Ting Yu,et al.  Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study , 2020, The Lancet.

[16]  Gang Li,et al.  A face recognition method based on LBP feature for CNN , 2017, 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC).

[17]  Shao-Chung Cheng,et al.  First case of Coronavirus Disease 2019 (COVID-19) pneumonia in Taiwan , 2020, Journal of the Formosan Medical Association.

[18]  Nick G. Kingsbury,et al.  Shift invariant properties of the dual-tree complex wavelet transform , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[19]  Deepak Gupta,et al.  CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection , 2020, IEEE Access.

[20]  Witold Pedrycz,et al.  Improved adaptive image retrieval with the use of shadowed sets , 2019, Pattern Recognit..

[21]  Murat Ceylan,et al.  Blood vessel extraction from retinal images using Complex Wavelet Transform and Complex-Valued Artificial Neural Network , 2013, 2013 36th International Conference on Telecommunications and Signal Processing (TSP).

[22]  F. Shan,et al.  Emerging 2019 Novel Coronavirus (2019-nCoV) Pneumonia , 2020, Radiology.

[23]  Long Jiang Zhang,et al.  Coronavirus Disease 2019 (COVID-19): A Perspective from China , 2020, Radiology.

[24]  Jesse M. Ehrenfeld,et al.  The Role of Augmented Intelligence (AI) in Detecting and Preventing the Spread of Novel Coronavirus , 2020, Journal of Medical Systems.

[25]  Xinli Yang,et al.  Facial Expression Recognition Algorithm Based on CNN and LBP Feature Fusion , 2017 .

[26]  Heshui Shi,et al.  Evolution of CT Manifestations in a Patient Recovered from 2019 Novel Coronavirus (2019-nCoV) Pneumonia in Wuhan, China , 2020, Radiology.

[27]  G. Gao,et al.  A Novel Coronavirus from Patients with Pneumonia in China, 2019 , 2020, The New England journal of medicine.

[28]  Monther Aldwairi,et al.  Automated Breast Tumor Diagnosis Using Local Binary Patterns (LBP) Based on Deep Learning Classification , 2019, 2019 International Conference on Computer and Information Sciences (ICCIS).

[29]  Nick G. Kingsbury,et al.  The dual-tree complex wavelet transform: A new efficient tool for image restoration and enhancement , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[30]  Steven Y. C. Tong,et al.  Breadth of concomitant immune responses prior to patient recovery: a case report of non-severe COVID-19 , 2020, Nature Medicine.

[31]  Alimuddin Zumla,et al.  2019-novel Coronavirus severe adult respiratory distress syndrome in two cases in Italy: An uncommon radiological presentation , 2020, International Journal of Infectious Diseases.

[32]  E. Holmes,et al.  The proximal origin of SARS-CoV-2 , 2020, Nature Medicine.

[33]  Ioannis D. Apostolopoulos,et al.  Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks , 2020, Physical and Engineering Sciences in Medicine.

[34]  Yan-Ren Lin,et al.  A Locally Transmitted Case of SARS-CoV-2 Infection in Taiwan , 2020, The New England journal of medicine.

[35]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[36]  Murat Ceylan,et al.  A novel comparative study for detection of Covid-19 on CT lung images using texture analysis, machine learning, and deep learning methods , 2020, Multimedia tools and applications.

[37]  Wei-Chih Liao,et al.  Featuring COVID-19 cases via screening symptomatic patients with epidemiologic link during flu season in a medical center of central Taiwan , 2020, Journal of Microbiology, Immunology and Infection.

[38]  Sengul Dogan,et al.  An automated Residual Exemplar Local Binary Pattern and iterative ReliefF based COVID-19 detection method using chest X-ray image , 2020, Chemometrics and Intelligent Laboratory Systems.

[39]  K. Yuen,et al.  Imaging Profile of the COVID-19 Infection: Radiologic Findings and Literature Review , 2020, Radiology. Cardiothoracic imaging.

[40]  Florentin Smarandache,et al.  Within the Lack of Chest COVID-19 X-ray Dataset: A Novel Detection Model Based on GAN and Deep Transfer Learning , 2020, Symmetry.

[41]  Jaegyun Lim,et al.  Case of the Index Patient Who Caused Tertiary Transmission of Coronavirus Disease 2019 in Korea: the Application of Lopinavir/Ritonavir for the Treatment of COVID-19 Pneumonia Monitored by Quantitative RT-PCR , 2020, Journal of Korean medical science.

[42]  W. Silverstein,et al.  First imported case of 2019 novel coronavirus in Canada, presenting as mild pneumonia , 2020, The Lancet.

[43]  Humberto Bustince,et al.  A Study on the Cardinality of Ordered Average Pooling in Visual Recognition , 2017, IbPRIA.

[44]  Aouatif Amine,et al.  Deep Transfer Learning with Apache Spark to Detect COVID-19 in chest X-ray Images , 2020 .

[45]  Hector Perez-Meana,et al.  Forecasting of COVID19 per regions using ARIMA models and polynomial functions , 2020, Applied Soft Computing.

[46]  C. Park,et al.  Chest Radiographic and CT Findings of the 2019 Novel Coronavirus Disease (COVID-19): Analysis of Nine Patients Treated in Korea , 2020, Korean journal of radiology.

[47]  C. Akdis,et al.  Clinical characteristics of 140 patients infected with SARS‐CoV‐2 in Wuhan, China , 2020, Allergy.

[48]  Milan Sonka,et al.  Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning , 2020, Medical Image Analysis.

[49]  Nureize Arbaiy,et al.  Benchmarking Methodology for Selection of Optimal COVID-19 Diagnostic Model Based on Entropy and TOPSIS Methods , 2020, IEEE Access.

[50]  Xiao Liu,et al.  Kernel Pooling for Convolutional Neural Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Fang Liu,et al.  A modified convolutional neural network for face sketch synthesis , 2018, Pattern Recognit..

[52]  P. Agarwal,et al.  Chest Imaging Appearance of COVID-19 Infection , 2020, Radiology. Cardiothoracic imaging.

[53]  Jian Wang,et al.  Deep Metric Learning with Angular Loss , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[54]  Q. Pham,et al.  Importation and Human-to-Human Transmission of a Novel Coronavirus in Vietnam , 2020, The New England journal of medicine.

[55]  Asif Iqbal Khan,et al.  CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images , 2020, Computer Methods and Programs in Biomedicine.

[56]  Talha Burak Alakus,et al.  Convolutional capsnet: A novel artificial neural network approach to detect COVID-19 disease from X-ray images using capsule networks , 2020, Chaos, Solitons & Fractals.

[57]  T. Singhal A Review of Coronavirus Disease-2019 (COVID-19) , 2020, The Indian Journal of Pediatrics.

[58]  Hoang Thi Nam Giang,et al.  The first Vietnamese case of COVID-19 acquired from China , 2020, The Lancet Infectious Diseases.

[59]  W. Ko,et al.  A case of COVID-19 and pneumonia returning from Macau in Taiwan: Clinical course and anti-SARS-CoV-2 IgG dynamic , 2020, Journal of Microbiology, Immunology and Infection.

[60]  Stefan Jaeger,et al.  Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. , 2014, Quantitative imaging in medicine and surgery.

[61]  Yan Liu,et al.  Data Augmentation for EEG-Based Emotion Recognition with Deep Convolutional Neural Networks , 2018, MMM.

[62]  Mohamed Abd Elaziz,et al.  New machine learning method for image-based diagnosis of COVID-19 , 2020, PloS one.

[63]  Kang Chen,et al.  Uncertainty-optimized deep learning model for small-scale person re-identification , 2019, Science China Information Sciences.

[64]  Vishnu Naresh Boddeti,et al.  Local Binary Convolutional Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[65]  Y. Hu,et al.  Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China , 2020, The Lancet.