A Deep Bayesian Ensembling Framework for COVID-19 Detection using Chest CT Images

The chest computed tomography (CT) images have been used for COVID-19 detection. Automating the process of analyzing can save great amount of time and energy. In this paper a deep bayesian ensembling framework is proposed for automatic detection of COVID-19 cases using the chest CT scans. Data augmentation is applied to increase the size and quality of training data available. Transfer learning is utilized to extract informative features. The extracted features are used to train the three different bayesian classifiers. The uncertainty of the neural network predictions is estimated by anchored, unconstrained and regularized bayesian ensembling methods. The reliability of predictions is then delineated. The epistemic and aleatoric uncertainties are estimated and different bayesian classifiers are compared from different perspectives. We use a small dataset containing only 275 CT images of positive COVID-19 cases. The results sounds promising and they can be improved in the future, as the performance of deep neural networks is reliant to big datasets. Prediction accuracy and predictive uncertainty estimates for unseen chest CT images indicate that the deep bayesian ensembling is a promising framework for COVID-19 detection.

[1]  Wenyu Liu,et al.  Deep Learning-based Detection for COVID-19 from Chest CT using Weak Label , 2020, medRxiv.

[2]  Yarin Gal,et al.  Uncertainty in Deep Learning , 2016 .

[3]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[4]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[5]  Chunhua Shen,et al.  COVID-19 Screening on Chest X-ray Images Using Deep Learning based Anomaly Detection , 2020, ArXiv.

[6]  Yee Whye Teh,et al.  Bayesian Learning via Stochastic Gradient Langevin Dynamics , 2011, ICML.

[7]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[8]  Saeid Nahavandi,et al.  Optimal Uncertainty-guided Neural Network Training , 2019, Appl. Soft Comput..

[9]  Abbas Khosravi,et al.  A Survey of Computational Intelligence Techniques for Wind Power Uncertainty Quantification in Smart Grids , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Julien Cornebise,et al.  Weight Uncertainty in Neural Networks , 2015, ArXiv.

[11]  Charles Blundell,et al.  Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles , 2016, NIPS.

[12]  Hayit Greenspan,et al.  Deep learning with non-medical training used for chest pathology identification , 2015, Medical Imaging.

[13]  Simon Julier,et al.  Posterior distribution analysis for Bayesian inference in neural networks , 2016 .

[14]  Johnathan M. Bardsley,et al.  MCMC-Based Image Reconstruction with Uncertainty Quantification , 2012, SIAM J. Sci. Comput..

[15]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.

[16]  Alexander Wong,et al.  COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest Radiography Images , 2020, ArXiv.

[17]  Q. Tao,et al.  Serial Quantitative Chest CT Assessment of COVID-19: A Deep Learning Approach , 2020, Radiology. Cardiothoracic imaging.

[18]  Pengtao Xie,et al.  COVID-CT-Dataset: A CT Scan Dataset about COVID-19 , 2020, ArXiv.

[19]  Hayit Greenspan,et al.  Chest pathology detection using deep learning with non-medical training , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[20]  Saeid Nahavandi,et al.  Neural Network-Based Uncertainty Quantification: A Survey of Methodologies and Applications , 2018, IEEE Access.

[21]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[22]  Alex Graves,et al.  Practical Variational Inference for Neural Networks , 2011, NIPS.

[23]  Saeid Nahavandi,et al.  An Uncertainty-Aware Transfer Learning-Based Framework for COVID-19 Diagnosis , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[25]  S. Balakrishnan,et al.  Coronavirus Disease 2019 (COVID-19): A Systematic Review of Imaging Findings in 919 Patients. , 2020, AJR. American journal of roentgenology.

[26]  Heikki Haario,et al.  Randomize-Then-Optimize: A Method for Sampling from Posterior Distributions in Nonlinear Inverse Problems , 2014, SIAM J. Sci. Comput..

[27]  Dandan Zhu,et al.  Synthetic Medical Images Using F&BGAN for Improved Lung Nodules Classification by Multi-Scale VGG16 , 2018, Symmetry.

[28]  K. Cao,et al.  Artificial Intelligence Distinguishes COVID-19 from Community Acquired Pneumonia on Chest CT , 2020, Radiology.

[29]  Lian-lian Wu,et al.  Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective study , 2020, medRxiv.

[30]  U. Rajendra Acharya,et al.  Automated Detection and Forecasting of COVID-19 using Deep Learning Techniques: A Review , 2020, ArXiv.

[31]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[32]  Ioannis D. Apostolopoulos,et al.  Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks , 2020, Physical and Engineering Sciences in Medicine.

[33]  Abdul Hafeez,et al.  COVID-ResNet: A Deep Learning Framework for Screening of COVID19 from Radiographs , 2020, ArXiv.

[34]  Benjamin Van Roy,et al.  Deep Exploration via Bootstrapped DQN , 2016, NIPS.

[35]  Dean S. Oliver,et al.  An Iterative Ensemble Kalman Filter for Multiphase Fluid Flow Data Assimilation , 2007 .

[36]  Ezz El-Din Hemdan,et al.  COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images , 2020, ArXiv.

[37]  Xiaowei Xu,et al.  A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia , 2020, Engineering.

[38]  Robert Tibshirani,et al.  A Comparison of Some Error Estimates for Neural Network Models , 1996, Neural Computation.

[39]  D. Oliver,et al.  Ensemble Randomized Maximum Likelihood Method as an Iterative Ensemble Smoother , 2011, Mathematical Geosciences.

[40]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[41]  Mohamed Zaki,et al.  Uncertainty in Neural Networks: Bayesian Ensembling , 2018, ArXiv.