Checklist for responsible deep learning modeling of medical images based on COVID-19 detection studies

The sudden outbreak and uncontrolled spread of COVID-19 disease is one of the most important global problems today. In a short period of time, it has led to the development of many deep neural network models for COVID-19 detection with modules for explainability. In this work, we carry out a systematic analysis of various aspects of proposed models. Our analysis revealed numerous mistakes made at different stages of data acquisition, model development, and explanation construction. In this work, we overview the approaches proposed in the surveyed Machine Learning articles and indicate typical errors emerging from the lack of deep understanding of the radiography domain. We present the perspective of both: experts in the field - radiologists and deep learning engineers dealing with model explanations. The final result is a proposed checklist with the minimum conditions to be met by a reliable COVID-19 diagnostic model.

[1]  Edward J. Bernacki.  The Checklist Manifesto—How to Get Things Right , 2010 .

[2]  H. Chenga,et al.  Automated breast cancer detection and classification using ultrasound images A survey , 2009 .

[3]  Byron C. Wallace,et al.  ERASER: A Benchmark to Evaluate Rationalized NLP Models , 2020, ACL.

[4]  Deniz Korkmaz,et al.  COVIDiagnosis-Net: Deep Bayes-SqueezeNet based diagnosis of the coronavirus disease 2019 (COVID-19) from X-ray images , 2020, Medical Hypotheses.

[5]  U. Rajendra Acharya,et al.  Automated detection of COVID-19 cases using deep neural networks with X-ray images , 2020, Computers in Biology and Medicine.

[6]  Md. Mohaiminul Islam,et al.  COVID-DenseNet: A Deep Learning Architecture to Detect COVID-19 from Chest Radiology Images , 2020 .

[7]  S. Tabik,et al.  COVIDGR Dataset and COVID-SDNet Methodology for Predicting COVID-19 Based on Chest X-Ray Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[8]  M. Zokaeinikoo,et al.  AIDCOV: An Interpretable Artificial Intelligence Model for Detection of COVID-19 from Chest Radiography Images , 2020, medRxiv.

[9]  Karrar Hameed Abdulkareem,et al.  Systematic review of artificial intelligence techniques in the detection and classification of COVID-19 medical images in terms of evaluation and benchmarking: Taxonomy analysis, challenges, future solutions and methodological aspects , 2020, Journal of Infection and Public Health.

[10]  Z. Fayad,et al.  CT Imaging Features of 2019 Novel Coronavirus (2019-nCoV) , 2020, Radiology.

[11]  Yaozong Gao,et al.  Dual-Sampling Attention Network for Diagnosis of COVID-19 From Community Acquired Pneumonia , 2020, IEEE Transactions on Medical Imaging.

[12]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[13]  Ming-Ming Cheng,et al.  JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentation , 2020, IEEE Transactions on Image Processing.

[14]  Edward Y Lee.  Pediatric Interstitial (Diffuse) Lung Disease , 2019, Imaging in Pediatric Pulmonology.

[15]  Hari Mohan Pandey,et al.  COVIDPEN: A Novel COVID-19 Detection Model using Chest X-Rays and CT Scans , 2020, medRxiv.

[16]  P. Agarwal,et al.  Chest Imaging Appearance of COVID-19 Infection , 2020, Radiology. Cardiothoracic imaging.

[17]  N. Adami,et al.  End-to-end learning for semiquantitative rating of COVID-19 severity on Chest X-rays , 2020, ArXiv.

[18]  Richard D Riley,et al.  Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal , 2020 .

[19]  M. Chung,et al.  Portable chest X-ray in coronavirus disease-19 (COVID-19): A pictorial review , 2020, Clinical Imaging.

[20]  Veronika Cheplygina,et al.  Cats or CAT scans: transfer learning from natural or medical image source datasets? , 2018, Current Opinion in Biomedical Engineering.

[21]  Till Döhmen,et al.  DeepCOVIDExplainer: Explainable COVID-19 Diagnosis from Chest X-ray Images , 2020, 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[22]  Yong Man Ro,et al.  Modality-bridge transfer learning for medical image classification , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[23]  C. Park,et al.  Chest Radiographic and CT Findings of the 2019 Novel Coronavirus Disease (COVID-19): Analysis of Nine Patients Treated in Korea , 2020, Korean journal of radiology.

[24]  Jong Chul Ye,et al.  Deep Learning COVID-19 Features on CXR Using Limited Training Data Sets , 2020, IEEE Transactions on Medical Imaging.

[25]  Hayit Greenspan,et al.  Rapid AI Development Cycle for the Coronavirus (COVID-19) Pandemic: Initial Results for Automated Detection & Patient Monitoring using Deep Learning CT Image Analysis , 2020, ArXiv.

[26]  Allan Tucker,et al.  Estimating Uncertainty and Interpretability in Deep Learning for Coronavirus (COVID-19) Detection , 2020, ArXiv.

[27]  P. Angelov,et al.  EXPLAINABLE-BY-DESIGN APPROACH FOR COVID-19 CLASSIFICATION VIA CT-SCAN , 2020, medRxiv.

[28]  Daniel S. Weller,et al.  Image quality affects deep learning reconstruction of MRI , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[29]  Kishor Datta Gupta,et al.  Study of Different Deep Learning Approach with Explainable AI for Screening Patients with COVID-19 Symptoms: Using CT Scan and Chest X-ray Image Dataset , 2020, ArXiv.

[30]  Bingliang Zeng,et al.  Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT? , 2020, European Journal of Radiology.

[31]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[32]  Michel F. Valstar,et al.  Automatic Detection of ADHD and ASD from Expressive Behaviour in RGBD Data , 2016, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[33]  Klaus-Robert Müller,et al.  Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models , 2017, ArXiv.

[34]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[35]  Zhenlin Li,et al.  The Battle Against Coronavirus Disease 2019 (COVID-19): Emergency Management and Infection Control in a Radiology Department , 2020, Journal of the American College of Radiology.

[36]  Christian Biemann,et al.  What do we need to build explainable AI systems for the medical domain? , 2017, ArXiv.

[37]  Antonella Santone,et al.  Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays , 2020, Computer Methods and Programs in Biomedicine.

[38]  I. Hung,et al.  Frequency and Distribution of Chest Radiographic Findings in Patients Positive for COVID-19 , 2020 .

[39]  Chirag Agarwal,et al.  CoroNet: A Deep Network Architecture for Semi-Supervised Task-Based Identification of COVID-19 from Chest X-ray Images , 2020, medRxiv.

[40]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[41]  Victor M Corman,et al.  Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR , 2020, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[42]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[43]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[44]  R. M. Vazquez.  The Checklist Manifesto How to Get Things Right , 2011 .

[45]  Amjad Rehman,et al.  Automatic medical image interpretation: State of the art and future directions , 2021, Pattern Recognit..

[46]  Eleftherios Trivizakis,et al.  Interpretable artificial intelligence framework for COVID-19 screening on chest X-rays , 2020, Experimental and therapeutic medicine.

[47]  Wenjing Jia,et al.  Multi-atlas segmentation and correction model with level set formulation for 3D brain MR images , 2019, Pattern Recognit..

[48]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[49]  Yicheng Fang,et al.  Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR , 2020, Radiology.

[50]  Anselmo Cardoso de Paiva,et al.  An automatic method for lung segmentation and reconstruction in chest X-ray using deep neural networks , 2019, Comput. Methods Programs Biomed..

[51]  Vishal Sharma,et al.  COVID-19 detection using Residual Attention Network an Artificial Intelligence approach , 2020, ArXiv.

[52]  Jorge S. Marques,et al.  Explainable skin lesion diagnosis using taxonomies , 2021, Pattern Recognit..

[53]  Wei Zhang,et al.  Accurate Screening of COVID-19 Using Attention-Based Deep 3D Multiple Instance Learning , 2020, IEEE Transactions on Medical Imaging.

[54]  Eri Matsuyama,et al.  A Deep Learning Interpretable Model for Novel Coronavirus Disease (COVID-19) Screening with Chest CT Images , 2020, Journal of Biomedical Science and Engineering.

[55]  Przemyslaw Biecek,et al.  Explanatory Model Analysis , 2021 .

[56]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[57]  L. Xia,et al.  Coronavirus Disease 2019 (COVID-19): Role of Chest CT in Diagnosis and Management. , 2020, AJR. American journal of roentgenology.

[58]  Petia Radeva,et al.  Exploration of Interpretability Techniques for Deep COVID-19 Classification using Chest X-ray Images , 2020, ArXiv.

[59]  Nikita Albert.  Evaluation of Contemporary Convolutional Neural Network Architectures for Detecting COVID-19 from Chest Radiographs , 2020, ArXiv.