Confidence Aware Neural Networks for Skin Cancer Detection

Deep learning (DL) models have received particular attention in medical imaging due to their promising pattern recognition capabilities. However, Deep Neural Networks (DNNs) require a huge amount of data, and because of the lack of sufficient data in this field, transfer learning can be a great solution. DNNs used for disease diagnosis meticulously concentrate on improving the accuracy of predictions without providing a figure about their confidence of predictions. Knowing how much a DNN model is confident in a computer-aided diagnosis model is necessary for gaining clinicians’ confidence and trust in DL-based solutions. To address this issue, this work presents three different methods for quantifying uncertainties for skin cancer detection from images. It also comprehensively evaluates and compares performance of these DNNs using novel uncertainty-related metrics. The obtained results reveal that the predictive uncertainty estimation methods are capable of flagging risky and erroneous predictions with a high uncertainty estimate. We also demonstrate that ensemble approaches are more reliable in capturing uncertainties through inference.

[1]  Debjani Chakraborty,et al.  Transfer learning based classification of optical coherence tomography images with diabetic macular edema and dry age-related macular degeneration. , 2017, Biomedical optics express.

[2]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[3]  Donya Khaledyan,et al.  Applying a new feature fusion method to classify breast lesions , 2021, Medical Imaging.

[4]  Muhammad Sharif,et al.  Attributes based skin lesion detection and recognition: A mask RCNN and transfer learning-based deep learning framework , 2021, Pattern Recognit. Lett..

[5]  S. Han,et al.  Classification of the Clinical Images for Benign and Malignant Cutaneous Tumors Using a Deep Learning Algorithm. , 2018, The Journal of investigative dermatology.

[6]  A. Kalloo,et al.  Results of the 2016 International Skin Imaging Collaboration International Symposium on Biomedical Imaging challenge: Comparison of the accuracy of computer algorithms to dermatologists for the diagnosis of melanoma from dermoscopic images , 2018, Journal of the American Academy of Dermatology.

[7]  Ali Salem Altaher,et al.  Using Multi-inception CNN for Face Emotion Recognition , 2021 .

[8]  Hong Liu,et al.  Development and Assessment of a New Global Mammographic Image Feature Analysis Scheme to Predict Likelihood of Malignant Cases , 2020, IEEE Transactions on Medical Imaging.

[9]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[10]  Allan Tucker,et al.  Estimating Uncertainty and Interpretability in Deep Learning for Coronavirus (COVID-19) Detection , 2020, ArXiv.

[11]  Li Liu,et al.  A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges , 2020, Inf. Fusion.

[12]  J. Piulats,et al.  Clinical predictors of survival in metastatic uveal melanoma , 2019, Japanese Journal of Ophthalmology.

[13]  László Pásztor,et al.  Comparison of various uncertainty modelling approaches based on geostatistics and machine learning algorithms , 2019, Geoderma.

[14]  Willem Waegeman,et al.  Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods , 2019, Machine Learning.

[15]  Miss A.O. Penney.  (b) , 1974, The New Yale Book of Quotations.

[16]  Frederic Coulon,et al.  Predicting uncertainty of machine learning models for modelling nitrate pollution of groundwater using quantile regression and UNEEC methods. , 2019, The Science of the total environment.

[17]  Josien P. W. Pluim,et al.  Not‐so‐supervised: A survey of semi‐supervised, multi‐instance, and transfer learning in medical image analysis , 2018, Medical Image Anal..

[18]  Kilian Q. Weinberger,et al.  On Calibration of Modern Neural Networks , 2017, ICML.

[19]  L. Naldi,et al.  The epidemiology of skin cancer , 2002, The British journal of dermatology.

[20]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[21]  Joost R. van Amersfoort,et al.  Simple and Scalable Epistemic Uncertainty Estimation Using a Single Deep Deterministic Neural Network , 2020, ICML 2020.

[22]  Saeid Nahavandi,et al.  An Uncertainty-Aware Transfer Learning-Based Framework for COVID-19 Diagnosis , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[24]  Hong Liu,et al.  Applying a Random Projection Algorithm to Optimize Machine Learning Model for Breast Lesion Classification , 2020, IEEE Transactions on Biomedical Engineering.

[25]  Ronald Seoh,et al.  Qualitative Analysis of Monte Carlo Dropout , 2020, ArXiv.

[26]  Azadeh Abdollah Zadeh,et al.  Study of Genes Associated With Parkinson Disease Using Feature Selection , 2020 .

[27]  Bin Zheng,et al.  A new case-based CAD scheme using a hierarchical SSIM feature extraction method to classify between malignant and benign cases , 2020, Medical Imaging.

[28]  Achim Hekler,et al.  Skin Cancer Classification Using Convolutional Neural Networks: Systematic Review , 2018, Journal of medical Internet research.

[29]  H. Haenssle,et al.  Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[30]  Saeid Nahavandi,et al.  Objective evaluation of deep uncertainty predictions for COVID-19 detection , 2020, Scientific Reports.

[31]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[32]  Bin Zheng,et al.  Applying a machine learning model using a locally preserving projection based feature regeneration algorithm to predict breast cancer risk , 2018, Medical Imaging.