Automatic Foot Ulcer segmentation Using an Ensemble of Convolutional Neural Networks

Foot ulcer is a common complication of diabetes mellitus; it is associated with substantial morbidity and mortality and remains a major risk factor for lower leg amputation. Extracting accurate morphological features from the foot wounds is crucial for proper treatment. Although visual and manual inspection by medical professionals is the common approach to extract the features, this method is subjective and errorprone. Computer-mediated approaches are the alternative solutions to segment the lesions and extract related morphological features. Among various proposed computer-based approaches for image segmentation, deep learning-based methods and more specifically convolutional neural networks (CNN) have shown excellent performances for various image segmentation tasks including medical image segmentation. In this work, we proposed an ensemble approach based on two encoder-decoder-based CNN models, namely LinkNet and UNet, to perform foot ulcer segmentation. To deal with limited training samples, we used pre-trained weights (EfficientNetB1 for the LinkNet model and EfficientNetB2 for the UNet model) and further pre-training by the Medetec dataset. We also applied a number of morphological-based and colour-based augmentation techniques to train the models. We integrated five-fold cross-validation, test time augmentation and result fusion in our proposed ensemble approach to boost the segmentation performance. Applied on a publicly available foot ulcer segmentation dataset and the MICCAI 2021 Foot Ulcer Segmentation (FUSeg) Challenge, our method achieved state-of-the-art data-based Dice scores of 92.07% and 88.80%, respectively. Our developed method achieved the first rank in the FUSeg challenge leaderboard. The Dockerised guideline, inference codes and saved trained models are publicly available in the published GitHub repository:https://github.com/masih4/Foot_Ulcer_ Segmentation.

[1]  Gerald Schaefer,et al.  CryoNuSeg: A Dataset for Nuclei Instance Segmentation of Cryosectioned H&E-Stained Histological Images , 2021, Comput. Biol. Medicine.

[2]  Neil D. Reeves,et al.  Fully convolutional networks for diabetic foot ulcer segmentation , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[3]  J. Shaw,et al.  Global and regional diabetes prevalence estimates for 2019 and projections for 2030 and 2045: results from the International Diabetes Federation Diabetes Atlas, 9th edition. , 2019, Diabetes research and clinical practice.

[4]  J. Shaw,et al.  Global trends in diabetes complications: a review of current evidence , 2018, Diabetologia.

[5]  Munoz Pl,et al.  Automatic Segmentation of Diabetic foot ulcer from Mask Region-Based Convolutional Neural Networks , 2020, Journal of Biomedical Research and Clinical Investigation.

[6]  Metin Nafi Gürcan,et al.  Computerized segmentation and measurement of chronic wound images , 2015, Comput. Biol. Medicine.

[7]  G. Carneiro,et al.  Double Encoder-Decoder Networks for Gastrointestinal Polyp Segmentation , 2021, ICPR Workshops.

[8]  Bo Song,et al.  Automated wound identification system based on image segmentation and Artificial Neural Networks , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[9]  Reka Hollandi,et al.  Test-time augmentation for deep learning-based cell segmentation on microscopy images , 2019, Scientific Reports.

[10]  Cecil Thomas,et al.  Prevention and treatment of diabetic foot ulcers , 2017, Journal of the Royal Society of Medicine.

[11]  S. Treuillet,et al.  A Superpixel-Wise Fully Convolutional Neural Network Approach for Diabetic Foot Ulcer Tissue Classification , 2020, ICPR Workshops.

[12]  K. Alexiadou,et al.  Management of Diabetic Foot Ulcers , 2012, Diabetes Therapy.

[13]  Georg Dorffner,et al.  Investigating and Exploiting Image Resolution for Transfer Learning-based Skin Lesion Classification , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[14]  Eugenio Culurciello,et al.  LinkNet: Exploiting encoder representations for efficient semantic segmentation , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[15]  D. Bandyk The diabetic foot: Pathophysiology, evaluation, and treatment. , 2018, Seminars in vascular surgery.

[16]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[17]  Lisheng Wang,et al.  MoNuSAC2020: A Multi-Organ Nuclei Segmentation and Classification Challenge , 2021, IEEE Transactions on Medical Imaging.

[18]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  G. Dorffner,et al.  Investigating the Impact of the Bit Depth of Fluorescence-Stained Images on the Performance of Deep Learning-Based Nuclei Instance Segmentation , 2021, Diagnostics.

[21]  J. Shaw,et al.  Global estimates of diabetes prevalence for 2013 and projections for 2035. , 2014, Diabetes Research and Clinical Practice.

[22]  Georg Langs,et al.  The Effects of Skin Lesion Segmentation on the Performance of Dermatoscopic Image Classification , 2020, Comput. Methods Programs Biomed..

[23]  Sansanee Auephanwiriyakul,et al.  Automatic segmentation and degree identification in burn color images , 2012, The 4th 2011 Biomedical Engineering International Conference.

[24]  Hassan Douzi,et al.  Semantic Segmentation of Diabetic Foot Ulcer Images: Dealing with Small Dataset in DL Approaches , 2020, ICISP.

[25]  Zeyun Yu,et al.  Fully automatic wound segmentation with deep convolutional neural networks , 2020, Scientific Reports.

[26]  Line Bisgaard Jørgensen,et al.  Methods to assess area and volume of wounds – a systematic review , 2016, International wound journal.

[27]  Bengisu Tulu,et al.  Area Determination of Diabetic Foot Ulcer Images Using a Cascaded Two-Stage SVM-Based Classification , 2017, IEEE Transactions on Biomedical Engineering.