Detect-and-Segment: a Deep Learning Approach to Automate Wound Image Segmentation

Chronic wounds significantly impact quality of life. If not properly managed, they can severely deteriorate. Image-based wound analysis could aid in objectively assessing the wound status by quantifying important features that are related to healing. However, the high heterogeneity of the wound types, image background composition, and capturing conditions challenge the robust segmentation of wound images. We present Detect-and-Segment (DS), a deep learning approach to produce wound segmentation maps with high generalization capabilities. In our approach, dedicated deep neural networks detected the wound position, isolated the wound from the uninformative background, and computed the wound segmentation map. We evaluated this approach using one data set with images of diabetic foot ulcers. For further testing, 4 supplemental independent data sets with larger variety of wound types from different body locations were used. The Matthews’ correlation coefficient (MCC) improved from 0.29 when computing the segmentation on the full image to 0.85 when combining detection and segmentation in the same approach. When tested on the wound images drawn from the supplemental data sets, the DS approach increased the mean MCC from 0.17 to 0.85. Furthermore, the DS approach enabled the training of segmentation models with up to 90% less training data while maintaining the segmentation performance.

[1]  Diaa Othman Negative Pressure Wound Therapy Literature Review of Efficacy, Cost Effectiveness, and Impact on Patients' Quality of Life in Chronic Wound Management and Its Implementation in the United Kingdom , 2012, Plastic surgery international.

[2]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  W. Karlen,et al.  Wound Image Quality From a Mobile Health Tool for Home-Based Chronic Wound Management With Real-Time Quality Feedback: Randomized Feasibility Study , 2021, JMIR mHealth and uHealth.

[5]  Mohammad Faizal Ahmad Fauzi,et al.  Segmentation and Management of Chronic Wound Images: A Computer-Based Approach , 2018 .

[6]  Moi Hoon Yap,et al.  The DFUC 2020 Dataset: Analysis Towards Diabetic Foot Ulcer Detection. , 2021, TouchREVIEWS in endocrinology.

[7]  Rafael Marcos Luque Baena,et al.  Wound image evaluation with machine learning , 2015, Neurocomputing.

[8]  S. Treuillet,et al.  Supervised Tissue Classification from Color Images for a Complete Wound Assessment Tool , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Bengisu Tulu,et al.  Area Determination of Diabetic Foot Ulcer Images Using a Cascaded Two-Stage SVM-Based Classification , 2017, IEEE Transactions on Biomedical Engineering.

[10]  Honglak Lee,et al.  A unified framework for automatic wound segmentation and analysis with deep convolutional neural networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Lin Yang,et al.  Spatial Clockwork Recurrent Neural Network for Muscle Perimysium Segmentation , 2016, MICCAI.

[12]  Zeyun Yu,et al.  Fully automatic wound segmentation with deep convolutional neural networks , 2020, Scientific Reports.

[13]  C. Sen Human Wounds and Its Burden: An Updated Compendium of Estimates. , 2019, Advances in wound care.

[14]  Héctor Mesa,et al.  Binary Tissue Classification on Wound Images With Neural Networks and Bayesian Classifiers , 2010, IEEE Transactions on Medical Imaging.

[15]  P. Harris,et al.  Research electronic data capture (REDCap) - A metadata-driven methodology and workflow process for providing translational research informatics support , 2009, J. Biomed. Informatics.

[16]  F. Liu,et al.  Deep Learning Approach for Evaluating Knee MR Images: Achieving High Diagnostic Performance for Cartilage Lesion Detection. , 2018, Radiology.

[17]  Haonan Lin,et al.  DeLTA: Automated cell segmentation, tracking, and lineage reconstruction using deep learning , 2019, bioRxiv.

[18]  Quoc V. Le,et al.  Self-Training With Noisy Student Improves ImageNet Classification , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Quoc V. Le,et al.  EfficientDet: Scalable and Efficient Object Detection , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Matthew B. Blaschko,et al.  Optimization for Medical Image Segmentation: Theory and Practice When Evaluating With Dice Score or Jaccard Index , 2020, IEEE Transactions on Medical Imaging.

[21]  En Zhu,et al.  A framework of wound segmentation based on deep convolutional networks , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[22]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[23]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[24]  Rangaraj M. Rangayyan,et al.  Segmentation and analysis of the tissue composition of dermatological ulcers , 2010, CCECE 2010.

[25]  C. Lindholm,et al.  Wound management for the 21st century: combining effectiveness and efficiency , 2016, International wound journal.

[26]  R. Ceilley,et al.  Chronic Wound Healing: A Review of Current Management and Treatments , 2017, Advances in Therapy.

[27]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[30]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[31]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[32]  Max A. Viergever,et al.  Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities , 2016, MICCAI.

[33]  Cathy Thomas Hess,et al.  The Art of Skin and Wound Care Documentation , 2005, Home healthcare nurse.

[34]  Hassan Douzi,et al.  Wound Size Imaging: Ready for Smart Assessment and Monitoring. , 2020, Advances in wound care.

[35]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[36]  J. Giurini,et al.  Percent change in wound area of diabetic foot ulcers over a 4-week period is a robust predictor of complete healing in a 12-week prospective trial. , 2003, Plastic and reconstructive surgery.

[37]  Saeid Nahavandi,et al.  Skin melanoma segmentation using recurrent and convolutional neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[38]  Xiaohui Liu,et al.  A Composite Model of Wound Segmentation Based on Traditional Methods and Deep Neural Networks , 2018, Comput. Intell. Neurosci..

[39]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.

[40]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Ezequiel López-Rubio,et al.  Diabetic Wound Segmentation using Convolutional Neural Networks , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[42]  R. Kirsner,et al.  High mortality in patients with chronic wounds , 2011, Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society.

[43]  Sejung Yang,et al.  Sequential Change of Wound Calculated by Image Analysis Using a Color Patch Method during a Secondary Intention Healing , 2016, PloS one.

[44]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[45]  Neil D. Reeves,et al.  Fully convolutional networks for diabetic foot ulcer segmentation , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[46]  Bengisu Tulu,et al.  Smartphone-Based Wound Assessment System for Patients With Diabetes , 2015, IEEE Transactions on Biomedical Engineering.

[47]  Yu Shi,et al.  Robust Pancreatic Ductal Adenocarcinoma Segmentation with Multi-Institutional Multi-Phase Partially-Annotated CT Scans , 2020, MICCAI.

[48]  Sabri Boughorbel,et al.  Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric , 2017, PloS one.

[49]  R. R. Bhavani,et al.  Image registration for varicose ulcer classification using KNN classifier , 2017 .

[50]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[51]  Manu Goyal,et al.  Robust Methods for Real-Time Diabetic Foot Ulcer Detection and Localization on Mobile Devices , 2019, IEEE Journal of Biomedical and Health Informatics.

[52]  Ronald M. Summers,et al.  Progressive and Multi-path Holistically Nested Neural Networks for Pathological Lung Segmentation from CT Images , 2017, MICCAI.

[53]  Bo Song,et al.  Automated wound identification system based on image segmentation and Artificial Neural Networks , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[54]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[55]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..