Recognition of Ischaemia and Infection in Diabetic Foot Ulcers: Dataset and Techniques

Recognition and analysis of Diabetic Foot Ulcers (DFU) using computerized methods is an emerging research area with the evolution of image-based machine learning algorithms. Existing research using visual computerized methods mainly focuses on recognition, detection, and segmentation of the visual appearance of the DFU as well as tissue classification. According to DFU medical classification systems, the presence of infection (bacteria in the wound) and ischaemia (inadequate blood supply) has important clinical implications for DFU assessment, which are used to predict the risk of amputation. In this work, we propose a new dataset and computer vision techniques to identify the presence of infection and ischaemia in DFU. This is the first time a DFU dataset with ground truth labels of ischaemia and infection cases is introduced for research purposes. For the handcrafted machine learning approach, we propose a new feature descriptor, namely the Superpixel Colour Descriptor. Then we use the Ensemble Convolutional Neural Network (CNN) model for more effective recognition of ischaemia and infection. We propose to use a natural data-augmentation method, which identifies the region of interest on foot images and focuses on finding the salient features existing in this area. Finally, we evaluate the performance of our proposed techniques on binary classification, i.e. ischaemia versus non-ischaemia and infection versus non-infection. Overall, our method performed better in the classification of ischaemia than infection. We found that our proposed Ensemble CNN deep learning algorithms performed better for both classification tasks as compared to handcrafted machine learning algorithms, with 90% accuracy in ischaemia classification and 73% in infection classification.

[1]  Wagner Fw,et al.  The diabetic foot , 1987 .

[2]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[3]  F Tovey,et al.  The Diabetic Foot , 1997 .

[4]  Héctor Mesa,et al.  Binary Tissue Classification on Wound Images With Neural Networks and Bayesian Classifiers , 2010, IEEE Transactions on Medical Imaging.

[5]  Manu Goyal,et al.  Semantic Segmentation of Human Thigh Quadriceps Muscle in Magnetic Resonance Images , 2018, ArXiv.

[6]  Neil D. Reeves,et al.  DFUNet: Convolutional Neural Networks for Diabetic Foot Ulcer Classification , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[8]  M Albers,et al.  Assessment of quality of life of patients with severe ischemia as a result of infrainguinal arterial occlusive disease. , 1992, Journal of vascular surgery.

[9]  David G Armstrong,et al.  The Society for Vascular Surgery Lower Extremity Threatened Limb Classification System: risk stratification based on wound, ischemia, and foot infection (WIfI). , 2014, Journal of vascular surgery.

[10]  David G Armstrong,et al.  Health Care Service and Outcomes Among an Estimated 6.7 Million Ambulatory Care Diabetic Foot Cases in the U.S. , 2017, Diabetes Care.

[11]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[12]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[14]  Gerry Rayman,et al.  A simple and novel method to identify inpatients with diabetes at risk of foot ulceration , 2011 .

[15]  J. V. van Netten,et al.  Infrared Thermal Imaging for Automated Detection of Diabetic Foot Complications , 2013, Journal of diabetes science and technology.

[16]  Hazem Wannous,et al.  Enhanced Assessment of the Wound-Healing Process by Accurate Multiview Tissue Classification , 2011, IEEE Transactions on Medical Imaging.

[17]  Manu Goyal,et al.  Breast ultrasound lesions recognition: end-to-end deep learning approaches , 2018, Journal of medical imaging.

[18]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[19]  D. Armstrong,et al.  Classification of diabetic foot wounds. , 1997, Ostomy/wound management.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  R. Frykberg,et al.  Diabetic foot ulcers: pathogenesis and management. , 2002, American family physician.

[22]  Moi Hoon Yap,et al.  A New Mobile Application for Standardizing Diabetic Foot Images , 2018, Journal of diabetes science and technology.

[23]  Honglak Lee,et al.  A unified framework for automatic wound segmentation and analysis with deep convolutional neural networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  David G Armstrong,et al.  2012 infectious diseases society of america clinical practice guideline for the diagnosis and treatment of diabetic foot infections. , 2013, Journal of the American Podiatric Medical Association.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  David G Armstrong,et al.  Diabetic foot syndrome: evaluating the prevalence and incidence of foot pathology in Mexican Americans and non-Hispanic whites from a diabetes disease management cohort. , 2003, Diabetes care.

[28]  L. Uccioli,et al.  High prevalence of ischaemia, infection and serious comorbidity in patients with diabetic foot disease in Europe. Baseline results from the Eurodiale study , 2006, Diabetologia.

[29]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[30]  Neil D. Reeves,et al.  Fully convolutional networks for diabetic foot ulcer segmentation , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[31]  Monika Janda,et al.  The validity and reliability of remote diabetic foot ulcer assessment using mobile phone images , 2017, Scientific Reports.

[32]  Bengisu Tulu,et al.  Area Determination of Diabetic Foot Ulcer Images Using a Cascaded Two-Stage SVM-Based Classification , 2017, IEEE Transactions on Biomedical Engineering.

[33]  Manu Goyal,et al.  Robust Methods for Real-Time Diabetic Foot Ulcer Detection and Localization on Mobile Devices , 2019, IEEE Journal of Biomedical and Health Informatics.

[34]  Manu Goyal,et al.  Region of Interest Detection in Dermoscopic Images for Natural Data-augmentation , 2018, ArXiv.

[35]  J. Santilli,et al.  Chronic critical limb ischemia: diagnosis, treatment and prognosis. , 1999, American family physician.

[36]  David G. Armstrong,et al.  Infectious Diseases Society of America Clinical Practice Guideline for the Diagnosis and Treatment of Diabetic Foot Infectionsa , 2012 .