Multi-modal wound classification using wound image and location by deep neural network

Wound classification is an essential step of wound diagnosis. An efficient classifier can assist wound specialists in classifying wound types with less financial and time costs and help them decide an optimal treatment procedure. This study developed a deep neural network-based multi-modal classifier using wound images and their corresponding locations to categorize wound images into multiple classes, including diabetic, pressure, surgical, and venous ulcers. A body map is also developed to prepare the location data, which can help wound specialists tag wound locations more efficiently. Three datasets containing images and their corresponding location information are designed with the help of wound specialists. The multi-modal network is developed by concatenating the image-based and location-based classifier’s outputs with some other modifications. The maximum accuracy on mixed-class classifications (containing background and normal skin) varies from 77.33% to 100% on different experiments. The maximum accuracy on wound-class classifications (containing only diabetic, pressure, surgical, and venous) varies from 72.95% to 98.08% on different experiments. The proposed multi-modal network also shows a significant improvement in results from the previous works of literature.

[1]  Chuan Wang,et al.  Recognition of Ischaemia and Infection in Diabetic Foot Ulcers: Dataset and Techniques , 2019, Comput. Biol. Medicine.

[2]  Zeyun Yu,et al.  A Deep Learning Study on Osteosarcoma Detection from Histological Images , 2020, ArXiv.

[3]  C. Sen.  Human Wounds and Its Burden: An Updated Compendium of Estimates. , 2019, Advances in wound care.

[4]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[5]  Dragica Radosav,et al.  Deep Learning and Medical Diagnosis: A Review of Literature , 2018, Multimodal Technol. Interact..

[6]  Murat Kuzlu,et al.  A Highly Transparent and Explainable Artificial Intelligence Tool for Chronic Wound Classification: XAI-CWC , 2021 .

[7]  Zeyun Yu,et al.  A Mobile App for Wound Localization Using Deep Learning , 2020, IEEE Access.

[8]  Omran Al-Shamma,et al.  DFU_QUTNet: diabetic foot ulcer classification using novel deep convolutional neural network , 2019, Multimedia Tools and Applications.

[9]  Varun N. Shenoy,et al.  Deepwound: Automated Postoperative Wound Assessment and Surgical Site Surveillance through Convolutional Neural Networks , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Hassan Ugail,et al.  Can Machine Learning Be Used to Discriminate Between Burns and Pressure Ulcer? , 2019, IntelliSys.

[12]  Zeyun Yu,et al.  Multiclass Wound Image Classification using an Ensemble Deep CNN-based Classifier , 2020, ArXiv.

[13]  Susanne Hempel,et al.  Preventing Pressure Ulcers in Hospitals , 2011 .

[14]  Isaac S Kohane,et al.  Artificial Intelligence in Healthcare , 2019, Artificial Intelligence and Machine Learning for Business for Non-Engineers.

[15]  B. Gillespie,et al.  Setting the surgical wound care agenda across two healthcare districts: A priority setting approach , 2020 .

[16]  G. Tenenbaum,et al.  Metastable Pain-Attention Dynamics during Incremental Exhaustive Exercise , 2017, Front. Psychol..

[17]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[19]  Neil D. Reeves,et al.  DFUNet: Convolutional Neural Networks for Diabetic Foot Ulcer Classification , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[20]  B. Coetzee,et al.  Body Mapping in Research , 2019 .

[21]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Charlotta Aguirre Nilsson,et al.  Classification of ulcer images using convolutional neural networks , 2018 .