GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn

Burns constitute one of the most common injuries in the world, and they can be very painful for the patient. Especially in the judgment of superficial partial thickness burns and deep partial thickness burns, many inexperienced clinicians are easily confused. Therefore, in order to make burn depth classification automated as well as accurate, we have introduced the deep learning method. This methodology uses a U-Net to segment burn wounds. On this basis, a new thickness burn classification model that fuses global and local features (GL-FusionNet) is proposed. For the thickness burn classification model, we use a ResNet50 to extract local features, use a ResNet101 to extract global features, and finally implement the add method to perform feature fusion and obtain the deep partial or superficial partial thickness burn classification results. Burns images are collected clinically, and they are segmented and labeled by professional physicians. Among the segmentation methods, the U-Net used achieved a Dice score of 85.352 and IoU score of 83.916, which are the best results among all of the comparative experiments. In the classification model, different existing classification networks are mainly used, as well as a fusion strategy and feature extraction method that are adjusted to conduct experiments; the proposed fusion network model also achieved the best results. Our method yielded the following: accuracy of 93.523, recall of 93.67, precision of 93.51, and F1-score of 93.513. In addition, the proposed method can quickly complete the auxiliary diagnosis of the wound in the clinic, which can greatly improve the efficiency of the initial diagnosis of burns and the nursing care of clinical medical staff.

[1]  A. Tagliafico,et al.  Artificial Intelligence in Breast Ultrasound: From Diagnosis to Prognosis—A Rapid Review , 2022, Diagnostics.

[2]  Tahsina Farah Sanam,et al.  A deep convolutional neural network-based approach for detecting burn severity from skin burn images , 2022, Machine Learning with Applications.

[3]  Juanjuan He,et al.  An evolvable adversarial network with gradient penalty for COVID-19 infection segmentation , 2021, Applied Soft Computing.

[4]  F. Siemers,et al.  Burn depth assessment using hyperspectral imaging in a prospective single center study. , 2021, Burns : journal of the International Society for Burn Injuries.

[5]  K. Amin,et al.  Artificial intelligence in the management and treatment of burns: a systematic review , 2021, Burns & trauma.

[6]  W. Hickerson,et al.  Use of 816 consecutive burn wound biopsies to inform a histologic algorithm for burn depth categorization. , 2021, Journal of burn care & research : official publication of the American Burn Association.

[7]  Saurabh Malhotra,et al.  Automatic extraction and stenosis evaluation of coronary arteries in invasive coronary angiograms , 2021, Comput. Biol. Medicine.

[8]  Jingfeng Jiang,et al.  Progressive global perception and local polishing network for lung infection segmentation of COVID-19 CT images , 2021, Pattern Recognition.

[9]  Jinshan Tang,et al.  MDC-net: A new convolutional neural network for nucleus segmentation in histopathology images with distance maps and contour information , 2021, Comput. Biol. Medicine.

[10]  Brice Anicet Mezatio,et al.  Biomedical Image Classification in a Big Data Architecture Using Machine Learning Algorithms , 2021, Journal of healthcare engineering.

[11]  Wen J. Li,et al.  A Framework for Automatic Burn Image Segmentation and Burn Depth Diagnosis Using Deep Learning , 2021, Comput. Math. Methods Medicine.

[12]  F. Sjöberg,et al.  Improving burn depth assessment for pediatric scalds by AI based on semantic segmentation of polarized light photography images. , 2021, Burns : journal of the International Society for Burn Injuries.

[13]  C. Pabitha,et al.  Densemask RCNN: A Hybrid Model for Skin Burn Image Classification and Severity Grading , 2020, Neural Processing Letters.

[14]  Hassan Ugail,et al.  Burns Depth Assessment Using Deep Learning Features , 2020, Journal of Medical and Biological Engineering.

[15]  A. Grumezescu,et al.  Hydrogel Dressings for the Treatment of Burn Wounds: An Up-To-Date Overview , 2020, Materials.

[16]  Rahul,et al.  Real-time Burn Classification using Ultrasound Imaging , 2020, Scientific Reports.

[17]  Ugur Sevik,et al.  Automatic classification of skin burn colour images using texture-based feature extraction , 2019, IET Image Process..

[18]  Weiguo Xie,et al.  Burn image segmentation based on Mask Regions with Convolutional Neural Network deep learning framework: more accurate and more convenient , 2019, Burns & Trauma.

[19]  P. Maitz,et al.  Burn injury: Challenges and advances in burn wound healing, infection, pain and scarring , 2018, Advanced drug delivery reviews.

[20]  Thuy Thanh Nguyen,et al.  Real Time Burning Image Classification Using Support Vector Machine , 2017, EAI Endorsed Trans. Context aware Syst. Appl..

[21]  Bernard Choi,et al.  Acute discrimination between superficial-partial and deep-partial thickness burns in a preclinical model with laser speckle imaging. , 2015, Burns : journal of the International Society for Burn Injuries.

[22]  B. Depreitere,et al.  The biomechanical behaviour of the bridging vein-superior sagittal sinus complex with implications for the mechanopathology of acute subdural haematoma. , 2014, Journal of the mechanical behavior of biomedical materials.

[23]  M. Peck Epidemiology of burns throughout the world. Part I: Distribution and risk factors. , 2011, Burns : journal of the International Society for Burn Injuries.

[24]  D. Herndon,et al.  Long-Term Persistance of the Pathophysiologic Response to Severe Burn Injury , 2011, PloS one.

[25]  Phillip Blondeel,et al.  Assessment of burn depth and burn wound healing potential. , 2008, Burns : journal of the International Society for Burn Injuries.

[26]  S. Hettiaratchy,et al.  Initial management of a major burn: II—assessment and resuscitation , 2004, BMJ : British Medical Journal.