Tissue classification and segmentation of pressure injuries using convolutional neural networks

BACKGROUND AND OBJECTIVES This paper presents a new approach for automatic tissue classification in pressure injuries. These wounds are localized skin damages which need frequent diagnosis and treatment. Therefore, a reliable and accurate systems for segmentation and tissue type identification are needed in order to achieve better treatment results. METHODS Our proposed system is based on a Convolutional Neural Network (CNN) devoted to performing optimized segmentation of the different tissue types present in pressure injuries (granulation, slough, and necrotic tissues). A preprocessing step removes the flash light and creates a set of 5x5 sub-images which are used as input for the CNN network. The network output will classify every sub-image of the validation set into one of the three classes studied. RESULTS The metrics used to evaluate our approach show an overall average classification accuracy of 92.01%, an average total weighted Dice Similarity Coefficient of 91.38%, and an average precision per class of 97.31% for granulation tissue, 96.59% for necrotic tissue, and 77.90% for slough tissue. CONCLUSIONS Our system has been proven to make recognition of complicated structures in biomedical images feasible.

[1]  P. Cattin,et al.  Multi-dimensional Gated Recurrent Units for the Segmentation of Biomedical 3D-Data , 2016, LABELS/DLMIA@MICCAI.

[2]  Nico Karssemeijer,et al.  Non-uniform patch sampling with deep convolutional neural networks for white matter hyperintensity segmentation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[3]  Stephen Lin,et al.  Automatic Feature Learning to Grade Nuclear Cataracts Based on Deep Learning , 2014, IEEE Transactions on Biomedical Engineering.

[4]  Agma J. M. Traina,et al.  Color and Texture Influence on Computer-Aided Diagnosis of Dermatological Ulcers , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[5]  Hayit Greenspan,et al.  Longitudinal Multiple Sclerosis Lesion Segmentation Using Multi-view Convolutional Neural Networks , 2016, LABELS/DLMIA@MICCAI.

[6]  M. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network. , 2016, IEEE transactions on medical imaging.

[7]  V. Rajinikanth,et al.  Otsu based optimal multilevel image thresholding using firefly algorithm , 2014 .

[8]  Jürgen Schmidhuber,et al.  Parallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation , 2015, NIPS.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Daniel Sierra-Sosa,et al.  Pressure ulcer image segmentation technique through synthetic frequencies generation and contrast variation using toroidal geometry , 2017, Biomedical engineering online.

[11]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[12]  Huazhu Fu,et al.  Retinal vessel segmentation via deep learning network and fully-connected conditional random fields , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[13]  Chandan Chakraborty,et al.  Automated Tissue Classification Framework for Reproducible Chronic Wound Assessment , 2014, BioMed research international.

[14]  R. Guadagnin,et al.  An image mining based approach to detect pressure ulcer stage , 2014, Pattern Recognition and Image Analysis.

[15]  Paul Anthony Iaizzo,et al.  Wound status evaluation using color image processing , 1997, IEEE Transactions on Medical Imaging.

[16]  Mingchen Gao,et al.  Deep vessel tracking: A generalized probabilistic approach via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[17]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[18]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[19]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[20]  Honglak Lee,et al.  A unified framework for automatic wound segmentation and analysis with deep convolutional neural networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Joachim M. Buhmann,et al.  Glaucoma detection using entropy sampling and ensemble learning for automatic optic cup and disc segmentation , 2017, Comput. Medical Imaging Graph..

[22]  Ghassan Hamarneh,et al.  Multi-resolution-Tract CNN with Hybrid Pretrained and Skin-Lesion Trained Layers , 2016, MLMI@MICCAI.

[23]  Elena Marchiori,et al.  Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities , 2016, Scientific Reports.

[24]  Georgia D. Tourassi,et al.  Self-organizing maps for masking mammography images , 2003, 4th International IEEE EMBS Special Topic Conference on Information Technology Applications in Biomedicine, 2003..

[25]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[26]  Denis Anthony,et al.  Pressure Ulcers Prevalence in the Acute Care Setting: A Systematic Review, 2000-2015 , 2018, Clinical nursing research.

[27]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[28]  Mohammad Havaei,et al.  HeMIS: Hetero-Modal Image Segmentation , 2016, MICCAI.

[29]  Begoña García Zapirain,et al.  Blue-white veil and dark-red patch of pigment pattern recognition in dermoscopic images using machine-learning techniques , 2011, 2011 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[30]  B. Turner,et al.  A Non-Contact Imaging-Based Approach to Detecting Stage I Pressure Ulcers , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[32]  B Nila Mankar,et al.  COMPARISION OF DIFFERENT IMAGING TECHNIQUES USED FOR CHRONIC WOUNDS , 2013 .

[33]  Rafael Marcos Luque Baena,et al.  Wound image evaluation with machine learning , 2015, Neurocomputing.

[34]  Stephen Lin,et al.  DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field , 2016, MICCAI.

[35]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.