Automatic Recognition of the Supraspinatus Tendinopathy from Ultrasound Images using Convolutional Neural Networks

Tendon injuries like tendinopathies, full and partial thickness tears are prevalent, and the supraspinatus tendon (SST) is the most vulnerable ones in the rotator cuff. Early diagnosis of SST tendinopathies is of high importance and hard to achieve using ultrasound imaging. In this paper, an automatic tendinopathy recognition framework based on convolutional neural networks has been proposed to assist the diagnosis. This framework has two essential parts of tendon segmentation and classification. Tendon segmentation is done through a novel network, NASUNet, which follows an encoder-decoder architecture paradigm and utilizes a multi-scale Enlarging cell. Moreover, a general classification pipeline has been proposed for tendinopathy recognition, which supports different base models as the feature extractor engine. Two feature maps comprising positional information of the tendon region have been introduced as the network input to make the classification network spatial-aware. To evaluate the tendinopathy recognition system, a data set consisting of 100 SST ultrasound images have been acquired, in which tendinopathy cases are double-verified by magnetic resonance imaging. In both segmentation and classification tasks, lack of training data has been compensated by incorporating knowledge transferring, transfer learning, and data augmentation techniques. In cross-validation experiments, the proposed tendinopathy recognition model achieves 91% accuracy, 86.67% sensitivity, and 92.86% specificity, showing state-of-the-art performance against other models.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  J. Jacobson Shoulder US: anatomy, technique, and scanning pitfalls. , 2011, Radiology.

[3]  T. Miller,et al.  Imaging of Tendons , 2009, Sports health.

[4]  R. Stevic,et al.  Ultrasonography of tendon abnormalities , 2013 .

[5]  W. Hing,et al.  Classification of Tendon Matrix Change Using Ultrasound Imaging: A Systematic Review and Meta-analysis. , 2018, Ultrasound in medicine & biology.

[6]  Francesco Visin,et al.  A guide to convolution arithmetic for deep learning , 2016, ArXiv.

[7]  A. Scott,et al.  Diagnostic accuracy of ultrasound and MRI for Achilles tendon xanthoma in people with familial hypercholesterolemia: A systematic review. , 2019, Journal of clinical lipidology.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[10]  Marleen de Bruijne,et al.  Transfer Learning Improves Supervised Image Segmentation Across Imaging Protocols , 2015, IEEE Trans. Medical Imaging.

[11]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[12]  Filippo Molinari,et al.  Comparative assessment of texture features for the identification of cancer in ultrasound images: a review , 2018 .

[13]  Babak Mohammadzadeh Asl,et al.  Melanoma recognition in dermoscopy images using lesion's peripheral region information , 2018, Comput. Methods Programs Biomed..

[14]  Nasir Rajpoot,et al.  Nuclear Instance Segmentation Using a Proposal-Free Spatially Aware Deep Learning Framework , 2019, MICCAI.

[15]  R. Chang,et al.  Quantitative diagnosis of rotator cuff tears based on sonographic pattern recognition , 2019, PloS one.

[16]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[17]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Li-Chieh Kuo,et al.  Model-based tendon segmentation from ultrasound images , 2014, 2014 40th Annual Northeast Bioengineering Conference (NEBEC).

[19]  S. Saraya,et al.  Ultrasound: Can it replace MRI in the evaluation of the rotator cuff tears? , 2016 .

[20]  K. Ting,et al.  Tendinopathy: injury, repair, and current exploration , 2018, Drug design, development and therapy.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Ali Gooya,et al.  Leveraging Transfer Learning for Segmenting Lesions and their Attributes in Dermoscopy Images , 2018, ArXiv.

[25]  Ali Gooya,et al.  Supervised Saliency Map Driven Segmentation of Lesions in Dermoscopic Images , 2017, IEEE Journal of Biomedical and Health Informatics.

[26]  Farid Meziane,et al.  Automatic ROI detection and classification of the achilles tendon ultrasound images , 2017, IML.

[27]  Pandian Vasant,et al.  Curvelet based automatic segmentation of supraspinatus tendon from ultrasound image: a focused assistive diagnostic method , 2014, Biomedical engineering online.

[28]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[30]  J. de la Fuente,et al.  Ultrasound classification of traumatic distal biceps brachii tendon injuries , 2017, Skeletal Radiology.

[31]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  N. Maffulli,et al.  Biology of tendon injury: healing, modeling and remodeling. , 2006, Journal of musculoskeletal & neuronal interactions.

[33]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[34]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[36]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Filippo Molinari,et al.  Quantitative analysis of patellar tendon abnormality in asymptomatic professional "Pallapugno" players: a texture-based ultrasound approach , 2018 .

[38]  J. Roy,et al.  Diagnostic accuracy of ultrasonography, MRI and MR arthrography in the characterisation of rotator cuff disorders: a systematic review and meta-analysis , 2015, British Journal of Sports Medicine.