Real-Time Ultrasound Segmentation, Analysis and Visualisation of Deep Cervical Muscle Structure

Despite widespread availability of ultrasound and a need for personalised muscle diagnosis (neck/back pain-injury, work related disorder, myopathies, neuropathies), robust, online segmentation of muscles within complex groups remains unsolved by existing methods. For example, Cervical Dystonia (CD) is a prevalent neurological condition causing painful spasticity in one or multiple muscles in the cervical muscle system. Clinicians currently have no method for targeting/monitoring treatment of deep muscles. Automated methods of muscle segmentation would enable clinicians to study, target, and monitor the deep cervical muscles via ultrasound. We have developed a method for segmenting five bilateral cervical muscles and the spine via ultrasound alone, in real-time. Magnetic Resonance Imaging (MRI) and ultrasound data were collected from 22 participants (age: 29.0±6.6, male: 12). To acquire ultrasound muscle segment labels, a novel multimodal registration method was developed, involving MRI image annotation, and shape registration to MRI-matched ultrasound images, via approximation of the tissue deformation. We then applied polynomial regression to transform our annotations and textures into a mean space, before using shape statistics to generate a texture-to-shape dictionary. For segmentation, test images were compared to dictionary textures giving an initial segmentation, and then we used a customized Active Shape Model to refine the fit. Using ultrasound alone, on unseen participants, our technique currently segments a single image in ${\approx } 0.45\text {s}$ to over 86% accuracy (Jaccard index). We propose this approach is applicable generally to segment, extrapolate and visualise deep muscle structure, and analyse statistical features online.

[1]  Alex Burdorf,et al.  Conservative interventions for treating work-related complaints of the arm, neck or shoulder in adults. , 2013, The Cochrane database of systematic reviews.

[2]  Susana Quijano-Roy,et al.  Whole body muscle MRI protocol: Pattern recognition in early onset NM disorders , 2012, Neuromuscular Disorders.

[3]  Bala Krishnamoorthy,et al.  Neck muscle paths and moment arms are significantly affected by wrapping surface parameters , 2012, Computer methods in biomechanics and biomedical engineering.

[4]  K. Türker,et al.  Electromyography: some methodological problems and issues. , 1993, Physical therapy.

[5]  Ryan Cunningham The application of b-mode ultrasonography for analysis of human skeletal muscle , 2015 .

[6]  Scott L. Delp,et al.  Three-dimensional spatial tuning of neck muscle activation in humans , 2002, Experimental Brain Research.

[7]  G. Loeb,et al.  Real‐time sonography to estimate muscle thickness: Comparison with MRI and CT , 2001, Journal of clinical ultrasound : JCU.

[8]  N. Paragios A level set approach for shape-driven segmentation and tracking of the left ventricle , 2003, IEEE Transactions on Medical Imaging.

[9]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Pina Marziliano,et al.  Speckle Patch Similarity for Echogenicity-Based Multiorgan Segmentation in Ultrasound Images of the Thyroid Gland , 2017, IEEE Journal of Biomedical and Health Informatics.

[11]  Timothy F. Cootes,et al.  Comparing Active Shape Models with Active Appearance Models , 1999, BMVC.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  M Acar,et al.  Viscoelastic finite element analysis of the cervical intervertebral discs in conjunction with a multi-body dynamic model of the human head and neck , 2009, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[14]  Eric Achten,et al.  The use of functional MRI to evaluate cervical flexor activity during different cervical flexion exercises. , 2008, Journal of applied physiology.

[15]  Alessandro Sarti,et al.  Left ventricular volume estimation for real-time three-dimensional echocardiography , 2002, IEEE Transactions on Medical Imaging.

[16]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[17]  Ben Glocker,et al.  Joint Classification-Regression Forests for Spatially Structured Multi-object Segmentation , 2012, ECCV.

[18]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[19]  Coert Metz,et al.  Segmentation of multiple heart cavities in 3-D transesophageal ultrasound images , 2015, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[20]  D. Urquhart,et al.  Ergonomic design and training for preventing work-related musculoskeletal disorders of the upper limb and neck in adults. , 2012, The Cochrane database of systematic reviews.

[21]  Eythor Kristjansson,et al.  Reliability of ultrasonography for the cervical multifidus muscle in asymptomatic and symptomatic subjects. , 2004, Manual therapy.

[22]  M. Revel,et al.  Surface electrodes are not appropriate to record selective myoelectric activity of splenius capitis muscle in humans , 2004, Experimental Brain Research.

[23]  James S. Duncan,et al.  Combinative Multi-scale Level Set Framework for Echocardiographic Image Segmentation , 2002, MICCAI.

[24]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  John Darby,et al.  Automated regional analysis of B-mode ultrasound images of skeletal muscle movement , 2011, Journal of applied physiology.

[26]  M Stokes,et al.  Size and shape of the posterior neck muscles measured by ultrasound imaging: normal values in males and females of different ages. , 2005, Manual therapy.

[27]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[28]  Elsa D. Angelini,et al.  State of the Art of Level Set Methods in Segmentation and Registration of Medical Imaging Modalities , 2005 .

[29]  L Kinzl,et al.  Guidelines for the intramuscular positioning of EMG electrodes in the semispinalis capitis and cervicis muscles. , 2003, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[30]  Dorin Comaniciu,et al.  Automatic Detection and Measurement of Structures in Fetal Head Ultrasound Volumes Using Sequential Estimation and Integrated Detection Network (IDN) , 2014, IEEE Transactions on Medical Imaging.

[31]  Seward B. Rutkove,et al.  Quantifying muscle asymmetries in cervical dystonia with electrical impedance: A preliminary assessment , 2011, Clinical Neurophysiology.

[32]  Yio-Wha Shau,et al.  Measurement of segmental cervical multifidus contraction by ultrasonography in asymptomatic adults. , 2007, Manual therapy.

[33]  Carolyn M. Sommerich,et al.  Use of surface electromyography to estimate neck muscle activity. , 2000, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[34]  Jun Xie,et al.  Segmentation of kidney from ultrasound images based on texture and shape priors , 2005, IEEE Transactions on Medical Imaging.

[35]  Rachelle Buchbinder,et al.  The global burden of low back pain: estimates from the Global Burden of Disease 2010 study , 2014, Annals of the rheumatic diseases.

[36]  Maja Pantic,et al.  Optimization Problems for Fast AAM Fitting in-the-Wild , 2013, 2013 IEEE International Conference on Computer Vision.

[37]  F. Richmond,et al.  Morphometry of Human Neck Muscles , 1998, Spine.

[38]  Yio-Wha Shau,et al.  Measurement of cervical multifidus contraction pattern with ultrasound imaging. , 2009, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[39]  Gustavo Carneiro,et al.  The Segmentation of the Left Ventricle of the Heart From Ultrasound Data Using Deep Learning Architectures and Derivative-Based Search Methods , 2012, IEEE Transactions on Image Processing.

[40]  Asghar Rezasoltani,et al.  Ultrasonography of the cervical muscles: a critical review of the literature. , 2010, Journal of manipulative and physiological therapeutics.

[41]  Silke Brinkmann,et al.  Methodological considerations of ultrasound-guided spinal anesthesia using the Ultrasonix GPS™ needle tracking system , 2013, Canadian Journal of Anesthesia/Journal canadien d'anesthésie.

[42]  Daniel Cremers,et al.  Efficient Kernel Density Estimation of Shape and Intensity Priors for Level Set Segmentation , 2005, MICCAI.