Automated semi-real-time detection of muscle activity with ultrasound imaging

Ultrasound imaging (USI) biofeedback is a useful therapeutic tool; however, it relies on qualitative assessment by a trained therapist, while existing automatic analysis techniques are computationally demanding. This study aims to present a computationally inexpensive algorithm based on the difference in pixel intensity between USI frames. During an offline experiment, where data was analyzed after the study, participants performed isometric contractions of the gastrocnemius medialis (GM) muscle, as executed (30% of maximum contraction) or attempted (low force contraction up to a point when the participant is aware of exerting force or contracting the muscle) movements, while USI, EMG, and force data were recorded. The algorithm achieved 99% agreement with EMG and force measurements for executed movements and 93% for attempted movements, with USI detecting 1.9% more contractions than the other methods. In the online study, participants performed GM muscle contractions at 10% and 30% of maximum contraction, while the algorithm provided visual feedback proportional to the muscle activity (based on USI recordings during the maximum contraction) in less than 3 s following each contraction. We show that the participants reached the target consistently, learning to perform precise contractions. The algorithm is reliable and computationally very efficient, allowing real-time applications on standard computing hardware. It is a suitable method for automated detection, quantification of muscle contraction, and to provide biofeedback which can be used for training of targeted muscles, making it suitable for rehabilitation. Graphical abstract Biofeedback session based on ultrasound imaging (USI) during muscle training. Novel, computationally inexpensive algorithm based on the difference in pixel intensity between USI frames is used to process the video and provide quantitative feedback on the strength of muscle contraction.

[1]  R. P. Fabio Reliability of computerized surface electromyography for determining the onset of muscle activity. , 1987 .

[2]  T. Fukunaga,et al.  Determination of fascicle length and pennation in a contracting human muscle in vivo. , 1997, Journal of applied physiology.

[3]  Steven W. Smith,et al.  The Scientist and Engineer's Guide to Digital Signal Processing , 1997 .

[4]  Constantinos N. Maganaris,et al.  Ultrasonographic assessment of human skeletal muscle size , 2003, European Journal of Applied Physiology.

[5]  S. Gandevia,et al.  Measurement of muscle contraction with ultrasound imaging , 2003, Muscle & nerve.

[6]  S. Henry,et al.  The use of real-time ultrasound feedback in teaching abdominal hollowing exercises to healthy subjects. , 2005, The Journal of orthopaedic and sports physical therapy.

[7]  Vasilios Baltzopoulos,et al.  Human calf muscle responses during repeated isometric plantarflexions. , 2006, Journal of biomechanics.

[8]  Machiel J Zwarts,et al.  Skeletal muscle ultrasonography: Visual versus quantitative evaluation. , 2006, Ultrasound in medicine & biology.

[9]  Preliminary Study of Skeletal Muscle with Multi-signals during Isometric Contraction , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Ian David Loram,et al.  Use of ultrasound to make noninvasive in vivo measurement of continuous changes in human muscle contractile length. , 2006, Journal of applied physiology.

[11]  K. C. McGill,et al.  Surface electromyogram signal modelling , 2004, Medical and Biological Engineering and Computing.

[12]  Y. Zheng,et al.  Sonomyography: monitoring morphological changes of forearm muscles in actions with the feasibility for the control of powered prosthesis. , 2006, Medical engineering & physics.

[13]  J. L. Whittaker,et al.  Rehabilitative ultrasound imaging: understanding the technology and its applications. , 2007, The Journal of orthopaedic and sports physical therapy.

[14]  G. Lichtwark,et al.  Muscle fascicle and series elastic element length changes along the length of the human gastrocnemius during walking and running. , 2007, Journal of biomechanics.

[15]  S. Henry,et al.  Ultrasound imaging as a feedback tool in the rehabilitation of trunk muscle dysfunction for people with low back pain. , 2007, The Journal of orthopaedic and sports physical therapy.

[16]  Jing-Yi Guo,et al.  Dynamic monitoring of forearm muscles using one-dimensional sonomyography system. , 2008, Journal of rehabilitation research and development.

[17]  J. Loss,et al.  Torque and force production during shoulder external rotation: differences between transverse and sagittal planes. , 2008, Journal of applied biomechanics.

[18]  Ghassan Hamarneh,et al.  Automated Tracking of Muscle Fascicle Orientation in B-mode Ultrasound Images , 2022 .

[19]  Takashi Komeda,et al.  Automatic detection method of muscle fiber movement as revealed by ultrasound images. , 2009, Medical engineering & physics.

[20]  V Reggie Edgerton,et al.  In vivo intramuscular fascicle-aponeuroses dynamics of the human medial gastrocnemius during plantarflexion and dorsiflexion of the foot. , 2009, Journal of applied physiology.

[21]  J. Fritz,et al.  Rehabilitative ultrasound imaging is a valid measure of trunk muscle size and activation during most isometric sub-maximal contractions: a systematic review. , 2009, The Australian journal of physiotherapy.

[22]  Neil J Cronin,et al.  Automatic tracking of medial gastrocnemius fascicle length during human locomotion. , 2011, Journal of applied physiology.

[23]  S. Pillen,et al.  Skeletal muscle ultrasound , 2010, Neurological research.

[24]  Elizabeth S. Chumanov,et al.  Low back and hip pain in a postpartum runner: applying ultrasound imaging and running analysis. , 2012, The Journal of orthopaedic and sports physical therapy.

[25]  Yong-Ping Zheng,et al.  Human motion analysis with ultrasound and sonomyography , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  John Darby,et al.  Automated regional analysis of B-mode ultrasound images of skeletal muscle movement , 2011, Journal of applied physiology.

[27]  D. Farina,et al.  Precise temporal association between cortical potentials evoked by motor imagination and afference induces cortical plasticity , 2012, The Journal of physiology.

[28]  Yongjin Zhou,et al.  Dynamic measurement of pennation angle of gastrocnemius muscles during contractions based on ultrasound imaging , 2012, Biomedical engineering online.

[29]  Jarred G Gillett,et al.  Reliability and accuracy of an automated tracking algorithm to measure controlled passive and active muscle fascicle length changes from ultrasound , 2013, Computer methods in biomechanics and biomedical engineering.

[30]  Todd Watson,et al.  Training of Transversus Abdominis Activation in the Supine Position With Ultrasound Biofeedback Translated to Increased Transversus Abdominis Activation During Upright Loaded Functional Tasks , 2014, PM & R : the journal of injury, function, and rehabilitation.

[31]  Jin-Hee Kim,et al.  The Effects of Precise Contraction of the Pelvic Floor Muscle Using Visual Feedback on the Stabilization of the Lumbar Region , 2014, Journal of physical therapy science.

[32]  Roger Gassert,et al.  Improvement in precision grip force control with self-modulation of primary motor cortex during motor imagery , 2015, Front. Behav. Neurosci..

[33]  Yong-Ping Zheng,et al.  Automatic measurement of pennation angle and fascicle length of gastrocnemius muscles using real-time ultrasound imaging. , 2015, Ultrasonics.

[34]  Jens Frahm,et al.  Training Efficiency and Transfer Success in an Extended Real-Time Functional MRI Neurofeedback Training of the Somatomotor Cortex of Healthy Subjects , 2015, Front. Hum. Neurosci..

[35]  Dominic James Farris,et al.  UltraTrack: Software for semi-automated tracking of muscle fascicles in sequences of B-mode ultrasound images , 2016, Comput. Methods Programs Biomed..

[36]  Ian Loram,et al.  Real-Time Ultrasound Segmentation, Analysis and Visualisation of Deep Cervical Muscle Structure , 2017, IEEE Transactions on Medical Imaging.

[37]  Derek G. Kamper,et al.  Automatic Detection of Contracting Muscle Regions via the Deformation Field of Transverse Ultrasound Images: A Feasibility Study , 2020, Annals of Biomedical Engineering.