Empirical Quantification and Modeling of Muscle Deformation: Toward Ultrasound-Driven Assistive Device Control * This work was supported by the NSF National Robotics Initiative (award no. 81774), Siemens Healthcare (85993), and the NSF Graduate Research Fellowship Program.

Surface electromyography is currently the sensing modality of choice for control of biosignal-driven prostheses and exoskeletons; however, the sensor's noisy and aggregate nature inhibits collection of distinguishable signal streams to robustly manipulate multiple device degrees of freedom (DoF). We here explore 2D B-mode ultrasound as an alternative source of muscle activation data (namely, muscle deformation) that can be more precisely localized, allowing for the theoretical collection of multiple naturally-varying signals that could be used to control high-DoF assistive devices. We here present a proof-of-concept study showing a) the observability of muscle deformation via ultrasound, and b) novel descriptions of the spatially-varying nature of the signal. These analyses are accomplished through the study of nine volumetric scans of the biceps brachii under varied elbow angle and loading conditions, collected and spatially localized using an ultrasound scanner and motion capture. We here establish the feasibility of measuring several force-associated deformation signals (including muscle cross-sectional area and thickness) via real-time ultrasound scanning and quantify the spatial variation of these signals. Additionally, we propose future applications for both our signal characterizations and the generated muscle volume data set, including better design of assistive device sensor locations and validation of existing muscle deformation models.††A visual summary of the work described can be found in the accompanying video abstract.

[1]  Y. Zheng,et al.  Sonomyography: monitoring morphological changes of forearm muscles in actions with the feasibility for the control of powered prosthesis. , 2006, Medical engineering & physics.

[2]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[3]  Jon G. Rokne,et al.  Modeling and simulating the deformation of human skeletal muscle based on anatomy and physiology , 2005, Comput. Animat. Virtual Worlds.

[4]  Jana Kosecka,et al.  Real-Time Classification of Hand Motions Using Ultrasound Imaging of Forearm Muscles , 2016, IEEE Transactions on Biomedical Engineering.

[5]  Andras Lasso,et al.  Open-source platforms for navigated image-guided interventions , 2016, Medical Image Anal..

[6]  E. J. Jones,et al.  Cross-Sectional Area and Muscular Strength , 2008, Sports medicine.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  J. Mcmeeken,et al.  The relationship between EMG and change in thickness of transversus abdominis. , 2004, Clinical biomechanics.

[9]  J. Gulati,et al.  Tonicity effects on intact single muscle fibers: relation between force and cell volume. , 1982, Science.

[10]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[11]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[12]  Walter R Frontera,et al.  Relationship between force and size in human single muscle fibres , 2011, Experimental physiology.

[13]  Edward D. Lemaire,et al.  Development of a wearable ultrasonic sensor and method for continuous monitoring of mechanical properties of plantar soft tissue for diabetic patients , 2014, 2014 IEEE International Ultrasonics Symposium.

[14]  Andras Lasso,et al.  PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems , 2014, IEEE Transactions on Biomedical Engineering.

[15]  A. Nitz,et al.  Measurement of lumbar multifidus muscle contraction with rehabilitative ultrasound imaging. , 2007, Manual therapy.

[16]  O. Schmitt The heat of shortening and the dynamic constants of muscle , 2017 .

[17]  Claudio Castellini,et al.  Assessment of a Wearable Force- and Electromyography Device and Comparison of the Related Signals for Myocontrol , 2016, Front. Neurorobot..

[18]  Sheng-Wei Chi,et al.  Finite element modeling of passive material influence on the deformation and force output of skeletal muscle. , 2012, Journal of the mechanical behavior of biomedical materials.

[19]  T. Roberts,et al.  Biaxial strain and variable stiffness in aponeuroses , 2009, The Journal of physiology.

[20]  Arie E. Kaufman,et al.  Real‐time Biomechanically‐based Muscle Volume Deformation using FEM , 1998, Comput. Graph. Forum.

[21]  Jessica K. Hodgins,et al.  Data-driven modeling of skin and muscle deformation , 2008, SIGGRAPH 2008.

[22]  Sylvain Calinon,et al.  Combining Electromyography and Tactile Myography to Improve Hand and Wrist Activity Detection in Prostheses , 2017 .

[23]  Brian Wyvill,et al.  Realistic skeletal muscle deformation using finite element analysis , 2001, Proceedings XIV Brazilian Symposium on Computer Graphics and Image Processing.

[24]  Y. Zheng,et al.  Assessment of muscle fatigue using sonomyography: muscle thickness change detected from ultrasound images. , 2007, Medical engineering & physics.

[25]  M. Feng,et al.  Duplex ultrasonic muscle activity sensor , 2005, IEEE Sensors, 2005..

[26]  S. Gandevia,et al.  Measurement of muscle contraction with ultrasound imaging , 2003, Muscle & nerve.

[27]  Katsunori Shimohara,et al.  EMG pattern analysis and classification by neural network , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.