Closing the loop between wearable technology and human biology: a new paradigm for steering neuromuscular form and function

Wearable technologies such as bionic limbs, robotic exoskeletons and neuromodulation devices have long been designed with the goal of enhancing human movement. However, current technologies have shown only modest results in healthy individuals and limited clinical impact. A central element hampering progress is that wearable technologies do not interact directly with tissues in the composite neuromuscular system. That is, current wearable systems do not take into account how biological targets (e.g. joints, tendons, muscles, nerves) react to mechanical or electrical stimuli, especially at extreme ends of the spatiotemporal scale (e.g. cell growth over months or years). Here, we outline a framework for ‘closing-the-loop’ between wearable technology and human biology. We envision a new class of wearable systems that will be classified as ‘steering devices’ rather than ‘assistive devices’ and outline the suggested research roadmap for the next 10–15 years. Wearable systems that steer, rather than assist, should be capable of delivering coordinated electro-mechanical stimuli to alter, in a controlled way, neuromuscular tissue form and function over time scales ranging from seconds (e.g. a movement cycle) to months (e.g. recovery stage following neuromuscular injuries) and beyond (e.g. across ageing stages). With an emphasis on spinal cord electrical stimulation and exosuits for the lower extremity, we explore developments in three key directions: (a) recording neuromuscular cellular activity from the intact moving human in vivo, (b) predicting tissue function and adaptation in response to electro-mechanical stimuli over time and (c) controlling tissue form and function with enough certainty to induce targeted, positive changes in the future. We discuss how this framework could restore, maintain or augment human movement and set the course for a new era in the development of bioprotective wearable devices. That is, devices designed to directly respond to biological cues to maintain integrity of underlying physiological systems over the lifespan.

[1]  Fabien B. Wagner,et al.  Targeted neurotechnology restores walking in humans with spinal cord injury , 2018, Nature.

[2]  E. Bizzi,et al.  Muscle synergy patterns as physiological markers of motor cortical damage , 2012, Proceedings of the National Academy of Sciences.

[3]  Robert D. Howe,et al.  Automated detection of soleus concentric contraction in variable gait conditions for improved exosuit control , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Dario Farina,et al.  Modeling and simulating the neuromuscular mechanisms regulating ankle and knee joint stiffness during human locomotion. , 2015, Journal of neurophysiology.

[5]  Ellen Kuhl,et al.  Use it or lose it: multiscale skeletal muscle adaptation to mechanical stimuli , 2014, Biomechanics and Modeling in Mechanobiology.

[6]  Dario Farina,et al.  Hybrid neuromusculoskeletal modeling to best track joint moments using a balance between muscle excitations derived from electromyograms and optimization. , 2014, Journal of biomechanics.

[7]  Katherine M Steele,et al.  Muscle recruitment and coordination with an ankle exoskeleton. , 2017, Journal of biomechanics.

[8]  Dario Farina,et al.  Control of Spinal Motoneurons by Feedback From a Non-Invasive Real-Time Interface , 2020, IEEE Transactions on Biomedical Engineering.

[9]  Jeremy D Wong,et al.  Control of position and movement is simplified by combined muscle spindle and Golgi tendon organ feedback. , 2013, Journal of neurophysiology.

[10]  Omer Inan,et al.  Fit to Burst: Toward Noninvasive Estimation of Achilles Tendon Load Using Burst Vibrations , 2020, IEEE Transactions on Biomedical Engineering.

[11]  J. B. Davidson,et al.  A Physiologically Based, Multi-Scale Model of Skeletal Muscle Structure and Function , 2012, Front. Physio..

[12]  André Fabio Kohn,et al.  Spinal Mechanisms May Provide a Combination of Intermittent and Continuous Control of Human Posture: Predictions from a Biologically Based Neuromusculoskeletal Model , 2014, PLoS Comput. Biol..

[13]  N. Smania,et al.  Combined effects of transcranial direct current stimulation (tDCS) and transcutaneous spinal direct current stimulation (tsDCS) on robot-assisted gait training in patients with chronic stroke: A pilot, double blind, randomized controlled trial. , 2015, Restorative neurology and neuroscience.

[14]  Scott L Delp,et al.  Microendoscopy reveals positive correlation in multiscale length changes and variable sarcomere lengths across different regions of human muscle. , 2018, Journal of applied physiology.

[15]  H. Scherberger,et al.  Musculoskeletal Representation of a Large Repertoire of Hand Grasping Actions in Primates , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Seungmoon Song,et al.  A neural circuitry that emphasizes spinal feedback generates diverse behaviours of human locomotion , 2015, The Journal of physiology.

[17]  Gregory S. Sawicki,et al.  Reducing the energy cost of human walking using an unpowered exoskeleton , 2015, Nature.

[18]  Kevin W. Young,et al.  Resonant reflection spectroscopy of biomolecular arrays in muscle. , 2014, Biophysical journal.

[19]  D. Farina,et al.  Multi-channel intramuscular and surface EMG decomposition by convolutive blind source separation , 2016, Journal of neural engineering.

[20]  S. Delp,et al.  Musculoskeletal modelling deconstructs the paradoxical effects of elastic ankle exoskeletons on plantar-flexor mechanics and energetics during hopping , 2014, Journal of Experimental Biology.

[21]  Damjan Zazula,et al.  Real-Time Motor Unit Identification From High-Density Surface EMG , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  R. Stein,et al.  Changes in firing rate of human motor units during linearly changing voluntary contractions , 1973, The Journal of physiology.

[23]  Dario Farina,et al.  A dynamically consistent model of a motorized ankle-foot orthosis , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[24]  Dario Farina,et al.  Man/machine interface based on the discharge timings of spinal motor neurons after targeted muscle reinnervation , 2017, Nature Biomedical Engineering.

[25]  Xiaogang Hu,et al.  Real-time isometric finger extension force estimation based on motor unit discharge information , 2019, Journal of neural engineering.

[26]  Silvia Muceli,et al.  Deep Learning for Robust Decomposition of High-Density Surface EMG Signals , 2020, IEEE Transactions on Biomedical Engineering.

[27]  Ghassan Hamarneh,et al.  Automated Tracking of Muscle Fascicle Orientation in B-mode Ultrasound Images , 2022 .

[28]  Silvia Muceli,et al.  A high-density surface EMG framework for the study of motor neurons controlling the intrinsic and extrinsic muscles of the hand , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  Dominic J Farris,et al.  More is not always better: modeling the effects of elastic exoskeleton compliance on underlying ankle muscle–tendon dynamics , 2014, Bioinspiration & biomimetics.

[30]  C. Zaidman,et al.  Skeletal muscle imaging in neuromuscular disease , 2016, Journal of Clinical Neuroscience.

[31]  Jim R. Potvin,et al.  A motor unit-based model of muscle fatigue , 2017, PLoS Comput. Biol..

[32]  Winfried Mayr,et al.  Modification of spasticity by transcutaneous spinal cord stimulation in individuals with incomplete spinal cord injury , 2014, The journal of spinal cord medicine.

[33]  Enrico Pagello,et al.  Modeling the Human Knee for Assistive Technologies , 2012, IEEE Transactions on Biomedical Engineering.

[34]  Massimo Sartori,et al.  In Vivo Neuromechanics: Decoding Causal Motor Neuron Behavior with Resulting Musculoskeletal Function , 2017, Scientific Reports.

[35]  Michael L Boninger,et al.  Personalized neuromusculoskeletal modeling to improve treatment of mobility impairments: a perspective from European research sites , 2012, Journal of NeuroEngineering and Rehabilitation.

[36]  Samuel R. Hamner,et al.  Muscle contributions to fore-aft and vertical body mass center accelerations over a range of running speeds. , 2013, Journal of biomechanics.

[37]  Darryl G Thelen,et al.  Imaging and simulation of Achilles tendon dynamics: Implications for walking performance in the elderly. , 2016, Journal of biomechanics.

[38]  Dario Farina,et al.  Robust Real-Time Musculoskeletal Modeling Driven by Electromyograms , 2018, IEEE Transactions on Biomedical Engineering.

[39]  Ian David Loram,et al.  Use of ultrasound to make noninvasive in vivo measurement of continuous changes in human muscle contractile length. , 2006, Journal of applied physiology.

[40]  Darryl G. Thelen,et al.  Gauging force by tapping tendons , 2018, Nature Communications.

[41]  Simon A. Overduin,et al.  Microstimulation Activates a Handful of Muscle Synergies , 2012, Neuron.

[42]  E. Bizzi,et al.  Article history: , 2005 .

[43]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[44]  S. Schultz Principles of Neural Science, 4th ed. , 2001 .

[45]  A. Holobar,et al.  Motor Unit Identification From High-Density Surface Electromyograms in Repeated Dynamic Muscle Contractions , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Madalina Fiterau,et al.  Machine learning in human movement biomechanics: Best practices, common pitfalls, and new opportunities. , 2018, Journal of biomechanics.

[47]  Rachel W Jackson,et al.  Muscle–tendon mechanics explain unexpected effects of exoskeleton assistance on metabolic rate during walking , 2017, Journal of Experimental Biology.

[48]  D. Farina,et al.  The human motor neuron pools receive a dominant slow‐varying common synaptic input , 2016, The Journal of physiology.

[49]  Marcus G Pandy,et al.  A neuromusculoskeletal tracking method for estimating individual muscle forces in human movement. , 2007, Journal of biomechanics.

[50]  Stacie A. Chvatal,et al.  Common muscle synergies for balance and walking , 2013, Front. Comput. Neurosci..

[51]  Max Ortiz-Catalan,et al.  An osseointegrated human-machine gateway for long-term sensory feedback and motor control of artificial limbs , 2014, Science Translational Medicine.

[52]  Ken Endo,et al.  A Model of Muscle–Tendon Function in Human Walking at Self-Selected Speed , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  Jonas Rubenson,et al.  A conceptual framework for computational models of Achilles tendon homeostasis , 2013, Wiley interdisciplinary reviews. Systems biology and medicine.

[54]  Ian D. Loram,et al.  Estimation of absolute states of human skeletal muscle via standard B-mode ultrasound imaging and deep convolutional neural networks , 2019, Journal of the Royal Society Interface.

[55]  T. Wren,et al.  A computational model for the adaptation of muscle and tendon length to average muscle length and minimum tendon strain. , 2003, Journal of biomechanics.

[56]  David G. Lloyd,et al.  Muscle activity is different for humans performing static tasks which require force control and position control , 1995, Neuroscience Letters.

[57]  Dario Farina,et al.  Common Synaptic Input to Motor Neurons, Motor Unit Synchronization, and Force Control , 2015, Exercise and sport sciences reviews.

[58]  T. Sinkjaer,et al.  Spastic movement disorder: impaired reflex function and altered muscle mechanics , 2007, The Lancet Neurology.

[59]  Dominic James Farris,et al.  UltraTrack: Software for semi-automated tracking of muscle fascicles in sequences of B-mode ultrasound images , 2016, Comput. Methods Programs Biomed..

[60]  D. Lloyd,et al.  An EMG-driven musculoskeletal model to estimate muscle forces and knee joint moments in vivo. , 2003, Journal of biomechanics.

[61]  S. Blemker,et al.  Computational Modeling of Muscle Regeneration and Adaptation to Advance Muscle Tissue Regeneration Strategies , 2016, Cells Tissues Organs.

[62]  G. Loeb,et al.  Mathematical models of proprioceptors. II. Structure and function of the Golgi tendon organ. , 2006, Journal of neurophysiology.

[63]  Rachel W Jackson,et al.  Human-in-the-loop optimization of exoskeleton assistance during walking , 2017, Science.

[64]  Massimo Sartori,et al.  Subject-specific knee joint geometry improves predictions of medial tibiofemoral contact forces. , 2013, Journal of biomechanics.

[65]  Dario Farina,et al.  EMG-Driven Forward-Dynamic Estimation of Muscle Force and Joint Moment about Multiple Degrees of Freedom in the Human Lower Extremity , 2012, PloS one.

[66]  Elliott J. Rouse,et al.  Mapping the relationships between joint stiffness, modeled muscle stiffness, and shear wave velocity. , 2020, Journal of applied physiology.

[67]  Kelly A. Tennant Thinking outside the brain: Structural plasticity in the spinal cord promotes recovery from cortical stroke , 2014, Experimental Neurology.

[68]  Jonathan S. Zia,et al.  Machine learning to extract muscle fascicle length changes from dynamic ultrasound images in real-time , 2021, bioRxiv.

[69]  G. Loeb,et al.  Mathematical models of proprioceptors. I. Control and transduction in the muscle spindle. , 2006, Journal of neurophysiology.

[70]  Massimo Sartori,et al.  Estimation of musculotendon kinematics in large musculoskeletal models using multidimensional B-splines. , 2012, Journal of biomechanics.

[71]  Jeffrey W Holmes,et al.  Multiscale computational model of Achilles tendon wound healing: Untangling the effects of repair and loading , 2018, PLoS Comput. Biol..

[72]  J. Buitenweg,et al.  Interfacing With Alpha Motor Neurons in Spinal Cord Injury Patients Receiving Trans-spinal Electrical Stimulation , 2020, Frontiers in Neurology.

[73]  Gregory S. Sawicki,et al.  A Simple Model to Estimate Plantarflexor Muscle–Tendon Mechanics and Energetics During Walking With Elastic Ankle Exoskeletons , 2016, IEEE Transactions on Biomedical Engineering.

[74]  Aaron J. Young,et al.  The exoskeleton expansion: improving walking and running economy , 2020, Journal of NeuroEngineering and Rehabilitation.

[75]  Rebecca L. Krupenevich,et al.  Automated Analysis of Medial Gastrocnemius Muscle-Tendon Junction Displacements During Isolated Contractions and Walking Using Deep Neural Networks , 2020, bioRxiv.

[76]  Jure Leskovec,et al.  The mobilize center: an NIH big data to knowledge center to advance human movement research and improve mobility , 2015, J. Am. Medical Informatics Assoc..

[77]  S. Delp,et al.  Image‐based musculoskeletal modeling: Applications, advances, and future opportunities , 2007, Journal of magnetic resonance imaging : JMRI.

[78]  S. Blemker,et al.  Agent-based model illustrates the role of the microenvironment in regeneration in healthy and mdx skeletal muscle. , 2018, Journal of applied physiology.

[79]  Emilio Bizzi,et al.  Shared and specific muscle synergies in natural motor behaviors. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[80]  R. W. Nuckols,et al.  Ultrasound imaging links soleus muscle neuromechanics and energetics during human walking with elastic ankle exoskeletons , 2020, Scientific Reports.

[81]  Scott Kuindersma,et al.  Human-in-the-loop Bayesian optimization of wearable device parameters , 2017, PloS one.

[82]  S. Harkema,et al.  Altering spinal cord excitability enables voluntary movements after chronic complete paralysis in humans. , 2014, Brain : a journal of neurology.

[83]  Jung Woo Lee,et al.  Rugged and breathable forms of stretchable electronics with adherent composite substrates for transcutaneous monitoring , 2014, Nature Communications.

[84]  Dario Farina,et al.  A musculoskeletal model of human locomotion driven by a low dimensional set of impulsive excitation primitives , 2013, Front. Comput. Neurosci..

[85]  Yoshihiko Nakamura,et al.  Modeling and Identification of a Realistic Spiking Neural Network and Musculoskeletal Model of the Human Arm, and an Application to the Stretch Reflex , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[86]  Dario Farina,et al.  Real-time modeling for lower limb exoskeletons , 2017 .

[87]  David G. Lloyd,et al.  Neural Data-Driven Musculoskeletal Modeling for Personalized Neurorehabilitation Technologies , 2016, IEEE Transactions on Biomedical Engineering.

[88]  Joshua C Kline,et al.  Decomposition of surface EMG signals from cyclic dynamic contractions. , 2015, Journal of neurophysiology.

[89]  André Fabio Kohn,et al.  System identification of a motor unit pool using a realistic neuromusculoskeletal model , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[90]  Massimo Sartori,et al.  Bone remodelling in the natural acetabulum is influenced by muscle force‐induced bone stress , 2014, International journal for numerical methods in biomedical engineering.

[91]  J. Krakauer,et al.  Computational neurorehabilitation: modeling plasticity and learning to predict recovery , 2016, Journal of NeuroEngineering and Rehabilitation.

[92]  Giuseppe Andreoni,et al.  Defining Requirements and Related Methods for Designing Sensorized Garments , 2016, Sensors.

[93]  G. Fénelon,et al.  Spinal Stimulation for Movement Disorders , 2014, Neurotherapeutics.

[94]  Kevin M. Cury,et al.  DeepLabCut: markerless pose estimation of user-defined body parts with deep learning , 2018, Nature Neuroscience.

[95]  George G. Malliaras,et al.  Fully printed all-polymer tattoo/textile electronics for electromyography , 2018, Flexible and Printed Electronics.

[96]  Massimo Sartori,et al.  Neuro-Musculoskeletal Mapping for Man-Machine Interfacing , 2020, Scientific Reports.

[97]  S. Giszter,et al.  Motor primitives are determined in early development and are then robustly conserved into adulthood , 2019, Proceedings of the National Academy of Sciences.

[98]  David W. Smith,et al.  Adaptive Remodeling of Achilles Tendon: A Multi-scale Computational Model , 2016, PLoS Comput. Biol..

[99]  Francesco Lacquaniti,et al.  Can modular strategies simplify neural control of multidirectional human locomotion? , 2014, Journal of neurophysiology.

[100]  D. Farina,et al.  Toward modeling locomotion using electromyography‐informed 3D models: application to cerebral palsy , 2017, Wiley interdisciplinary reviews. Systems biology and medicine.

[101]  Dario Farina,et al.  Surface Electromyography for MAN‐Machine Interfacing in Rehabilitation Technologies , 2016 .

[102]  Dario Farina,et al.  Voluntary control of wearable robotic exoskeletons by patients with paresis via neuromechanical modeling , 2019, Journal of NeuroEngineering and Rehabilitation.

[103]  O Röhrle,et al.  Multiscale musculoskeletal modelling, data–model fusion and electromyography-informed modelling , 2016, Interface Focus.

[104]  T. Demott,et al.  Enhanced Gait-Related Improvements After Therapist- Versus Robotic-Assisted Locomotor Training in Subjects With Chronic Stroke: A Randomized Controlled Study , 2008, Stroke.

[105]  D. Farina,et al.  Central nervous system modulates the neuromechanical delay in a broad range for the control of muscle force. , 2018, Journal of applied physiology.

[106]  Michael Damsgaard,et al.  Analysis of musculoskeletal systems in the AnyBody Modeling System , 2006, Simul. Model. Pract. Theory.

[107]  Xiaoning Jiang,et al.  A laser ultrasound transducer using carbon nanofibers–polydimethylsiloxane composite thin film , 2015 .

[108]  Lizhen Wang,et al.  A Framework of a Lower Limb Musculoskeletal Model With Implemented Natural Proprioceptive Feedback and Its Progressive Evaluation , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[109]  Scott L. Delp,et al.  In Vivo Imaging of Human Sarcomere Twitch Dynamics in Individual Motor Units , 2015, Neuron.

[110]  Daniel P. Ferris,et al.  Robotic Devices to Enhance Human Movement Performance , 2017 .

[111]  Richard W Nuckols,et al.  Exoskeletons Improve Locomotion Economy by Reducing Active Muscle Volume , 2019, Exercise and sport sciences reviews.

[112]  Rik Huiskes,et al.  Why mechanobiology? A survey article. , 2002, Journal of biomechanics.

[113]  Silvestro Micera,et al.  A critical review of interfaces with the peripheral nervous system for the control of neuroprostheses and hybrid bionic systems , 2005, Journal of the peripheral nervous system : JPNS.

[114]  Volker Dietz,et al.  Neuronal plasticity after a human spinal cord injury: Positive and negative effects , 2012, Experimental Neurology.

[115]  Jarred G Gillett,et al.  Reliability and accuracy of an automated tracking algorithm to measure controlled passive and active muscle fascicle length changes from ultrasound , 2013, Computer methods in biomechanics and biomedical engineering.