A pilot study on locomotion training via biomechanical models and a wearable haptic feedback system

Locomotion is a fundamental human skill. Real-time sensing and feedback is a promising strategy for motion training to reconstruct healthy locomotion patterns lost due to aging or disease, and to prevent injuries. In this paper, we present a pilot study on locomotion training via biomechanical modeling and a wearable haptic feedback system. In addition, a novel simulation framework for motion tracking and analysis is introduced. This unified framework, implemented within the Unity environment, is used to analyze subject’s baseline and performance characteristics, and to provide real-time haptic feedback during locomotion. The framework incorporates accurate musculoskeletal models derived from OpenSim, closed-form calculations of muscle routing kinematics and kinematic Jacobian matrices, dynamic performance metrics (i.e., muscular effort), human motion reconstruction via inertial measurement unit (IMU) sensors, and real-time visualization of the motion and its dynamics. A pilot study was conducted in which 6 healthy subjects learned to alter running patterns to lower the knee flexion moment (KFM) through haptic feedback. We targeted three gait parameters (trunk lean, cadence, and foot strike) that previous studies had identified as having an influence on reducing the knee flexion moment and associated with increased risk of running injuries. All subjects were able to adopt altered running patterns requiring simultaneous changes to these kinematic parameters and reduced their KFM to 30–85% of their baseline values. The muscular effort during motion training stayed comparable to subjects’ baseline. This study shows that biomechanical modeling, together with real-time sensing and wearable haptic feedback can greatly increase the efficiency of motion training.

[1]  F.E. Zajac,et al.  An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures , 1990, IEEE Transactions on Biomedical Engineering.

[2]  Erwin Schoonderwaldt,et al.  MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing , 2011, IEEE Transactions on Instrumentation and Measurement.

[3]  Linda R. Elliott,et al.  Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis , 2006, ICMI '06.

[4]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[5]  Wahyu Caesarendra,et al.  Overview Electrotactile Feedback for Enhancing Human Computer Interface , 2018 .

[6]  T. Andriacchi,et al.  Gait modification via verbal instruction and an active feedback system to reduce peak knee adduction moment. , 2010, Journal of biomechanical engineering.

[7]  F. Q. Ribeiro The meta-analysis , 2017, Brazilian journal of otorhinolaryngology.

[8]  D. Burr,et al.  Design and validation of a knee brace with feedback to reduce the rate of loading. , 2009, Journal of biomechanical engineering.

[9]  J. Rogers A Clear Advance in Soft Actuators , 2013, Science.

[10]  Peter B. Shull,et al.  Wearable sensing and haptic feedback research platform for gait retraining , 2017, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[11]  David G. Lloyd,et al.  Individual muscle contributions to the swing phase of gait: An EMG-based forward dynamics modelling approach , 2007, Simul. Model. Pract. Theory.

[12]  Bernard J. Martin,et al.  The Effect of Vibrotactile Cuing on Recovery Strategies From a Treadmill-Induced Trip , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  M. Pandy,et al.  Contributions of muscle forces and toe-off kinematics to peak knee flexion during the swing phase of normal gait: an induced position analysis. , 2004, Journal of biomechanics.

[14]  B. Vicenzino,et al.  Take your shoes off to reduce patellofemoral joint stress during running , 2013, British Journal of Sports Medicine.

[15]  Ajay Seth,et al.  Minimal formulation of joint motion for biomechanisms , 2010, Nonlinear dynamics.

[16]  S. Majumdar,et al.  Higher Knee Flexion Moment During the Second Half of the Stance Phase of Gait Is Associated With the Progression of Osteoarthritis of the Patellofemoral Joint on Magnetic Resonance Imaging. , 2015, The Journal of orthopaedic and sports physical therapy.

[17]  Hiroyasu Iwata,et al.  Development and pilot clinical evaluation of a haptic-based perception-empathy biofeedback device for gait rehabilitation , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[19]  Dana Kulic,et al.  Anthropomorphic Movement Analysis and Synthesis: A Survey of Methods and Applications , 2016, IEEE Transactions on Robotics.

[20]  T Bajd,et al.  Comparison of visual and haptic feedback during training of lower extremities. , 2010, Gait & posture.

[21]  Andrew J Fuglevand,et al.  Object discrimination using electrotactile feedback , 2018, Journal of neural engineering.

[22]  Christa M. Wille,et al.  Effects of step rate manipulation on joint mechanics during running. , 2011, Medicine and science in sports and exercise.

[23]  Jungwon Yoon,et al.  A Portable Gait Asymmetry Rehabilitation System for Individuals with Stroke Using a Vibrotactile Feedback , 2015, BioMed research international.

[24]  C. Majidi Soft Robotics: A Perspective—Current Trends and Prospects for the Future , 2014 .

[25]  A.U. Alahakone,et al.  Vibrotactile feedback systems: Current trends in rehabilitation, sports and information display , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[26]  Koren Ward,et al.  Tactile sensing system using electro-tactile feedback , 2015, 2015 6th International Conference on Automation, Robotics and Applications (ICARA).

[27]  J. Taunton,et al.  A retrospective case-control analysis of 2002 running injuries , 2002, British journal of sports medicine.

[28]  Dong-Wook Kim,et al.  The Development of Gait Detection and Vibration Stimulus System , 2015, 2015 6th International Conference on Intelligent Systems, Modelling and Simulation.

[29]  Werner Schiehlen,et al.  Dynamic Analysis of Human Gait Disorder and Metabolical Cost Estimation , 2006 .

[30]  Isotta Chimenti,et al.  The Potential of GMP-Compliant Platelet Lysate to Induce a Permissive State for Cardiovascular Transdifferentiation in Human Mediastinal Adipose Tissue-Derived Mesenchymal Stem Cells , 2015, BioMed research international.

[31]  Richard R Neptune,et al.  Biomechanics and muscle coordination of human walking: part II: lessons from dynamical simulations and clinical implications. , 2003, Gait & posture.

[32]  Conor James Walsh,et al.  An autonomous, underactuated exoskeleton for load-carrying augmentation , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Yoshiyuki Sankai,et al.  Power assist control for walking aid with HAL-3 based on EMG and impedance adjustment around knee joint , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Mark R. Cutkosky,et al.  Haptic gait retraining for knee osteoarthritis treatment , 2010, 2010 IEEE Haptics Symposium.

[35]  J. Yordanova,et al.  Daily morning running for 3 weeks improved sleep and psychological functioning in healthy adolescents compared with controls. , 2012, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[36]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[37]  Michael Damsgaard,et al.  Analysis of musculoskeletal systems in the AnyBody Modeling System , 2006, Simul. Model. Pract. Theory.

[38]  Clare E. Milner,et al.  Reducing impact loading during running with the use of real-time visual feedback. , 2010, The Journal of orthopaedic and sports physical therapy.

[39]  P. Barralon,et al.  Optimizing the Tactile Display of Physiological Information: Vibro-Tactile vs. Electro-Tactile Stimulation, and Forearm or Wrist Location , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Nikolaos G. Tsagarakis,et al.  Design of a wearable skin stretch cutaneous device for the upper limb , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[41]  May Q. Liu,et al.  Muscle contributions to support and progression over a range of walking speeds. , 2008, Journal of biomechanics.

[42]  Shawn P. McGuan Human Modeling – From Bubblemen to Skeletons , 2001 .

[43]  Allison S Arnold,et al.  Contributions of muscles to terminal-swing knee motions vary with walking speed. , 2007, Journal of biomechanics.

[44]  Vincent De Sapio,et al.  Robotics-based synthesis of human motion , 2009, Journal of Physiology-Paris.

[45]  Rainer Stiefelhagen,et al.  Cognitive Evaluation of Haptic and Audio Feedback in Short Range Navigation Tasks , 2014, ICCHP.

[46]  Katherine J. Kuchenbecker,et al.  Effects of Vibrotactile Feedback on Human Learning of Arm Motions , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  Mark R Cutkosky,et al.  Training multi-parameter gaits to reduce the knee adduction moment with data-driven models and haptic feedback. , 2011, Journal of biomechanics.

[48]  Emel Demircan,et al.  Perception Accuracy of Vibrotactile Feedback during Locomotion , 2019, 2019 16th International Conference on Ubiquitous Robots (UR).

[49]  Jungwon Yoon,et al.  Development of an augmented feedback system for training of gait improvement using vibrotactile cues , 2017, 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[50]  John Abella,et al.  A Multi-body Simulation Framework for Live Motion Tracking and Analysis within the Unity Environment , 2019, 2019 16th International Conference on Ubiquitous Robots (UR).

[51]  Scott L Delp,et al.  Quantified self and human movement: a review on the clinical impact of wearable sensing and feedback for gait analysis and intervention. , 2014, Gait & posture.

[52]  R. Rothenberg,et al.  The natural history of exercise: a 10-yr follow-up of a cohort of runners. , 1995, Medicine and science in sports and exercise.

[53]  James M. Sabatier,et al.  Human motion characterization , 2009 .

[54]  S. Collins,et al.  The effect of ankle foot orthosis stiffness on the energy cost of walking: a simulation study. , 2011, Clinical biomechanics.

[55]  Stijn Verwulgen,et al.  Vibrotactile feedback as a tool to improve motor learning and sports performance: a systematic review , 2017, BMJ Open Sport & Exercise Medicine.

[56]  J. Barrios,et al.  Gait retraining to reduce the knee adduction moment through real-time visual feedback of dynamic knee alignment. , 2010, Journal of biomechanics.

[57]  Conor James Walsh,et al.  Biomimetic Design of an Under-Actuated Leg Exoskeleton for Load-Carrying Augmentation , 2006 .

[58]  K. Fields,et al.  Prevention of Running Injuries , 2010, Current sports medicine reports.

[59]  Thomas W Kernozek,et al.  Effects of step length on patellofemoral joint stress in female runners with and without patellofemoral pain. , 2014, Clinical biomechanics.

[60]  Arthur D Kuo,et al.  The six determinants of gait and the inverted pendulum analogy: A dynamic walking perspective. , 2007, Human movement science.

[61]  C. Powers,et al.  Sagittal plane trunk posture influences patellofemoral joint stress during running. , 2014, The Journal of orthopaedic and sports physical therapy.

[62]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[63]  Hafiz Farhan Maqbool,et al.  A wearable skin stretch haptic feedback device: Towards improving balance control in lower limb amputees , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[64]  M. Pandy,et al.  Muscular contributions to hip and knee extension during the single limb stance phase of normal gait: a framework for investigating the causes of crouch gait. , 2005, Journal of biomechanics.

[65]  MajidiCarmel,et al.  Soft Robotics: A Perspective—Current Trends and Prospects for the Future , 2014 .

[66]  James Selfe,et al.  Anterior knee pain in younger adults as a precursor to subsequent patellofemoral osteoarthritis: a systematic review , 2010, BMC musculoskeletal disorders.

[67]  Christian Cipriani,et al.  HyVE—Hybrid Vibro-Electrotactile Stimulation—Is an Efficient Approach to Multi-Channel Sensory Feedback , 2014, IEEE Transactions on Haptics.

[68]  Aaron M. Dollar,et al.  Biomechanical considerations in the design of lower limb exoskeletons , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[69]  Yonggang Huang,et al.  Multifunctional Epidermal Electronics Printed Directly Onto the Skin , 2013, Advanced materials.

[70]  T. Besier,et al.  Real-time knee adduction moment feedback for gait retraining through visual and tactile displays. , 2011, Journal of biomechanical engineering.

[71]  William R. Provancher,et al.  Planar Hand Motion Guidance Using Fingertip Skin-Stretch Feedback , 2014, IEEE Transactions on Haptics.

[72]  Chand T. John,et al.  Contributions of muscles to mediolateral ground reaction force over a range of walking speeds. , 2012, Journal of biomechanics.

[73]  VECTOR DECOMPOSITION OF FINITE ROTATIONS , 2012 .

[74]  C. Mladenova,et al.  Vector Decompositions of Rotations , 2012 .

[75]  Matteo Bianchi,et al.  Skin Stretch Haptic Feedback to Convey Closure Information in Anthropomorphic, Under-Actuated Upper Limb Soft Prostheses , 2019, IEEE Transactions on Haptics.

[76]  B. Koes,et al.  Incidence and determinants of lower extremity running injuries in long distance runners: a systematic review , 2007, British Journal of Sports Medicine.

[77]  Claudio Pacchierotti,et al.  Design and Evaluation of a Wearable Haptic Device for Skin Stretch, Pressure, and Vibrotactile Stimuli , 2018, IEEE Robotics and Automation Letters.

[78]  I. Davis,et al.  Foot strike patterns and collision forces in habitually barefoot versus shod runners , 2010, Nature.

[79]  Michael A Sherman,et al.  Simbody: multibody dynamics for biomedical research. , 2011, Procedia IUTAM.

[80]  Explore Configuring,et al.  A Simulation Study to , 2004 .

[81]  H. Nakata Relationship Between the Relative Age Effect and Lengths of Professional Careers in Male Japanese Baseball Players: a Retrospective Analysis , 2017, Sports Medicine - Open.

[82]  Ajay Seth,et al.  Muscle contributions to propulsion and support during running. , 2010, Journal of biomechanics.

[83]  May Q. Liu,et al.  Muscles that support the body also modulate forward progression during walking. , 2006, Journal of biomechanics.

[84]  Przemyslaw Dobrowolski,et al.  Swing-twist decomposition in Clifford algebra , 2015, ArXiv.

[85]  Yasushi Akazawa,et al.  Design of a stiffness-adjustable ankle-foot orthosis and its effect on ankle joint kinematics in patients with stroke. , 2011, Gait & posture.

[86]  Antonie J. van den Bogert,et al.  A real-time system for biomechanical analysis of human movement and muscle function , 2013, Medical & Biological Engineering & Computing.

[87]  Mark R. Cutkosky,et al.  Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[88]  Mark G. Blanchette,et al.  The influence of heel height on patellofemoral joint kinetics during walking. , 2012, Gait & posture.

[89]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.