MoveNet: A Deep Neural Network for Joint Profile Prediction Across Variable Walking Speeds and Slopes

An exoskeleton needs reference joint angle profiles at various speeds and slopes for its application in real-world scenarios. Recording these profiles and their implementation in the control system of an exoskeleton are time-consuming and complex processes. Therefore, there is a need for an artificial system that can predict subject-specific joint angle profiles for various real-world scenarios from a minimum amount of input data. This study aims to propose a predictive neural network (NN) called MoveNet, for joints angle profile prediction across variable walking speeds and slopes. MoveNet consists of three NN modules, namely, encoder, mapper, and decoder. The encoder module is trained to convert the knee joint angle profile into its 6-D latent representation. The mapper module is trained to map the latent representation of angle profile at zero degrees angle of inclination (AOI) to latent representation of angle profile at the target AOI. The decoder module is trained to predict an angle profile from its given latent representation. The proposed model successfully predicted knee joint angle profiles at three walking speeds (0.8, 1, and 1.2 m/s) and nine AOI ranging from −10° to 10°. MoveNet obtained root mean squared error of 3.24 ± 1.19° and mean absolute error of 2.66 ± 1.00° from tenfold cross validation. These results suggest that artificial intelligence can predict subject-specific knee joint angle profiles for variable slopes at a given walking speed from the data of knee joint angle profiles recorded at a flat surface.

[1]  Karim Djouani,et al.  Toward Lower Limbs Functional Rehabilitation Through a Knee-Joint Exoskeleton , 2017, IEEE Transactions on Control Systems Technology.

[2]  Diana Hodgins,et al.  Inertial sensor-based knee flexion/extension angle estimation. , 2009, Journal of biomechanics.

[3]  Andrzej Wit,et al.  Artificial neural network simulation of lower limb joint angles in normal and impaired human gait. , 2018, Acta of bioengineering and biomechanics.

[4]  Joao P. Ferreira,et al.  Computational Intelligence Generation of Subject-Specific Knee and Hip Healthy Joint Angles Reference Curves , 2019, IFMBE Proceedings.

[5]  Yoshio Inoue,et al.  Ambulatory Estimation of Knee-Joint Kinematics in Anatomical Coordinate System Using Accelerometers and Magnetometers , 2011, IEEE Transactions on Biomedical Engineering.

[6]  M. Duarte,et al.  A prediction method of speed-dependent walking patterns for healthy individuals. , 2019, Gait & posture.

[7]  Robert D. Gregg,et al.  A unified parameterization of human gait across ambulation modes , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Anoop Kant Godiyal,et al.  Optimal Force Myography Placement For Maximizing Locomotion Classification Accuracy in Transfemoral Amputees: A Pilot Study , 2020, IEEE Journal of Biomedical and Health Informatics.

[9]  Xinyu Wu,et al.  Gait trajectory prediction for lower-limb exoskeleton based on Deep Spatial-Temporal Model (DSTM) , 2017, 2017 2nd International Conference on Advanced Robotics and Mechatronics (ICARM).

[10]  Michael E. Hahn,et al.  A NEURAL NETWORK MODEL FOR ESTIMATION OF NET JOINT MOMENTS DURING NORMAL GAIT , 2008 .

[11]  Xiaodong Zhang,et al.  Surface EMG based continuous estimation of human lower limb joint angles by using deep belief networks , 2018, Biomed. Signal Process. Control..

[12]  Kok-Meng Lee,et al.  An adaptive knee joint exoskeleton based on biological geometries , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Xuan Zhao,et al.  Online Adaptive and LSTM-Based Trajectory Generation of Lower Limb Exoskeletons for Stroke Rehabilitation , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Hongliu Yu,et al.  Pilot Study of a Powered Exoskeleton for Upper Limb Rehabilitation Based on the Wheelchair , 2019, BioMed research international.

[16]  A. Paulo Coimbra,et al.  Human Gait Acquisition and Characterization , 2009, IEEE Transactions on Instrumentation and Measurement.

[17]  Fabien Leboeuf,et al.  Lower limb sagittal gait kinematics can be predicted based on walking speed, gender, age and BMI , 2019, Scientific Reports.

[18]  A. Paulo Coimbra,et al.  Human knee joint walking pattern generation using computational intelligence techniques , 2018, Neural Computing and Applications.

[20]  Jan Andrysek,et al.  Lower-Limb Prostheses and Exoskeletons With Energy Regeneration: Mechatronic Design and Optimization Review , 2019, Journal of Mechanisms and Robotics.

[21]  Badong Chen,et al.  Personalized gait trajectory generation based on anthropometric features using Random Forest , 2019, J. Ambient Intell. Humaniz. Comput..

[22]  Xinyu Wu,et al.  GC-IGTG: A Rehabilitation Gait Trajectory Generation Algorithm for Lower Extremity Exoskeleton , 2019, 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[23]  Björn Eskofier,et al.  Estimation of the Knee Flexion-Extension Angle During Dynamic Sport Motions Using Body-worn Inertial Sensors , 2013, BODYNETS.

[24]  Martin Grimmer,et al.  Energetic and Peak Power Advantages of Series Elastic Actuators in an Actuated Prosthetic Leg for Walking and Running , 2014 .

[25]  Muhammad Fahmi Miskon,et al.  Trajectory Planning For Exoskeleton Robot By Using Cubic And Quintic Polynomial Equation , 2016 .

[26]  Fong-Chin Su,et al.  EFFECTS OF SPEED AND INCLINE ON LOWER EXTREMITY KINEMATICS DURING TREADMILL JOGGING IN HEALTHY SUBJECTS , 2006 .

[27]  Hyogon Kim,et al.  Design of a novel knee joint for an exoskeleton with good energy efficiency for load-carrying augmentation , 2014 .

[28]  Rachid Aissaoui,et al.  Automatic Classification of Asymptomatic and Osteoarthritis Knee Gait Patterns Using Kinematic Data Features and the Nearest Neighbor Classifier , 2008, IEEE Transactions on Biomedical Engineering.

[29]  Edward D Lemaire,et al.  Lower limb sagittal kinematic and kinetic modeling of very slow walking for gait trajectory scaling , 2018, PloS one.

[30]  Klaus-Robert Müller,et al.  Explaining the unique nature of individual gait patterns with deep learning , 2018, Scientific Reports.

[31]  F Lacquaniti,et al.  Kinematic patterns while walking on a slope at different speeds. , 2018, Journal of applied physiology.

[32]  Andrea Ancillao,et al.  Analysis of Knee Strength Measurements Performed by a Hand-Held Multicomponent Dynamometer and Optoelectronic System , 2017, IEEE Transactions on Instrumentation and Measurement.

[33]  Anoop Kant Godiyal,et al.  A New Force Myography-Based Approach for Continuous Estimation of Knee Joint Angle in Lower Limb Amputees and Able-Bodied Subjects , 2020, IEEE Journal of Biomedical and Health Informatics.

[34]  Changmook Chun,et al.  Gaussian Process Trajectory Learning and Synthesis of Individualized Gait Motions , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Syed Ali Raza Zaidi,et al.  A CNN-LSTM Hybrid Model for Wrist Kinematics Estimation Using Surface Electromyography , 2021, IEEE Transactions on Instrumentation and Measurement.

[36]  Robert D. Gregg,et al.  Modeling the Kinematics of Human Locomotion Over Continuously Varying Speeds and Inclines , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Tao Liu,et al.  Ambulatory measurement and analysis of the lower limb 3D posture using wearable sensor system , 2009, 2009 International Conference on Mechatronics and Automation.