Hierarchical Motion Segmentation Through sEMG for Continuous Lower Limb Motions

Surface electromyograms (sEMG), are records of electrical signals generated by muscles, and have long been used to indicate the motions intended by humans to enable interactions between a robot and a human. To support not only the diverse movements in human daily living but also the task of increasing the human–robot interface and its applications, a new algorithm that can classify continuous lower-limb motion using sEMG signals is proposed herein. By simply constructing the motion hierarchy and probability distribution of sEMG for each motion phase obtained using only kinematic motion data and sEMG data, it is possible to demonstrate higher classification accuracy than with state-of-the-art supervised learning methods that consume much time. Four different experiments were performed involving five participants and the algorithm was verified to distinguish successfully walking, running, jumping and sit-to-stand.

[1]  Wan Kyun Chung,et al.  Autonomous segmentation of motion primitive including muscular activation using variational Bayesian mixture of Gaussian , 2013, 2013 10th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[2]  A. Hof,et al.  Averaged EMG profiles in jogging and running at different speeds. , 2007, Gait & posture.

[3]  Yoshua Bengio,et al.  Blocks and Fuel: Frameworks for deep learning , 2015, ArXiv.

[4]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[5]  Quoc V. Le,et al.  Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis , 2011, CVPR 2011.

[6]  Le Li,et al.  Assistive Control System Using Continuous Myoelectric Signal in Robot-Aided Arm Training for Patients After Stroke , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Ruzena Bajcsy,et al.  Bio-inspired Dynamic 3D Discriminative Skeletal Features for Human Action Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Olivier Gibaru,et al.  Unsupervised Gesture Segmentation by Motion Detection of a Real-Time Data Stream , 2017, IEEE Transactions on Industrial Informatics.

[9]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  A. V. van Soest,et al.  Why is countermovement jump height greater than squat jump height? , 1996, Medicine and science in sports and exercise.

[11]  Panagiotis K. Artemiadis,et al.  EMG-Based Control of a Robot Arm Using Low-Dimensional Embeddings , 2010, IEEE Transactions on Robotics.

[12]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[13]  Rémi Ronfard,et al.  A survey of vision-based methods for action representation, segmentation and recognition , 2011, Comput. Vis. Image Underst..

[14]  Il Hong Suh,et al.  Dynamic motion phase segmentation using sEMG during countermovement jump based on hidden semi-Markov model , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Jake K. Aggarwal,et al.  Human activity recognition from 3D data: A review , 2014, Pattern Recognit. Lett..

[16]  Tamim Asfour,et al.  Learning a bidirectional mapping between human whole-body motion and natural language using deep recurrent neural networks , 2017, Robotics Auton. Syst..

[17]  Patrick van der Smagt,et al.  EMG-based teleoperation and manipulation with the DLR LWR-III , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Panagiotis K. Artemiadis,et al.  Proportional Myoelectric Control of Robots: Muscle Synergy Development Drives Performance Enhancement, Retainment, and Generalization , 2015, IEEE Transactions on Robotics.

[19]  N. Hogan,et al.  Multivariable Static Ankle Mechanical Impedance With Active Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Neil T. Roach,et al.  Elastic energy storage in the shoulder and the evolution of high-speed throwing in Homo , 2013, Nature.

[21]  Ajay Seth,et al.  Muscle contributions to propulsion and support during running. , 2010, Journal of biomechanics.

[22]  M Controzzi,et al.  Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Yan Song,et al.  A synchronous and multi-domain feature extraction method of EEG and sEMG in power-assist rehabilitation robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  N. Hogan,et al.  Multivariable Dynamic Ankle Mechanical Impedance With Active Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[26]  Dana Kulic,et al.  Incremental Learning, Clustering and Hierarchy Formation of Whole Body Motion Patterns using Adaptive Hidden Markov Chains , 2008, Int. J. Robotics Res..