Predicting Task Intent From Surface Electromyography Using Layered Hidden Markov Models

Human–robot interaction faces the challenge of designing and modeling tightly coupled and effectively controlled human–machine systems. This letter describes a method to learn human operator's performance characteristics from surface electromyography measurements to predict their intentions during task operations. For the first time, a layered hidden Markov model (LHMM) is successfully used with physiological data from cocontracting arm muscles to achieve accurate intent prediction. Furthermore, optimal model parameters and high-performing feature sets are identified and prediction accuracy at various time horizons calculated. The LHMM outperformed various other classification methods, including naive Bayes and support vector machine, ultimately achieving 82% accuracy in predicting the next 50 ms window of intent and maintaining 60% accuracy even after one second. These results hold the promise of improving robots’ internal model of their human partners, which could increase the safety and productivity of human–robot teams in the factories of the future.

[1]  Danica Kragic,et al.  Layered HMM for Motion Intention Recognition , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Jun Ueda,et al.  Relaxed individual control of skeletal muscle forces via physical human–robot interaction , 2013, Multibody System Dynamics.

[3]  Svetha Venkatesh,et al.  Recognition of human activity through hierarchical stochastic learning , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[4]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[5]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[6]  Firas AlOmari,et al.  Analysis of Extracted Forearm sEMG Signal Using LDA, QDA, K-NN Classification Algorithms , 2014 .

[7]  Jaime Valls Miró,et al.  Learning object, grasping and manipulation activities using hierarchical HMMs , 2014, Auton. Robots.

[8]  Adrian D. C. Chan,et al.  Myoelectric Control Development Toolbox , 2007 .

[9]  Jun Ueda,et al.  A model for operator endpoint stiffness prediction during physical human-robot interaction , 2015, HRI 2015.

[10]  Othman O. Khalifa,et al.  Electromygraphy (EMG) signal based hand gesture recognition using artificial neural network (ANN) , 2011, 2011 4th International Conference on Mechatronics (ICOM).

[11]  Jun Ueda,et al.  Support Vector Machine classification of muscle cocontraction to improve physical human-robot interaction , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  K. Englehart,et al.  Classification of the myoelectric signal using time-frequency based representations. , 1999, Medical engineering & physics.

[13]  Pornchai Phukpattaranont,et al.  A Novel Feature Extraction for Robust EMG Pattern Recognition , 2009, ArXiv.

[14]  Panagiotis Artemiadis,et al.  A hybrid BMI-based exoskeleton for paresis: EMG control for assisting arm movements , 2017, Journal of neural engineering.

[15]  Eric Horvitz,et al.  Layered representations for learning and inferring office activity from multiple sensory channels , 2004, Comput. Vis. Image Underst..

[16]  William Gallagher Modeling of operator action for intelligent control of haptic human-robot interfaces , 2013 .

[17]  Carlo Menon,et al.  Surface EMG pattern recognition for real-time control of a wrist exoskeleton , 2010, Biomedical engineering online.

[18]  Gwenn Englebienne,et al.  Hierarchical Activity Recognition Using Automatically Clustered Actions , 2011, AmI.

[19]  Huosheng Hu,et al.  Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb , 2008, IEEE Transactions on Biomedical Engineering.

[20]  Jun Ueda,et al.  Haptic Control in Physical Human-Robot Interaction Based on Support Vector Machine Classification of Muscle Activity: A Preliminary Study , 2014, HRI 2014.

[21]  Panagiotis K. Artemiadis,et al.  EMG-Based Control of a Robot Arm Using Low-Dimensional Embeddings , 2010, IEEE Transactions on Robotics.

[22]  Ganesh R. Naik,et al.  Twin SVM for Gesture Classification Using the Surface Electromyogram , 2010, IEEE Transactions on Information Technology in Biomedicine.

[23]  Jun Ueda,et al.  Measurement of Muscle Stiffness to Improve Stability of Haptic Human-Robot Interfaces , 2012 .

[24]  Dinesh Kumar,et al.  An accurate bicep muscle model with sEMG and muscle force outputs , 2010 .

[25]  Jun Ueda,et al.  Improved stability of haptic human–robot interfaces using measurement of human arm stiffness , 2014, Adv. Robotics.