Attribute-Driven Granular Model for EMG-Based Pinch and Fingertip Force Grand Recognition

Fine multifunctional prosthetic hand manipulation requires precise control on the pinch-type and the corresponding force, and it is a challenge to decode both aspects from myoelectric signals. This paper proposes an attribute-driven granular model (AGrM) under a machine-learning scheme to solve this problem. The model utilizes the additionally captured attribute as the latent variable for a supervised granulation procedure. It was fulfilled for EMG-based pinch-type classification and the fingertip force grand prediction. In the experiments, 16 channels of surface electromyographic signals (i.e., main attribute) and continuous fingertip force (i.e., subattribute) were simultaneously collected while subjects performing eight types of hand pinches. The use of AGrM improved the pinch-type recognition accuracy to around 97.2% by 1.8% when constructing eight granules for each grasping type and received more than 90% force grand prediction accuracy at any granular level greater than six. Further, sensitivity analysis verified its robustness with respect to different channel combination and interferences. In comparison with other clustering-based granulation methods, AGrM achieved comparable pinch recognition accuracy but was of lowest computational cost and highest force grand prediction accuracy.

[1]  Sang-Woon Kim A pre-clustering technique for optimizing subclass discriminant analysis , 2010, Pattern Recognit. Lett..

[2]  Patrick van der Smagt,et al.  Surface EMG in advanced hand prosthetics , 2008, Biological Cybernetics.

[3]  Wei Wang,et al.  Adaptive Granulation-Based Prediction for Energy System of Steel Industry , 2018, IEEE Transactions on Cybernetics.

[4]  Danica Kragic,et al.  The GRASP Taxonomy of Human Grasp Types , 2016, IEEE Transactions on Human-Machine Systems.

[5]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[6]  Andrzej Bargiela,et al.  An Optimization of Allocation of Information Granularity in the Interpretation of Data Structures: Toward Granular Fuzzy Clustering , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Chee Seng Chan,et al.  GrCS: Granular Computing-Based Crowd Segmentation , 2017, IEEE Transactions on Cybernetics.

[8]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[9]  Yinfeng Fang,et al.  Interface Prostheses With Classifier-Feedback-Based User Training , 2017, IEEE Transactions on Biomedical Engineering.

[10]  Witold Pedrycz,et al.  Granular Data Description: Designing Ellipsoidal Information Granules , 2017, IEEE Transactions on Cybernetics.

[11]  Aiguo Song,et al.  Grip Force and 3D Push-Pull Force Estimation Based on sEMG and GRNN , 2017, Front. Neurosci..

[12]  Andrzej Bargiela,et al.  Granular mappings , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Aleix M. Martínez,et al.  Subclass discriminant analysis , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Yoshiaki Hayashi,et al.  An EMG-Based Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Toshio Fukuda,et al.  An exoskeletal robot for human elbow motion support-sensor fusion, adaptation, and control , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[16]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[17]  Xinjun Sheng,et al.  Invariant Surface EMG Feature Against Varying Contraction Level for Myoelectric Control Based on Muscle Coordination , 2015, IEEE Journal of Biomedical and Health Informatics.

[18]  Witold Pedrycz,et al.  Granular Computing: Perspectives and Challenges , 2013, IEEE Transactions on Cybernetics.

[19]  Honghai Liu,et al.  A force-driven granular model for EMG based grasp recognition , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[20]  Aristodemos Pnevmatikakis,et al.  Subclass linear discriminant analysis for video-based face recognition , 2009, J. Vis. Commun. Image Represent..

[21]  Honghai Liu,et al.  Multi-Modal Sensing Techniques for Interfacing Hand Prostheses: A Review , 2015, IEEE Sensors Journal.

[22]  Witold Pedrycz,et al.  Granular Model of Long-Term Prediction for Energy System in Steel Industry , 2016, IEEE Transactions on Cybernetics.

[23]  Nitish V. Thakor,et al.  User Training for Pattern Recognition-Based Myoelectric Prostheses: Improving Phantom Limb Movement Consistency and Distinguishability , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Honghai Liu,et al.  A Unified Fuzzy Framework for Human-Hand Motion Recognition , 2011, IEEE Transactions on Fuzzy Systems.

[25]  Seok-Beom Roh,et al.  A design of granular fuzzy classifier , 2014, Expert Syst. Appl..

[26]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[27]  Yinfeng Fang,et al.  Interacting with prosthetic hands via electromyography signals , 2015 .

[28]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[29]  Shyamanta M. Hazarika,et al.  EMG Feature Set Selection Through Linear Relationship for Grasp Recognition , 2016 .

[30]  Honghai Liu,et al.  Human Hand Motion Analysis With Multisensory Information , 2014, IEEE/ASME Transactions on Mechatronics.

[31]  Hong Liu,et al.  Estimation of hand grasp force based on forearm surface EMG , 2009, 2009 International Conference on Mechatronics and Automation.

[32]  J. Daube,et al.  Muscles Alive , 1981, Neurology.

[33]  Elisa Ficarra,et al.  Subclass Discriminant Analysis of morphological and textural features for HEp-2 staining pattern classification , 2014, Pattern Recognit..

[34]  Joo-Hwee Lim,et al.  Whole space subclass discriminant analysis for face recognition , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[35]  Yanqing Zhang,et al.  Granular support vector machines for medical binary classification problems , 2004, 2004 Symposium on Computational Intelligence in Bioinformatics and Computational Biology.

[36]  Hong Liu,et al.  EMG pattern recognition and grasping force estimation: Improvement to the myocontrol of multi-DOF prosthetic hands , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Honghai Liu,et al.  Exploring Human Hand Capabilities Into Embedded Multifingered Object Manipulation , 2011, IEEE Transactions on Industrial Informatics.

[38]  Witold Pedrycz,et al.  The Design of Free Structure Granular Mappings: The Use of the Principle of Justifiable Granularity , 2013, IEEE Transactions on Cybernetics.

[39]  Witold Pedrycz,et al.  From Principal Curves to Granular Principal Curves , 2014, IEEE Transactions on Cybernetics.

[40]  Y. Yao Granular Computing : basic issues and possible solutions , 2000 .

[41]  Chunhua Liu,et al.  Granular Computing Classification Algorithms Based on Distance Measures between Granules from the View of Set , 2014, Comput. Intell. Neurosci..

[42]  Sankar Kumar Pal,et al.  Granular Flow Graph, Adaptive Rule Generation and Tracking , 2017, IEEE Transactions on Cybernetics.