Real-time myoelectric control of a multi-fingered hand prosthesis using principal components analysis

BackgroundIn spite of the advances made in the design of dexterous anthropomorphic hand prostheses, these sophisticated devices still lack adequate control interfaces which could allow amputees to operate them in an intuitive and close-to-natural way. In this study, an anthropomorphic five-fingered robotic hand, actuated by six motors, was used as a prosthetic hand emulator to assess the feasibility of a control approach based on Principal Components Analysis (PCA), specifically conceived to address this problem. Since it was demonstrated elsewhere that the first two principal components (PCs) can describe the whole hand configuration space sufficiently well, the controller here employed reverted the PCA algorithm and allowed to drive a multi-DoF hand by combining a two-differential channels EMG input with these two PCs. Hence, the novelty of this approach stood in the PCA application for solving the challenging problem of best mapping the EMG inputs into the degrees of freedom (DoFs) of the prosthesis.MethodsA clinically viable two DoFs myoelectric controller, exploiting two differential channels, was developed and twelve able-bodied participants, divided in two groups, volunteered to control the hand in simple grasp trials, using forearm myoelectric signals. Task completion rates and times were measured. The first objective (assessed through one group of subjects) was to understand the effectiveness of the approach; i.e., whether it is possible to drive the hand in real-time, with reasonable performance, in different grasps, also taking advantage of the direct visual feedback of the moving hand. The second objective (assessed through a different group) was to investigate the intuitiveness, and therefore to assess statistical differences in the performance throughout three consecutive days.ResultsSubjects performed several grasp, transport and release trials with differently shaped objects, by operating the hand with the myoelectric PCA-based controller. Experimental trials showed that the simultaneous use of the two differential channels paradigm was successful.ConclusionsThis work demonstrates that the proposed two-DoFs myoelectric controller based on PCA allows to drive in real-time a prosthetic hand emulator into different prehensile patterns with excellent performance. These results open up promising possibilities for the development of intuitive, effective myoelectric hand controllers.

[1]  Robert Rosenberg The biofeedback pointer: EMG control of a two dimensional pointer , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[2]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[3]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[4]  W. W. Daniel Applied Nonparametric Statistics , 1979 .

[5]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[6]  C. Sollerman,et al.  Sollerman hand function test. A standardised method and its use in tetraplegic patients. , 1995, Scandinavian journal of plastic and reconstructive surgery and hand surgery.

[7]  Dario Farina,et al.  Influence of the training set on the accuracy of surface EMG classification in dynamic contractions for the control of multifunction prostheses , 2011, Journal of NeuroEngineering and Rehabilitation.

[8]  Z. Pylyshyn,et al.  Vision and Action: The Control of Grasping , 1990 .

[9]  S. Krishnan,et al.  Real-Time Classification of Forearm Electromyographic Signals Corresponding to User-Selected Intentional Movements for Multifunction Prosthesis Control , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Strahinja Došen,et al.  Cognitive vision system for control of dexterous prosthetic hands: Experimental evaluation , 2010, Journal of NeuroEngineering and Rehabilitation.

[11]  S Micera,et al.  A hybrid approach to EMG pattern analysis for classification of arm movements using statistical and fuzzy techniques. , 1999, Medical engineering & physics.

[12]  Giulio Sandini,et al.  Multi-subject/daily-life activity EMG-based control of mechanical hands , 2009, Journal of NeuroEngineering and Rehabilitation.

[13]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[14]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[15]  Guanglin Li,et al.  Principal Components Analysis Preprocessing for Improved Classification Accuracies in Pattern-Recognition-Based Myoelectric Control , 2009, IEEE Transactions on Biomedical Engineering.

[16]  Daniel R Merrill,et al.  Development of an implantable myoelectric sensor for advanced prosthesis control. , 2011, Artificial organs.

[17]  Christian Cipriani,et al.  Principal components analysis based control of a multi-dof underactuated prosthetic hand , 2010, Journal of NeuroEngineering and Rehabilitation.

[18]  Silvestro Micera,et al.  Design of a cybernetic hand for perception and action , 2006, Biological Cybernetics.

[19]  R. Weir,et al.  New Multifunctional Prosthetic Arm and hand Systems , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  A. Panarese,et al.  Humans Can Integrate Force Feedback to Toes in Their Sensorimotor Control of a Robotic Hand , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  J. Wyndaele,et al.  Color atlas of human anatomy , 2009, Spinal Cord.

[22]  Sanjay S Joshi,et al.  Two-Dimensional Cursor-to-Target Control From Single Muscle Site sEMG Signals , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[24]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[25]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[26]  S. Shott,et al.  Nonparametric Statistics , 2018, The Encyclopedia of Archaeological Sciences.

[27]  Michael Goldfarb,et al.  Design of a multifunctional anthropomorphic prosthetic hand with extrinsic actuation , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[28]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[29]  A. Stuart,et al.  Non-Parametric Statistics for the Behavioral Sciences. , 1957 .

[30]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[31]  Emilio Bizzi,et al.  Combinations of muscle synergies in the construction of a natural motor behavior , 2003, Nature Neuroscience.

[32]  Shin-Ki Kim,et al.  Control of multifunction myoelectric hand using a real-time EMG pattern recognition , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Matei T. Ciocarlie,et al.  Biomimetic grasp planning for cortical control of a robotic hand , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Changmok Choi,et al.  Development of a myoelectric joystick: A preliminary study , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[35]  M. Carpenter The Co-ordination and Regulation of Movements , 1968 .

[36]  Nitish V. Thakor,et al.  Decoding of Individuated Finger Movements Using Surface Electromyography , 2009, IEEE Transactions on Biomedical Engineering.

[37]  H. H. Sears,et al.  PROPORTIONAL MYOELECTRIC HAND CONTROL: AN EVALUATION , 1991, American journal of physical medicine & rehabilitation.

[38]  Christian Cipriani,et al.  The SmartHand transradial prosthesis , 2011, Journal of NeuroEngineering and Rehabilitation.

[39]  H. Harry Asada,et al.  Inter-finger coordination and postural synergies in robot hands via mechanical implementation of principal components analysis , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  F. Netter Atlas of Human Anatomy , 1967 .

[41]  R. T. Hutchings,et al.  Color atlas of human anatomy , 1977 .

[42]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[43]  M Controzzi,et al.  Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.