Bio-signal based control in assistive robots: a survey

Recently, bio-signal based control has been gradually deployed in biomedical devices and assistive robots for improving the quality of life of disabled and elderly people, among which electromyography (EMG) and electroencephalography (EEG) bio-signals are being used widely. This paper reviews the deployment of these bio-signals in the state of art of control systems. The main aim of this paper is to describe the techniques used for (i) collecting EMG and EEG signals and diving these signals into segments (data acquisition and data segmentation stage), (ii) dividing the important data and removing redundant data from the EMG and EEG segments (feature extraction stage), and (iii) identifying categories from the relevant data obtained in the previous stage (classification stage). Furthermore, this paper presents a summary of applications controlled through these two bio-signals and some research challenges in the creation of these control systems. Finally, a brief conclusion is summarized.

[1]  S. L. Shishkin,et al.  Application of the change-point analysis to the investigation of the brain’s electrical activity , 2000 .

[2]  Reza Boostani,et al.  Selection of relevant features for EEG signal classification of schizophrenic patients , 2007, Biomed. Signal Process. Control..

[3]  Mustafa Yilmaz,et al.  Classification of EMG signals using wavelet neural network , 2006, Journal of Neuroscience Methods.

[4]  Seyed Kamaledin Setarehdan,et al.  Kalman filter parameters as a new EEG feature vector for BCI applications , 2005, 2005 13th European Signal Processing Conference.

[5]  Junuk Chu,et al.  A Real-Time EMG Pattern Recognition System Based on Linear-Nonlinear Feature Projection for a Multifunction Myoelectric Hand , 2006, IEEE Transactions on Biomedical Engineering.

[6]  B. Brodsky,et al.  A nonparametric method for the segmentation of the EEG. , 1999, Computer methods and programs in biomedicine.

[7]  Tanu Sharma,et al.  A novel feature extraction for robust EMG pattern recognition , 2016, Journal of medical engineering & technology.

[8]  Christian Cipriani,et al.  Dexterous Control of a Prosthetic Hand Using Fine-Wire Intramuscular Electrodes in Targeted Extrinsic Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Michael Weeks,et al.  Digital Signal Processing Using Matlab And Wavelets , 2006 .

[10]  Nadine Eberhardt,et al.  Bioelectrical Signal Processing In Cardiac And Neurological Applications , 2016 .

[11]  Hiroki Tamura,et al.  A Study of the Electric Wheelchair Hands-Free Safety Control System Using the Surface-Electromygram of Facial Muscles , 2010, ICIRA.

[12]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[13]  George S. Moschytz,et al.  High-precision EMG signal decomposition using communication techniques , 2000, IEEE Trans. Signal Process..

[14]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[15]  Huosheng Hu,et al.  Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb , 2008, IEEE Transactions on Biomedical Engineering.

[16]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[17]  Amitava Chatterjee,et al.  Cross-correlation aided support vector machine classifier for classification of EEG signals , 2009, Expert Syst. Appl..

[18]  D. Gabor,et al.  Theory of communication. Part 1: The analysis of information , 1946 .

[19]  Rajesh P. N. Rao,et al.  Real-Time Classification of Electromyographic Signals for Robotic Control , 2005, AAAI.

[20]  Tamer Demiralp,et al.  Classification of electroencephalogram signals with combined time and frequency features , 2011, Expert Syst. Appl..

[21]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[23]  Jong-Sung Kim,et al.  A Study of an EMG-controlled HCI Method by Clenching Teeth , 2004, APCHI.

[24]  Joseph D. Bronzino,et al.  The Biomedical Engineering Handbook , 1995 .

[25]  Mohammad Reza Hashemi Golpayegani,et al.  Classification of chaotic signals using HMM classifiers:EEG-based mental task classification , 2005, 2005 13th European Signal Processing Conference.

[26]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[27]  Nicole Krämer,et al.  Time Domain Parameters as a feature for EEG-based Brain-Computer Interfaces , 2009, Neural Networks.

[28]  S. Gielen,et al.  The brain–computer interface cycle , 2009, Journal of neural engineering.

[29]  Toshio Tsuji,et al.  A Hybrid Motion Classification Approach for EMG-Based Human–Robot Interfaces Using Bayesian and Neural Networks , 2009, IEEE Transactions on Robotics.

[30]  Maryhelen Stevenson,et al.  Signal representation for classification of the transient myoelectric signal , 1998 .

[31]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[32]  Ramaswamy Palaniappan,et al.  Neural network classification of autoregressive features from electroencephalogram signals for brain–computer interface design , 2004, Journal of neural engineering.

[33]  C. Cipriani,et al.  The Effects of Weight and Inertia of the Prosthesis on the Sensitivity of Electromyographic Pattern Recognition in Relax State , 2012 .

[34]  Gernot R. Müller-Putz,et al.  "Virtual keyboard" controlled by spontaneous EEG activity , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  C.I. Christodoulou,et al.  Unsupervised pattern recognition for the classification of EMG signals , 1999, IEEE Transactions on Biomedical Engineering.

[36]  Zeung nam Bien,et al.  New EMG pattern Recognition based on Soft Computing Techniques and Its Application to Control of a Rehabilitation Robotic Arm , 2000 .

[37]  Arun V. Holden,et al.  Mathematical approaches to brain functioning diagnostics , 1991 .

[38]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  David G. Stork,et al.  Pattern Classification , 1973 .

[40]  Kemal Polat,et al.  Sleep spindles recognition system based on time and frequency domain features , 2011, Expert Syst. Appl..

[41]  D. Farina,et al.  Simultaneous and Proportional Estimation of Hand Kinematics From EMG During Mirrored Movements at Multiple Degrees-of-Freedom , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  G. Berns,et al.  BAD TO WORSE , 1975, The Lancet.

[43]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[44]  Huosheng Hu,et al.  EMG and visual based HMI for hands-free control of an intelligent wheelchair , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[45]  B. Darkhovsky,et al.  Macrostructural EEG characterization based on nonparametric change point segmentation: application to sleep analysis , 2001, Journal of Neuroscience Methods.

[46]  Wolfgang Rosenstiel,et al.  ResearchArticle Online Artifact Removal for Brain-Computer Interfaces Using Support Vector Machines and Blind Source Separation , 2007 .

[47]  Kyuwan Choi,et al.  Control of a Wheelchair by Motor Imagery in Real Time , 2008, IDEAL.

[48]  Dario Farina,et al.  Myoelectric Control of Artificial Limbs¿Is There a Need to Change Focus? [In the Spotlight] , 2012, IEEE Signal Process. Mag..

[49]  Yukihiro Matsubara,et al.  EMG pattern classification using hierarchical network based on boosting approach , 2009 .

[50]  Huosheng Hu,et al.  A Human – Computer Interface based on Forehead Multi-Channel Bio-signals to Control a Virtual Wheelchair , 2002 .

[51]  Han-Pang Huang,et al.  Development of a myoelectric discrimination system for a multi-degree prosthetic hand , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[52]  Ya-Ju Fan,et al.  On the Time Series $K$-Nearest Neighbor Classification of Abnormal Brain Activity , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[53]  R. Aufrichtigl,et al.  Adaptive Segmentation Of EEG Signals , 1991, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991.

[54]  Wolfgang Rosenstiel,et al.  Online Artifact Removal for Brain-Computer Interfaces Using Support Vector Machines and Blind Source Separation , 2007, Comput. Intell. Neurosci..

[55]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[56]  Ramaswamy Palaniappan.  Biological signal analysis , 2011 .

[57]  Brendan Z. Allison,et al.  Brain-Computer Interfaces , 2010 .

[58]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[59]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .

[60]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[61]  Bekir Karlik,et al.  Differentiating Type of Muscle Movement via AR Modeling and Neural Network Classification , 1999 .

[62]  Toshio Tsuji,et al.  A recurrent log-linearized Gaussian mixture network , 2003, IEEE Trans. Neural Networks.

[63]  Adrian D. C. Chan,et al.  Continuous myoelectric control for powered prostheses using hidden Markov models , 2005, IEEE Transactions on Biomedical Engineering.

[64]  Raymond T. Bowman.  Improvement of Federal Statistics , 1957 .

[65]  Dennis Gabor,et al.  Theory of communication , 1946 .

[66]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[67]  Fabien Lotte,et al.  The Use of Fuzzy Inference Systems for Classification in EEG-based Brain-Computer Interfaces , 2006 .

[68]  Ajat Shatru Arora,et al.  Comparison of the techniques used for sgmentation of EMG signals , 2009 .

[69]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[70]  K. Englehart,et al.  Classification of the myoelectric signal using time-frequency based representations. , 1999, Medical engineering & physics.

[71]  Paul S. Dwyer,et al.  Basic Instructions in Statistical Computations , 1957 .

[72]  Marie-Françoise Lucas,et al.  Multi-channel surface EMG classification using support vector machines and signal-based wavelet optimization , 2008, Biomed. Signal Process. Control..

[73]  J Gotman,et al.  An expert system for EEG monitoring in the pediatric intensive care unit. , 1998, Electroencephalography and clinical neurophysiology.

[74]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[75]  K. Englehart,et al.  Investigation of Optimum Pattern Recognition Methods for Robust Myoelectric Control During Dynamic Limb Movement , 2017 .

[76]  D. Wolfe,et al.  Nonparametric Statistical Methods. , 1974 .

[77]  Huosheng Hu,et al.  GA-based Feature Subset Selection for Myoelectric Classification , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[78]  R Biscay,et al.  Maximum a posteriori estimation of change points in the EEG. , 1995, International journal of bio-medical computing.

[79]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[80]  G.F. Inbar,et al.  Feature selection for the classification of movements from single movement-related potentials , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[81]  S. Shott,et al.  Nonparametric Statistics , 2018, The Encyclopedia of Archaeological Sciences.

[82]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[83]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[84]  Francisco Sepulveda,et al.  Classifying mental tasks based on features of higher-order statistics from EEG signals in brain-computer interface , 2008, Inf. Sci..

[85]  Richard D. Jones,et al.  Detection of epileptiform discharges in the EEG by a hybrid system comprising mimetic, self-organized artificial neural network, and fuzzy logic stages , 1999, Clinical Neurophysiology.

[86]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[87]  Kazuo Tanaka,et al.  Electroencephalogram-based control of an electric wheelchair , 2005, IEEE Transactions on Robotics.

[88]  Ajat Shatru Arora,et al.  EMG Diagnosis via AR Modeling and Binary Support Vector Machine Classification , 2010 .

[89]  Abdulhamit Subasi,et al.  EEG signal classification using PCA, ICA, LDA and support vector machines , 2010, Expert Syst. Appl..

[90]  G.F. Inbar,et al.  Classification of finger activation for use in a robotic prosthesis arm , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[91]  L. Lhotská,et al.  Electroencephalogram processing using Hidden Markov Models , 2004 .

[92]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.