EMG signal classification for human computer interaction: a review

With the ever increasing role of computerized machines in society, Human Computer Interaction (HCI) system has become an increasingly important part of our daily lives. HCI determines the effective utilization of the available information flow of the computing, communication, and display technologies. In recent years, there has been a tremendous interest in introducing intuitive interfaces that can recognize the user's body movements and translate them into machine commands. For the neural linkage with computers, various biomedical signals (biosignals) can be used, which can be acquired from a specialized tissue, organ, or cell system like the nervous system. Examples include Electro-Encephalogram (EEG), Electrooculogram (EOG), and Electromyogram (EMG). Such approaches are extremely valuable to physically disabled persons. Many attempts have been made to use EMG signal from gesture for developing HCI. EMG signal processing and controller work is currently proceeding in various direction including the development of continuous EMG signal classification for graphical controller, that enables the physically disabled to use word processing programs and other personal computer software, internet. It also enable manipulation of robotic devices, prosthesis limb, I/O for virtual reality games, physical exercise equipments etc. Most of the developmental area is based on pattern recognition using neural networks. The EMG controller can be programmed to perform gesture recognition based on signal analysis of groups of muscles action potential. This review paper is to discuss the various methodologies and algorithms used for EMG signal classification for the purpose of interpreting the EMG signal into computer command.

[1]  K. Horch,et al.  Acute peripheral nerve recording Characteristics of polymer-based longitudinal intrafascicular electrodes , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Silvestro Micera,et al.  On the intersubject generalization ability in extracting kinematic information from afferent nervous signals , 2003, IEEE Transactions on Biomedical Engineering.

[3]  Arie E. Kaufman,et al.  An eye tracking computer user interface , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[4]  Shumin Zhai,et al.  An isometric tongue pointing device , 1997, CHI.

[5]  Toshio Tsuji,et al.  A maximum likelihood neural network based on a log-linearized Gaussian mixture model , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[6]  Dinesh Kumar,et al.  Classification of EOG for human computer interface , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[7]  Marimuthu Palaniswami,et al.  Multi run ICA and surface EMG based signal processing system for recognising hand gestures , 2008, 2008 8th IEEE International Conference on Computer and Information Technology.

[8]  K. R. Wheeler.  Device control using gestures sensed from EMG , 2003, Proceedings of the 2003 IEEE International Workshop on Soft Computing in Industrial Applications, 2003. SMCia/03..

[9]  Inhyuk Moon,et al.  A novel EMG-based human-computer interface for persons with disability , 2004, Proceedings of the IEEE International Conference on Mechatronics, 2004. ICM '04..

[10]  S. Micera,et al.  On the Actuation of Thin Film Longitudinal Intrafascicular Electrodes , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[11]  Xu Zhang,et al.  Multiple Hand Gesture Recognition Based on Surface EMG Signal , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[12]  Hua Wang,et al.  Empathic tutoring software agents using real-time eye tracking , 2006, ETRA '06.

[13]  E. Curran,et al.  Learning to control brain activity: A review of the production and control of EEG components for driving brain–computer interface (BCI) systems , 2003, Brain and Cognition.

[14]  Touradj Ebrahimi,et al.  Brain-computer interface in multimedia communication , 2003, IEEE Signal Process. Mag..

[15]  N.V. Thakor,et al.  Accuracy of a Brain-Computer Interface in Subjects with Minimal Training , 2006, Proceedings of the IEEE 32nd Annual Northeast Bioengineering Conference.

[16]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[17]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[18]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[19]  Adrian D. C. Chan,et al.  Continuous myoelectric control for powered prostheses using hidden Markov models , 2005, IEEE Transactions on Biomedical Engineering.

[20]  Zdenek Kucerovsky,et al.  Design of an Electroocular Computing Interface , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[21]  Yoshiki Uchikawa,et al.  Development 01 eye pointer with free head-motion , 1998 .

[22]  O. Fukuda,et al.  FPGA implementation of a probabilistic neural network for a bioelectric human interface , 2004, The 2004 47th Midwest Symposium on Circuits and Systems, 2004. MWSCAS '04..

[23]  John G. Webster,et al.  Medical Instrumentation: Application and Design , 1997 .

[24]  M. Betke,et al.  The Camera Mouse: visual tracking of body features to provide computer access for people with severe disabilities , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Mohammad Ghavami,et al.  A Novel Blind Watermarking of ECG Signals on Medical Images Using EZW Algorithm , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Ki Hwan Eom,et al.  EMG pattern classification using spectral estimation and neural network , 2007, SICE Annual Conference 2007.

[27]  Wookho Son,et al.  A new means of HCI: EMG-MOUSE , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[28]  Guang Li,et al.  Development of an EOG (Electro-Oculography) Based Human-Computer Interface , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[29]  Mitsuo Kawato,et al.  Human interface using surface electromyography signals , 1996 .

[30]  K. Hashtrudi-Zaad,et al.  A Method for Online Estimation of Human Arm Dynamics , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Toshio Tsuji,et al.  A recurrent log-linearized Gaussian mixture network , 2003, IEEE Trans. Neural Networks.

[32]  M Adjouadi,et al.  A real-time assistive computer interface for users with motor disabilities , 1999, SIGC.

[33]  J.R. Wolpaw,et al.  BCI meeting 2005-workshop on signals and recording methods , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  F. Babiloni,et al.  Autoregressive spectral analysis in Brain Computer Interface context , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  R. Fazel-Rezai,et al.  A Low Cost Human Computer Interface based on Eye Tracking , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  R. Palaniappan,et al.  Brain Computer Interface Design Using Band Powers Extracted During Mental Tasks , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[38]  Elisabeth André,et al.  EMG-based hand gesture recognition for realtime biosignal interfacing , 2008, IUI '08.

[39]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[40]  Richard F. ff. Weir,et al.  CHAPTER 32 DESIGN OF ARTIFICIAL ARMS AND HANDS FOR PROSTHETIC APPLICATIONS , 2005 .

[41]  N. Shoylev,et al.  Neural Networks for Online Classification of Hand and Finger Movements Using Surface EMG signals , 2006, 2006 8th Seminar on Neural Network Applications in Electrical Engineering.

[42]  Junuk Chu,et al.  A Real-Time EMG Pattern Recognition System Based on Linear-Nonlinear Feature Projection for a Multifunction Myoelectric Hand , 2006, IEEE Transactions on Biomedical Engineering.

[43]  Toshio Tsuji,et al.  An EMG-controlled omnidirectional pointing device using a HMM-based neural network , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[44]  Thilo Hinterberger,et al.  BRAIN-COMPUTER INTERFACES FOR VERBAL COMMUNICATION , 2004 .

[45]  Edmund F. LoPresti,et al.  Neck range of motion and use of computer head controls , 2000, Assets '00.

[46]  M Adjouadi,et al.  A practical EMG-based human-computer interface for users with motor disabilities. , 2000, Journal of rehabilitation research and development.

[47]  Masaki Yoshida,et al.  Mouse cursor control system using EMG , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  K. Jellinger.  Toward Brain-Computer Interfacing , 2009 .

[49]  Eman M. El Daydamony,et al.  A Computerized System for SEMG Signals Analysis and Classification , 2008 .

[50]  R. B. Knapp,et al.  Real-time computer control using pattern recognition of the electromyogram , 1993, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Societ.

[51]  T. Stieglitz,et al.  A Naïve and Fast Human Computer Interface Controllable for the Inexperienced - a Performance Study , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[52]  Osamah A. Alsayegh.  EMG-based human-machine interface system , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[53]  G.R. Naik,et al.  Performance comparison of ICA algorithms for Isometric Hand gesture identification using Surface EMG , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[54]  Yu Sun,et al.  Static Hand Gesture Recognition and its Application based on Support Vector Machines , 2008, 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing.

[55]  William Z Rymer,et al.  Guest Editorial Brain–Computer Interface Technology: A Review of the Second International Meeting , 2001 .

[56]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[57]  N. D. Durie,et al.  Digest of papers , 1976 .

[58]  Robert Rosenberg.  The biofeedback pointer: EMG control of a two dimensional pointer , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[59]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[60]  J. Wolpaw,et al.  Multichannel EEG-based brain-computer communication. , 1994, Electroencephalography and clinical neurophysiology.

[61]  Kongqiao Wang,et al.  Hand Gesture Recognition Research Based on Surface EMG Sensors and 2D-accelerometers , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[62]  Yoshiaki Shirai,et al.  Robotic wheelchair based on observations of both user and environment , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[63]  E.S. Gopi,et al.  Brain Computer Interface Analysis using Wavelet Transforms and Auto Regressive Coefficients , 2006, 2006 International Conference on Electrical and Computer Engineering.

[64]  Chao Zhang,et al.  Implementation of the EOG-Based Human Computer Interface System , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[65]  Toshio Tsuji,et al.  An EMG controlled pointing device using a neural network , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[66]  Charles Jorgensen,et al.  Gestures as Input: Neuroelectric Joysticks and Keyboards , 2003, IEEE Pervasive Comput..

[67]  Howell O. Istance,et al.  Zooming interfaces!: enhancing the performance of eye controlled pointing devices , 2002, Assets '02.