Human-machine interfaces based on EMG and EEG applied to robotic systems

BackgroundTwo different Human-Machine Interfaces (HMIs) were developed, both based on electro-biological signals. One is based on the EMG signal and the other is based on the EEG signal. Two major features of such interfaces are their relatively simple data acquisition and processing systems, which need just a few hardware and software resources, so that they are, computationally and financially speaking, low cost solutions. Both interfaces were applied to robotic systems, and their performances are analyzed here. The EMG-based HMI was tested in a mobile robot, while the EEG-based HMI was tested in a mobile robot and a robotic manipulator as well.ResultsExperiments using the EMG-based HMI were carried out by eight individuals, who were asked to accomplish ten eye blinks with each eye, in order to test the eye blink detection algorithm. An average rightness rate of about 95% reached by individuals with the ability to blink both eyes allowed to conclude that the system could be used to command devices. Experiments with EEG consisted of inviting 25 people (some of them had suffered cases of meningitis and epilepsy) to test the system. All of them managed to deal with the HMI in only one training session. Most of them learnt how to use such HMI in less than 15 minutes. The minimum and maximum training times observed were 3 and 50 minutes, respectively.ConclusionSuch works are the initial parts of a system to help people with neuromotor diseases, including those with severe dysfunctions. The next steps are to convert a commercial wheelchair in an autonomous mobile vehicle; to implement the HMI onboard the autonomous wheelchair thus obtained to assist people with motor diseases, and to explore the potentiality of EEG signals, making the EEG-based HMI more robust and faster, aiming at using it to help individuals with severe motor dysfunctions.

[1]  Panagiotis K. Artemiadis,et al.  Teleoperation of a robot manipulator using EMG signals and a position tracker , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  M.W. Jiang,et al.  EMG Signal Classification for Myoelectric Teleoperating a Dexterous Robot Hand , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[3]  José Carlos Príncipe,et al.  Bimodal brain-machine interface for motor control of robotic prosthetic , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[4]  J. Mourino,et al.  Asynchronous BCI and local neural classifiers: an overview of the adaptive brain interface project , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Georg Dorffner,et al.  Detection of the EEG Artifacts by the Means of the (Extended) Kalman Filter , 2001 .

[6]  Bozenna Pasik-Duncan,et al.  EEG ocular artifact removal through ARMAX model system identification using extended least squares , 2003, Commun. Inf. Syst..

[7]  M. Sarcinelli-Filho,et al.  Teleoperation of an Industrial Manipulator Through a TCP/IP Channel Using EEG Signals , 2006, 2006 IEEE International Symposium on Industrial Electronics.

[8]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[9]  José del R. Millán,et al.  You Are Wrong! - Automatic Detection of Interaction Errors from Brain Waves , 2005, IJCAI.

[10]  Jeong-Su Han,et al.  Human-machine interface for wheelchair control with EMG and its evaluation , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[11]  José del R. Millán,et al.  Non-Invasive Brain-Actuated Control of a Mobile Robot , 2003, IJCAI.

[12]  Nilanjan Sarkar,et al.  EMG-based high level human-robot interaction system for people with disability , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[13]  Panagiotis K. Artemiadis,et al.  EMG-based teleoperation of a robot arm in planar catching movements using ARMAX model and trajectory monitoring techniques , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[15]  T.F.B. Filho,et al.  Human-Machine Interface Based on Electro-Biological Signals for Mobile Vehicles , 2006, 2006 IEEE International Symposium on Industrial Electronics.

[16]  Junuk Chu,et al.  Wearable EMG-based HCI for Electric-Powered Wheelchair Users with Motor Disabilities , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[17]  Inhyuk Moon,et al.  Intelligent robotic wheelchair with EMG-, gesture-, and voice-based interfaces , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).