A Supplementary System for a Brain-Machine Interface Based on Jaw Artifacts for the Bidimensional Control of a Robotic Arm

Non-invasive Brain-Machine Interfaces (BMIs) are being used more and more these days to design systems focused on helping people with motor disabilities. Spontaneous BMIs translate user's brain signals into commands to control devices. On these systems, by and large, 2 different mental tasks can be detected with enough accuracy. However, a large training time is required and the system needs to be adjusted on each session. This paper presents a supplementary system that employs BMI sensors, allowing the use of 2 systems (the BMI system and the supplementary system) with the same data acquisition device. This supplementary system is designed to control a robotic arm in two dimensions using electromyographical (EMG) signals extracted from the electroencephalographical (EEG) recordings. These signals are voluntarily produced by users clenching their jaws. EEG signals (with EMG contributions) were registered and analyzed to obtain the electrodes and the range of frequencies which provide the best classification results for 5 different clenching tasks. A training stage, based on the 2-dimensional control of a cursor, was designed and used by the volunteers to get used to this control. Afterwards, the control was extrapolated to a robotic arm in a 2-dimensional workspace. Although the training performed by volunteers requires 70 minutes, the final results suggest that in a shorter period of time (45 min), users should be able to control the robotic arm in 2 dimensions with their jaws. The designed system is compared with a similar 2-dimensional system based on spontaneous BMIs, and our system shows faster and more accurate performance. This is due to the nature of the control signals. Brain potentials are much more difficult to control than the electromyographical signals produced by jaw clenches. Additionally, the presented system also shows an improvement in the results compared with an electrooculographic system in a similar environment.

[1]  B. Hjorth.  An on-line transformation of EEG scalp potentials into orthogonal source derivations. , 1975, Electroencephalography and clinical neurophysiology.

[2]  A. Ubeda,et al.  Wireless and Portable EOG-Based Interface for Assisting Disabled People , 2011, IEEE/ASME Transactions on Mechatronics.

[3]  Stéphane Bonnet,et al.  Mental fatigue and working memory load estimation: Interaction and implications for EEG-based passive BCI , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  L.J. Trejo,et al.  Brain-computer interfaces for 1-D and 2-D cursor control: designs using volitional control of the EEG spectrum or steady-state visual evoked potentials , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Doru Talaba,et al.  P300-Based Brain-Neuronal Computer Interaction for Spelling Applications , 2013, IEEE Transactions on Biomedical Engineering.

[6]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[7]  R. Scherer,et al.  On the Automated Removal of Artifacts Related to Head Movement From the EEG , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[9]  O. Bai,et al.  Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Antti Savelainen,et al.  An introduction to EEG artifacts , 2010 .

[11]  S. Sokol,et al.  Visually evoked potentials: theory, techniques and clinical applications. , 1976, Survey of ophthalmology.

[12]  K. Takahashi,et al.  Remarks on multimodal nonverbal interface and its application to controlling mobile robot , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[13]  Andrés Úbeda,et al.  Empirical Analysis of the Integration of a BCI and an EOG Interface to Control a Robot Arm , 2013, IWINAC.

[14]  G. Plourde.  Auditory evoked potentials. , 2006, Best practice & research. Clinical anaesthesiology.

[15]  Thierry Dutoit,et al.  A subjective assessment of a P300 BCI system for lower-limb rehabilitation purposes , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Andrés Úbeda,et al.  Visual evoked potential-based brain-machine interface applications to assist disabled people , 2012, Expert Syst. Appl..

[17]  J. Juang,et al.  PID Control Using Presearched Genetic Algorithms for a MIMO System , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Brahim Hamadicharef.  Brain-Computer Interface (BCI) literature - a bibliometric study , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[19]  Ivan Volosyak,et al.  Toward BCI Wizard - best BCI approach for each user , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[20]  D. Rh.  International symposium on pain. , 1973 .

[21]  G.E. Birch,et al.  Facial EMG contamination of EEG signals: Characteristics and effects of spatial filtering , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[22]  M. Ochi,et al.  Quantitative assessment of myelopathy patients using motor evoked potentials produced by transcranial magnetic stimulation , 2010, European Spine Journal.

[23]  Timothy J. Dasey,et al.  Detection of multiple sclerosis with visual evoked potentials - an unsupervised computational intelligence system , 2000, IEEE Transactions on Information Technology in Biomedicine.

[24]  G Pfurtscheller,et al.  Real-time EEG analysis with subject-specific spatial patterns for a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  S. Tobimatsu,et al.  Parvocellular pathway impairment in autism spectrum disorder: Evidence from visual evoked potentials , 2011 .

[26]  Yili Liu,et al.  Using a Head-up Display-Based Steady-State Visually Evoked Potential Brain–Computer Interface to Control a Simulated Vehicle , 2014, IEEE Transactions on Intelligent Transportation Systems.

[27]  M. Bergamasco,et al.  A New Gaze-BCI-Driven Control of an Upper Limb Exoskeleton for Rehabilitation in Real-World Tasks , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Andrés Úbeda,et al.  Control of a 2 DoF robot using a Brain-Machine Interface , 2014, Comput. Methods Programs Biomed..

[29]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[30]  Damien Coyle,et al.  Games, Gameplay, and BCI: The State of the Art , 2013, IEEE Transactions on Computational Intelligence and AI in Games.