Multidimensional control using a mobile-phone based brain-muscle-computer interface

Many well-known brain-computer interfaces measure signals at the brain, and then rely on the brain's ability to learn via operant conditioning in order to control objects in the environment. In our lab, we have been developing brain-muscle-computer interfaces, which measure signals at a single muscle and then rely on the brain's ability to learn neuromuscular skills via operant conditioning. Here, we report a new mobile-phone based brain-muscle-computer interface prototype for severely paralyzed persons, based on previous results from our group showing that humans may actively create specified power levels in two separate frequency bands of a single sEMG signal. Electromyographic activity on the surface of a single face muscle (Auricularis superior) is recorded with a standard electrode. This analog electrical signal is imported into an Android-based mobile phone. User-modulated power in two separate frequency band serves as two separate and simultaneous control channels for machine control. After signal processing, the Android phone sends commands to external devices via Bluetooth. Users are trained to use the device via biofeedback, with simple cursor-to-target activities on the phone screen.

[1]  R. N. Scott,et al.  Error rate in five-state myoelectric control systems , 2006, Medical and Biological Engineering and Computing.

[2]  Geert Langereis,et al.  Contactless EMG sensors embroidered onto textile , 2007, BSN.

[3]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[4]  J. V. Basmajian,et al.  Control and Training of Individual Motor Units , 1963, Science.

[5]  E. Fetz Operant Conditioning of Cortical Unit Activity , 1969, Science.

[6]  T. Yin,et al.  Behavioral Studies of Sound Localization in the Cat , 1998, The Journal of Neuroscience.

[7]  John P. Donoghue,et al.  Connecting cortex to machines: recent advances in brain interfaces , 2002, Nature Neuroscience.

[8]  Rory A Cooper,et al.  Joystick control for powered mobility: current state of technology and future directions. , 2010, Physical medicine and rehabilitation clinics of North America.

[9]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Shirley G Fitzgerald,et al.  Comparison of virtual and real electric powered wheelchair driving using a position sensing joystick and an isometric joystick. , 2002, Medical engineering & physics.

[11]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[12]  S. S. Joshi,et al.  Brain–Muscle–Computer Interface: Mobile-Phone Prototype Development and Testing , 2011, IEEE Transactions on Information Technology in Biomedicine.

[13]  Carlo J. De Luca,et al.  Physiology and Mathematics of Myoelectric Signals , 1979 .

[14]  S. S. Joshi,et al.  Brain-muscle-computer interface using a single surface electromyographic signal: Initial results , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[15]  G. Pfurtscheller,et al.  Rapid prototyping of an EEG-based brain-computer interface (BCI) , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  R. N. Scott,et al.  A three-state myo-electric control , 1966, Medical and biological engineering.

[17]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[18]  Sanjay S Joshi,et al.  Two-Dimensional Cursor-to-Target Control From Single Muscle Site sEMG Signals , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Edward M. Schmidt,et al.  Single neuron recording from motor cortex as a possible source of signals for control of external devices , 2006, Annals of Biomedical Engineering.

[20]  Geert Langereis,et al.  Contactless sensors for Surface Electromyography , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Yu-Luen Chen,et al.  Application of tilt sensors in human-computer mouse interface for people with disabilities. , 2001, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[22]  E. Fetz Volitional control of neural activity: implications for brain–computer interfaces , 2007, The Journal of physiology.

[23]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.