Brain Computer Interfaces for Mobile Apps: State-of-the-art and Future Directions

In recent times, there have been significant advancements in utilizing the sensing capabilities of mobile devices for developing applications. The primary objective has been to enhance the way a user interacts with the application by making it effortless and convenient. This paper explores the capabilities of using Brain Computer Interfaces (BCI), an evolving subset of Human Computer Interaction (HCI) paradigms, to control mobile devices. We present a comprehensive survey of the state-of-the-art in this area, discussing the challenges and limitations in using BCI for mobile applications. Further we propose possible modalities that in future can benefit with BCI applications. This paper consolidates research directions being pursued in this domain, and draws conclusions on feasibility and benefits of using BCI systems effectively augmented to the mobile application development domain.

[1]  Tzyy-Ping Jung,et al.  Developing stimulus presentation on mobile devices for a truly portable SSVEP-based BCI , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  G. Edlinger,et al.  BCI Integration: Application Interfaces , 2013 .

[3]  R. Homan,et al.  Cerebral location of international 10-20 system electrode placement. , 1987, Electroencephalography and clinical neurophysiology.

[4]  Tzyy-Ping Jung,et al.  Noninvasive Neural Prostheses Using Mobile and Wireless EEG , 2008, Proceedings of the IEEE.

[5]  José del R. Millán,et al.  Non-Invasive Brain-Actuated Control of a Mobile Robot , 2003, IJCAI.

[6]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.

[7]  Kazuhiko Takahashi,et al.  Remarks on EOG and EMG gesture recognition in hands-free manipulation system , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[8]  Frank H. Guenther,et al.  The unlock project: A Python-based framework for practical brain-computer interface communication “app” development , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[10]  S. S. Gupta,et al.  Detecting eye movements in EEG for controlling devices , 2012, 2012 IEEE International Conference on Computational Intelligence and Cybernetics (CyberneticsCom).

[11]  Li-Wei Ko,et al.  Review of Wireless and Wearable Electroencephalogram Systems and Brain-Computer Interfaces – A Mini-Review , 2009, Gerontology.

[12]  Cosima Prahm,et al.  Evaluation of consumer EEG device Emotiv EPOC , 2011 .

[13]  N. Chumerin,et al.  Designing a brain-computer interface controlled video-game using consumer grade EEG hardware , 2012, 2012 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC).

[14]  Shaohan Hu,et al.  NeuroPhone: brain-mobile phone interface using a wireless EEG headset , 2010, MobiHeld '10.

[15]  S. Sathiya Keerthi,et al.  Building Support Vector Machines with Reduced Classifier Complexity , 2006, J. Mach. Learn. Res..

[16]  Tzyy-Ping Jung,et al.  A Cell-Phone Based Brain-Computer Interface for Communication in Daily Life , 2010, AICI.

[17]  David Ewins,et al.  The Emotiv EPOC neuroheadset: an inexpensive method of controlling assistive technologies using facial expressions and thoughts? , 2011 .

[18]  Andrew L. Janke,et al.  Interpretation of Medical Imaging Data with a Mobile Application: A Mobile Digital Imaging Processing Environment , 2013, Front. Neurol..

[19]  José del R. Millán,et al.  The role of shared-control in BCI-based telepresence , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[20]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[21]  T. Jung,et al.  Dry and Noncontact EEG Sensors for Mobile Brain–Computer Interfaces , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Lars Kai Hansen,et al.  A Smartphone Interface for a Wireless EEG Headset with Real-Time 3D Reconstruction , 2011, ACII.

[23]  T. Jung,et al.  Assessing the feasibility of online SSVEP decoding in human walking using a consumer EEG headset , 2014, Journal of NeuroEngineering and Rehabilitation.

[24]  Anton Nijholt,et al.  Brain–Computer Interfaces for Multimodal Interaction: A Survey and Principles , 2012, Int. J. Hum. Comput. Interact..

[25]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Ricardo Chavarriaga,et al.  Workshops of the Fifth International Brain-Computer Interface Meeting: Defining the Future. , 2014, Brain computer interfaces.

[27]  G. Oriolo,et al.  Non-invasive brain–computer interface system: Towards its application as assistive technology , 2008, Brain Research Bulletin.

[28]  Anton Nijholt,et al.  BrainGain: BCI for HCI and Games , 2008 .

[29]  Anton Nijholt,et al.  BCI for Games: A 'State of the Art' Survey , 2008, ICEC.

[30]  P. Tallgren,et al.  Evaluation of commercially available electrodes and gels for recording of slow EEG potentials , 2005, Clinical Neurophysiology.

[31]  G. Edlinger,et al.  Architectures of laboratory-PC and mobile pocket PC brain-computer interfaces , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[32]  Ronald M. Aarts,et al.  A Survey of Stimulation Methods Used in SSVEP-Based BCIs , 2010, Comput. Intell. Neurosci..

[33]  Roderick Murray-Smith,et al.  Hex: Dynamics and Probabilistic Text Entry , 2003, European Summer School on Multi-AgentControl.

[34]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[35]  Michael Kai Petersen,et al.  Smartphones as pocketable labs: visions for mobile brain imaging and neurofeedback. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  Michael Tangermann,et al.  Towards User-Friendly Spelling with an Auditory Brain-Computer Interface: The CharStreamer Paradigm , 2014, PloS one.

[37]  Benjamin Blankertz,et al.  Two-dimensional auditory p300 speller with predictive text system , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[38]  P. Bifulco,et al.  A mobile EEG system with dry electrodes , 2008, 2008 IEEE Biomedical Circuits and Systems Conference.

[39]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[40]  Brendan Z. Allison,et al.  New input modalities for modern game design and virtual embodiment , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[41]  Enrico Costanza,et al.  Toward subtle intimate interfaces for mobile devices using an EMG controller , 2005, CHI.

[42]  S. Debener,et al.  Towards a truly mobile auditory brain-computer interface: exploring the P300 to take away. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[43]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[44]  Jayadeva Learning a hyperplane classifier by minimizing an exact bound on the VC dimension , 2015, Neurocomputing.

[45]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[46]  S. S. Joshi,et al.  Brain–Muscle–Computer Interface: Mobile-Phone Prototype Development and Testing , 2011, IEEE Transactions on Information Technology in Biomedicine.

[47]  Cuntai Guan,et al.  High performance P300 speller for brain-computer interface , 2004, IEEE International Workshop on Biomedical Circuits and Systems, 2004..

[48]  Alan F. Blackwell,et al.  Dasher—a data entry interface using continuous gestures and language models , 2000, UIST '00.

[49]  Yuan-Pin Lin,et al.  A mobile SSVEP-based brain-computer interface for freely moving humans: The robustness of canonical correlation analysis to motion artifacts , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[50]  Lars Kai Hansen,et al.  The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System , 2013, PloS one.

[51]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[52]  Yi Li,et al.  P300 based BCI messenger , 2009, 2009 ICME International Conference on Complex Medical Engineering.

[53]  J. Polich,et al.  On the relationship between EEG and P300: individual differences, aging, and ultradian rhythms. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[54]  Dong Ming,et al.  [Research progress on application of brain-computer-interface in mobile peripheral control]. , 2011, Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi.

[55]  Mike Baxter,et al.  Stepwise Discriminant Analysis in Archaeometry: a Critique , 1994 .

[56]  Maarten De Vos,et al.  P300 speller BCI with a mobile EEG system: comparison to a traditional amplifier , 2014, Journal of neural engineering.

[57]  Benjamin Blankertz,et al.  THE BERLIN BRAIN-COMPUTER INTERFACE PRESENTS THE NOVEL MENTAL TYPEWRITER HEX-O-SPELL , 2006 .

[58]  A Graser,et al.  BCI Demographics II: How Many (and What Kinds of) People Can Use a High-Frequency SSVEP BCI? , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.