Social Environments, Mixed Communication and Goal-Oriented Control Application Using a Brain-Computer Interface

For this study a P300 BCI speller application framework served as a base to explore the operation for three different applications. Subjects exchanged messages in the networks of (i) Twitter (Twitter Inc.) and socialized with other residents in Second Life (Linden Lab) and (ii) controlled a virtual smart home. Although the complexity of the various applications varied greatly, all three applications yielded similar results which are interesting for the general application of BCI for communication and control: (a) icons can be used together with characters in the interface masks and (b) more crucially, the BCI system does not need to be trained on each individual symbol and allows the use of icons for many different tasks without prior time consuming and boring training for each individual icon. Hence such a type of BCI system is more optimally suited for goal oriented control amongst currently available BCI systems.

[1]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[2]  Helge J. Ritter,et al.  2009 Special Issue: The MindGame: A P300-based brain-computer interface game , 2009 .

[3]  Mel Slater,et al.  Brain-computer interfaces for goal orientated control of a virtual smart home environment , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[4]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[5]  M. Thulasidas,et al.  Robust classification of EEG signal for brain-computer interface , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  C. Cinel,et al.  P300-Based BCI Mouse With Genetically-Optimized Analogue Control , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[8]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[9]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[12]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[13]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[14]  G. R. Muller,et al.  Brain oscillations control hand orthosis in a tetraplegic , 2000, Neuroscience Letters.

[15]  Cuntai Guan,et al.  Asynchronous P300-Based Brain--Computer Interfaces: A Computational Approach With Statistical Models , 2008, IEEE Transactions on Biomedical Engineering.

[16]  G. Pfurtscheller,et al.  Motor imagery and action observation: Modulation of sensorimotor brain rhythms during mental control of a brain–computer interface , 2009, Clinical Neurophysiology.

[17]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[19]  Ricardo Ron-Angevin,et al.  Brain–computer interface: Changes in performance using virtual reality techniques , 2009, Neuroscience Letters.

[20]  Mel Slater,et al.  Goal-Oriented Control with Brain-Computer Interface , 2009, HCI.

[21]  Tao Liu,et al.  N200-speller using motion-onset visual response , 2009, Clinical Neurophysiology.

[22]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[23]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Accurate performance from first-session in BCI-naive subjects , 2008, IEEE Transactions on Biomedical Engineering.

[24]  E. Donchin,et al.  EEG-based communication: prospects and problems. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  T. Komatsu.  A non-training EEG-based BMI system for environmental control , 2008 .