Towards Serious Games for Improved BCI

Abstract : Brain-computer interface (BCI) technologies, or technologies that use online brain signal processing, have a great promise to improve human interactions with computers, their environment, and even other humans. Despite this promise, there are no current serious BCI technologies in widespread use, due to the lack of robustness in BCI technologies. The key neural aspect of this lack of robustness is human variability, which has two main components: (1) individual differences in neural signals and (2) intraindividual variability over time. In order to develop widespread BCI technologies, it will be necessary to address this lack of robustness. However, it is currently unknown how neural variability affects BCI performance. To accomplish these goals, it is essential to obtain data from large numbers of individuals using BCI technologies over considerable lengths of time. One promising method for this is through the use of BCI technologies embedded into games with a purpose (GWAP). GWAP are a game-based form of crowdsourcing which players choose to play for enjoyment and during which the player performs key tasks which cannot be automated but that are required to solve research questions. By embedding BCI paradigms in GWAP and recording neural and behavioral data, it should be possible to much more clearly understand the differences in neural signals between individuals and across different time scales, enabling the development of novel and increasingly robust adaptive BCI algorithms.

[1]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[2]  Daniel J Buysse,et al.  The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research , 1989, Psychiatry Research.

[3]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[4]  Tzyy-Ping Jung,et al.  Real-World Neuroimaging Technologies , 2013, IEEE Access.

[5]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[6]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[7]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[8]  T. Jung,et al.  Assessing the feasibility of online SSVEP decoding in human walking using a consumer EEG headset , 2014, Journal of NeuroEngineering and Rehabilitation.

[9]  A S Gevins,et al.  Computer rejection of EEG artifact. II. Contamination by drowsiness. , 1977, Electroencephalography and clinical neurophysiology.

[10]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[11]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[12]  Paul A. Cairns,et al.  A grounded investigation of game immersion , 2004, CHI EA '04.

[13]  Tzyy-Ping Jung,et al.  EEG-based drowsiness estimation for safety driving using independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[14]  Scott E. Kerick,et al.  Brain–Computer Interface Technologies in the Coming Decades , 2012, Proceedings of the IEEE.

[15]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[16]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[17]  Clemens Brunner,et al.  Single-trial connectivity estimation for classification of motor imagery data , 2013, Journal of neural engineering.

[18]  Luis von Ahn Games with a Purpose , 2006, Computer.

[19]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[20]  Tzyy-Ping Jung,et al.  Biosensor Technologies for Augmented Brain–Computer Interfaces in the Next Decades , 2012, Proceedings of the IEEE.

[21]  Bruce Phillips,et al.  Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems , 2008, CHI.

[22]  Jon Touryan,et al.  Estimating endogenous changes in task performance from EEG , 2014, Front. Neurosci..

[23]  Venkatesh Balasubramanian,et al.  EEG based analysis of cognitive fatigue during simulated driving , 2011 .

[24]  G. Matthews,et al.  Task-induced fatigue states and simulated driving performance , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[25]  Shih-Fu Chang,et al.  Neurally and ocularly informed graph-based models for searching 3D environments , 2014, Journal of neural engineering.

[26]  C. Grozea,et al.  Bristle-sensors—low-cost flexible passive dry EEG electrodes for neurofeedback and BCI applications , 2011, Journal of neural engineering.

[27]  José del R. Millán,et al.  Context-Based Filtering for Assisted Brain-Actuated Wheelchair Driving , 2007, Comput. Intell. Neurosci..

[28]  Damien Coyle,et al.  Games, Gameplay, and BCI: The State of the Art , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[29]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[30]  Chin-Teng Lin,et al.  A Novel 16-Channel Wireless System for Electroencephalography Measurements With Dry Spring-Loaded Sensors , 2014, IEEE Transactions on Instrumentation and Measurement.

[31]  Neil B. Rappaport,et al.  A daily stress inventory: Development, reliability, and validity , 1987, Journal of Behavioral Medicine.

[32]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[33]  Tzyy-Ping Jung,et al.  A brain-machine interface using dry-contact, low-noise EEG sensors , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[34]  T. Sejnowski,et al.  Estimating alertness from the EEG power spectrum , 1997, IEEE Transactions on Biomedical Engineering.

[35]  Leandro Schwarz,et al.  Pupil and iris detection in dynamic pupillometry using the OpenCV library , 2012, 2012 5th International Congress on Image and Signal Processing.

[36]  Shih-Fu Chang,et al.  Closing the loop in cortically-coupled computer vision: a brain–computer interface for searching image databases , 2011, Journal of neural engineering.

[37]  T O Zander,et al.  Context-aware brain–computer interfaces: exploring the information space of user, technical system and environment , 2012, Journal of neural engineering.

[38]  Daniel A. Sternberg,et al.  The largest human cognitive performance dataset reveals insights into the effects of lifestyle factors and aging , 2013, Front. Hum. Neurosci..

[39]  Claus Bahlmann,et al.  In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision , 2010, Proceedings of the IEEE.

[40]  Z. Popovic,et al.  Crystal structure of a monomeric retroviral protease solved by protein folding game players , 2011, Nature Structural &Molecular Biology.

[41]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[42]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[43]  Geng Liu,et al.  Algorithm and Data Optimization Techniques for Scaling to Massively Threaded Systems , 2012, Computer.

[44]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[45]  Dirk Heylen,et al.  Brain-Computer Interfacing and Games , 2010, Brain-Computer Interfaces.

[46]  Christian Mühl,et al.  EEG-based workload estimation across affective contexts , 2014, Front. Neurosci..

[47]  L. S. Frishkopf,et al.  Extracranial Responses to Acoustic Clicks in Man , 1958, Science.

[48]  Yun Li,et al.  Prestimulus alpha power predicts fidelity of sensory encoding in perceptual decision making , 2014, NeuroImage.

[49]  Brent Lance,et al.  Optimal Arousal Identification and Classification for Affective Computing Using Physiological Signals: Virtual Reality Stroop Task , 2010, IEEE Transactions on Affective Computing.

[50]  Adam T. Biggs,et al.  The Ultra-Rare-Item Effect , 2014, Psychological science.