> Replace This Line with Your Paper Identification Number (double-click Here to Edit) <

Passive brain-computer interaction (BCI) can provide useful information to understand a user's state and anticipate intentions, which is needed to support adaptivity and personalization. Given the huge variety of audiences, a game's capability of adapting to different user profiles-in particular to keep the player in flow-is crucial to make it ever more enjoyable and satisfying. We have performed a user experiment exploiting a four-electrode electroencephalogram (EEG) tool similar to the ones that are soon likely to appear in the market for game control. We have performed a spectral characterization of the video-gaming experience, also in comparison with other tasks. Results show that the most informative frequency bands for discriminating among gaming conditions are around low beta. Simple signals from the peripheral nervous system add marginal information. Classification of three levels of user states is possible, with good accuracy, using a support vector machine (SVM) classifier. A user-independent classification performs worse than a user-dependent approach (50.1% versus 66.4% rate). Personalized SVM training and validation time is reasonable (7-8 min). Thus, we argue that a personalized system could be implemented in a consumer context and research should aim at improving classifiers that can be trained online by end users.

[1]  Jeong-Hoon Shin,et al.  Implementation of a 3-Dimensional Game for developing balanced Brainwave , 2007, 5th ACIS International Conference on Software Engineering Research, Management & Applications (SERA 2007).

[2]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[3]  C. Joyce,et al.  Automatic removal of eye movement and blink artifacts from EEG data using blind component separation. , 2004, Psychophysiology.

[4]  Kalle Jegers,et al.  Pervasive game flow: understanding player enjoyment in pervasive gaming , 2007, CIE.

[5]  T. Martin McGinnity,et al.  EEG-based continuous control of a game using a 3 channel motor imagery BCI: BCI game , 2011, 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[6]  Qiang Wang,et al.  EEG-Based "Serious" Games Design for Medical Applications , 2010, 2010 International Conference on Cyberworlds.

[7]  F. Cincotti,et al.  High Resolution EEG Hyperscanning During a Card Game , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[9]  Lutz Jäncke,et al.  Anatomical left‐right asymmetry of language‐related temporal cortex is different in left‐ and right‐handers , 1991, Annals of neurology.

[10]  Anton Nijholt,et al.  Social Interaction in a Cooperative Brain-Computer Interface Game , 2011, INTETAIN.

[11]  Nadia Bianchi-Berthouze,et al.  Does Body Movement Engage You More in Digital Game Play? and Why? , 2007, ACII.

[12]  Liangxiao Jiang,et al.  Weightily Averaged One-Dependence Estimators , 2006, PRICAI.

[13]  Rafael Bidarra,et al.  In Press: Ieee Transactions on Computational Intelligence and Ai in Games Adaptivity Challenges in Games and Simulations: a Survey , 2022 .

[14]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[15]  Martin Anthony,et al.  London WC1E6BT , 2007 .

[16]  Matteo Toscani,et al.  Alpha waves: a neural signature of visual suppression , 2010, Experimental Brain Research.

[17]  Chih-Jen Lin,et al.  Combining SVMs with Various Feature Selection Strategies , 2006, Feature Extraction.

[18]  Mark Chen,et al.  Measuring Flow in a computer game simulating a foreign language environment , 2004 .

[19]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[20]  Girijesh Prasad,et al.  Self-paced brain-controlled wheelchair methodology with shared and automated assistive control , 2011, 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[21]  Dirk Heylen,et al.  Brain-Computer Interfacing and Games , 2010, Brain-Computer Interfaces.

[22]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[23]  Lennart E. Nacke,et al.  Electroencephalographic Assessment of Player Experience , 2011 .

[24]  Claude Frasson,et al.  A Theoretical and Empirical Approach in Assessing Motivational Factors: From Serious Games To an ITS , 2011, FLAIRS.

[25]  Daire Ó Broin.  Using a Criteria-Based User Model for Facilitating Flow in Serious Games , 2011, 2011 Third International Conference on Games and Virtual Worlds for Serious Applications.

[26]  Liangxiao Jiang,et al.  A Novel Bayes Model: Hidden Naive Bayes , 2009, IEEE Transactions on Knowledge and Data Engineering.

[27]  Antinus Nijholt,et al.  A Preliminary Survey on the Perception of Marketability of Brain-Computer Interfaces and Initial Development of a Repository of BCI Companies , 2011 .

[28]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[29]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[30]  Fabien Lotte,et al.  Brain-computer interfaces for 3D games: hype or hope? , 2011, FDG.

[31]  B. He,et al.  A High Resolution EEG Study of Dynamic Brain Activity during Video Game Play , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Robert J. K. Jacob,et al.  Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements , 2009, INTERACT.

[33]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[34]  Norbert Jaušovec,et al.  Differences in Cognitive Processes Between Gifted, Intelligent, Creative, and Average Individuals While Solving Complex Problems: An EEG Study , 2000 .

[35]  P. Putman,et al.  EEG theta/beta ratio in relation to fear-modulated response-inhibition, attentional control, and affective traits , 2010, Biological Psychology.

[36]  Anatole Lécuyer,et al.  Classifying EEG for brain computer interfaces using Gaussian processes , 2008, Pattern Recognit. Lett..

[37]  Sunny S. J. Lin,et al.  The Effects of Digital Games on Undergraduate Players' Flow Experiences and Affect , 2008, 2008 Second IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[38]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[39]  F Cincotti,et al.  Current trends in hardware and software for brain–computer interfaces (BCIs) , 2011, Journal of neural engineering.

[40]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[41]  Yang Xiang,et al.  On-line EEG classification for brain-computer interface based on CSP and SVM , 2010, 2010 3rd International Congress on Image and Signal Processing.

[42]  Darryl Charles,et al.  Toward an understanding of flow in video games , 2008, CIE.

[43]  Saeid Sanei,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[44]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[45]  Urbano Nunes,et al.  Playing Tetris with non-invasive BCI , 2011, 2011 IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH).

[46]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[47]  Jenova Chen,et al.  Flow in games (and everything else) , 2007, CACM.

[48]  C.W. Anderson,et al.  Comparison of linear, nonlinear, and feature selection methods for EEG signal classification , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  Jeanne H. Brockmyer,et al.  The Development of the Game Engagement Questionnaire: A Measure of Engagement in Video Game Playing: Response to Reviews , 2009, Interacting with computers.

[50]  Ian Pitt,et al.  Evaluating a Brain-Computer Interface to Categorise Human Emotional Response , 2010, 2010 10th IEEE International Conference on Advanced Learning Technologies.

[51]  Dirk Heylen,et al.  Affective Brain-Computer Interfaces (aBCI 2011) , 2011, ACII.

[52]  Claude Frasson,et al.  Modeling mental workload using EEG features for intelligent systems , 2011, UMAP'11.

[53]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[54]  L. McEvoy,et al.  Mental Effort‐Related EEG Modulation During Video‐Game Play: Comparison Between Juvenile Subjects with Epilepsy and Normal Control Subjects , 1999, Epilepsia.

[55]  Alessandro De Gloria,et al.  Adaptive Experience Engine for Serious Games , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[56]  Robert Oostenveld,et al.  The five percent electrode system for high-resolution EEG and ERP measurements , 2001, Clinical Neurophysiology.

[57]  Changchun Liu,et al.  Dynamic Difficulty Adjustment in Computer Games Through Real-Time Anxiety-Based Affective Feedback , 2009, Int. J. Hum. Comput. Interact..

[58]  Moritz Grosse-Wentrup,et al.  Critical issues in state-of-the-art brain–computer interface signal processing , 2011, Journal of neural engineering.

[59]  Insup Taylor,et al.  Psycholinguistics: Learning and Using Language , 1990 .

[60]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[61]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[62]  Damien Coyle,et al.  Investigating the Neural Correlates of Pathological Cortical Networks in Alzheimer's Disease Using Heterogeneous Neuronal Models , 2012, IEEE Transactions on Biomedical Engineering.