eeglib: computational analysis of cognitive performance during the use of video games

Cognitive training can improve mental abilities, and a novel method to apply it is trough video games. There is controversy about the effectiveness of commercial video games for brain training, therefore it is necessary to assess the utility of these kinds of games. One quantitative method to assess it is electroencephalography (EEG), a non-invasive technique to study brain activity. This paper explores the use of EEG and video games together to find what are the most used techniques when analyzing the signals by means of a systematic review. From the results of that review two partial contributions were obtained: a taxonomy of techniques to analyze EEG signals, and a ranking of these techniques based on their popularity. The partial contributions were the departure point for working in the main contribution of this paper: eeglib, a Python library for analyzing EEG. The library was tested technically and functionally. The technical test was oriented to assess the correct output of certain algorithms, while the functional one consisted in analyzing data from two different experiments to check the effectiveness of the library.

[1]  J. W. Tukey,et al.  The Measurement of Power Spectra from the Point of View of Communications Engineering , 1958 .

[2]  Shihui Han,et al.  Oxytocin enhances inter-brain synchrony during social coordination in male adults. , 2016, Social cognitive and affective neuroscience.

[3]  José Miguel Latorre,et al.  Analyzing EEG waves to support the design of serious games for cognitive training , 2018, Journal of Ambient Intelligence and Humanized Computing.

[4]  Leo Galway,et al.  Towards emotion recognition for virtual environments: an evaluation of eeg features on benchmark dataset , 2017, Personal and Ubiquitous Computing.

[5]  Qiang Wang,et al.  Fractal dimension based neurofeedback in serious games , 2011, The Visual Computer.

[6]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..

[7]  George W Rebok,et al.  Effects of cognitive training interventions with older adults: a randomized controlled trial. , 2002, JAMA.

[8]  Alessandro De Gloria,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[9]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[10]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[11]  José Miguel Latorre,et al.  Correlation between videogame mechanics and executive functions through EEG analysis , 2016, J. Biomed. Informatics.

[12]  Dandan Huang,et al.  Towards a user-friendly brain–computer interface: Initial tests in ALS and PLS patients , 2010, Clinical Neurophysiology.

[13]  Desney S. Tan,et al.  Using a low-cost electroencephalograph for task classification in HCI research , 2006, UIST.

[14]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[15]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[16]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[17]  Helge J. Ritter,et al.  2009 Special Issue: The MindGame: A P300-based brain-computer interface game , 2009 .

[18]  Luis Rodriguez-Benitez,et al.  Computational EEG Analysis Techniques When Playing Video Games: A Systematic Review , 2018, UCAmI.

[19]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[20]  Debatri Chatterjee,et al.  Cognitive Load Detection on Commercial EEG Devices: An Optimized Signal Processing Chain , 2014, IoT360.

[21]  O. Bai,et al.  Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[23]  D. Narayana Dutt,et al.  Computing Fractal Dimension of Signals using Multiresolution Box-counting Method , 2010 .

[24]  Hong Wang,et al.  EEG-based expert system using complexity measures and probability density function control in alpha sub-band , 2013, Integr. Comput. Aided Eng..

[25]  Richard M. Leahy,et al.  A note on the phase locking value and its properties , 2013, NeuroImage.

[26]  A. Grossmann,et al.  DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE , 1984 .

[27]  C. R. Rao,et al.  The Utilization of Multiple Measurements in Problems of Biological Classification , 1948 .

[28]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[29]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[30]  T. Higuchi.  Approach to an irregular time series on the basis of the fractal theory , 1988 .

[31]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[32]  K. Schaie,et al.  Cognitive training and plasticity: theoretical perspective and methodological consequences. , 2009, Restorative neurology and neuroscience.

[33]  Jesús Favela,et al.  Assessing empathy and managing emotions through interactions with an affective avatar , 2018, Health Informatics J..

[34]  Ramón Hervás,et al.  Gamification mechanics for behavioral change: a systematic review and proposed taxonomy , 2017, PervasiveHealth.

[35]  Gert Pfurtscheller,et al.  Distinction Sensitive Learning Vector Quantisation-a new noise-insensitive classification method , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[36]  C. Peng,et al.  Mosaic organization of DNA nucleotides. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[37]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[38]  Ricardo Chavarriaga,et al.  Non-Invasive Brain-Machine Interaction , 2008, Int. J. Pattern Recognit. Artif. Intell..

[39]  S. Luck.  An Introduction to the Event-Related Potential Technique , 2005 .

[40]  Francesco G. B. De Natale,et al.  Introducing Neuroberry, a platform for pervasive EEG signaling in the IoT domain , 2015, IOT 2015.

[41]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[42]  Anton Nijholt,et al.  Affective Pacman: A Frustrating Game for Brain-Computer Interface Experiments , 2009, INTETAIN.

[43]  Kembro Jackelyn,et al.  Detrended Fluctuation Analysis , 2015 .