Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements

Passive brain-computer interfaces are designed to use brain activity as an additional input, allowing the adaptation of the interface in real time according to the user's mental state. The goal of the present study is to distinguish between different levels of game difficulty using non-invasive brain activity measurement with functional near-infrared spectroscopy (fNIRS). The study is designed to lead to adaptive interfaces that respond to the user's brain activity in real time. Nine subjects played two levels of the game Pacman while their brain activity was measured using fNIRS. Statistical analysis and machine learning classification results show that we can discriminate well between subjects playing or resting, and distinguish between the two levels of difficulty with some success. In contrast to most previous fNIRS studies which only distinguish brain activity from rest, we attempt to tell apart two levels of brain activity, and our results show potential for using fNIRS in an adaptive game or user interface.

[1]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[2]  Yushiro Yamashita,et al.  Prefrontal cerebral blood volume patterns while playing video games—A near-infrared spectroscopy study , 2006, Brain and Development.

[3]  Shirley Coyle,et al.  On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. , 2004, Physiological measurement.

[4]  Philippe A. Palanque,et al.  Human-Computer Interaction – INTERACT 2007 , 2007, Lecture Notes in Computer Science.

[5]  Edward Cutrell,et al.  BCI for passive input in HCI , 2007 .

[6]  Roel Vertegaal,et al.  Towards a Physiological Model of User Interruptability , 2007, INTERACT.

[7]  Brendan Z. Allison,et al.  Workload assessment of computer gaming using a single-stimulus event-related potential paradigm , 2008, Biological Psychology.

[8]  N. Mukawa,et al.  Brain Activity Comparison of Different-Genre Video Game Players , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[9]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[10]  M. Herrmann,et al.  Prefrontal activation through task requirements of emotional induction measured with NIRS , 2003, Biological Psychology.

[11]  Desney S. Tan,et al.  Using a low-cost electroencephalograph for task classification in HCI research , 2006, UIST.

[12]  Erin M. Nishimura,et al.  A new approach to functional near-infrared technology , 2007, IEEE Engineering in Medicine and Biology Magazine.

[13]  Kazuo Hiraki,et al.  Sustained decrease in oxygenated hemoglobin during video games in the dorsal prefrontal cortex: A NIRS study of children , 2006, NeuroImage.

[14]  Michael E. Smith,et al.  Neurophysiological measures of cognitive workload during human-computer interaction , 2003 .

[15]  Robert J. K. Jacob,et al.  Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy , 2009, CHI.

[16]  A. Villringer,et al.  Non-invasive optical spectroscopy and imaging of human brain function , 1997, Trends in Neurosciences.

[17]  Britton Chance,et al.  Functional Optical Brain Imaging Using Near-Infrared During Cognitive Tasks , 2004, Int. J. Hum. Comput. Interact..

[18]  Desney S. Tan,et al.  Brain-computer interfaces for hci and games , 2008, CHI Extended Abstracts.

[19]  K. Hiraki,et al.  Prefrontal Cortex Deactivation During Video Game Play , 2005 .

[20]  Thomas G. Dietterich.  Machine Learning for Sequential Data: A Review , 2002, SSPR/SPR.

[21]  S. Cerutti,et al.  Non-invasive neuroimaging: Generalized Linear Models for interpreting functional Near Infrared Spectroscopy signals , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[22]  Meltem Izzetoglu,et al.  Detecting deception in the brain: a functional near-infrared spectroscopy study of neural correlates of intentional deception , 2005, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[23]  S. Bunce,et al.  Functional near-infrared spectroscopy , 2006, IEEE Engineering in Medicine and Biology Magazine.

[24]  Graham J Hole,et al.  How to Design and Report Experiments , 2002 .

[25]  Edwin R. Hancock,et al.  Structural, Syntactic, and Statistical Pattern Recognition, Joint IAPR International Workshop, SSPR&SPR 2010, Cesme, Izmir, Turkey, August 18-20, 2010. Proceedings , 2010, SSPR/SPR.