Using a low-cost electroencephalograph for task classification in HCI research

Modern brain sensing technologies provide a variety of methods for detecting specific forms of brain activity. In this paper, we present an initial step in exploring how these technologies may be used to perform task classification and applied in a relevant manner to HCI research. We describe two experiments showing successful classification between tasks using a low-cost off-the-shelf electroencephalograph (EEG) system. In the first study, we achieved a mean classification accuracy of 84.0% in subjects performing one of three cognitive tasks - rest, mental arithmetic, and mental rotation - while sitting in a controlled posture. In the second study, conducted in more ecologically valid setting for HCI research, we attained a mean classification accuracy of 92.4% using three tasks that included non-cognitive features: a relaxation task, playing a PC based game without opponents, and engaging opponents within the game. Throughout the paper, we provide lessons learned and discuss how HCI researchers may utilize these technologies in their work.

[1]  Yoshifumi Kitamura,et al.  Things happening in the brain while humans learn to use new tools , 2003, CHI '03.

[2]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[3]  Bruce J. Fisch,et al.  Fisch and Spehlmann's Eeg Primer: Basic Principles of Digital and Analog Eeg , 1999 .

[4]  Z. Keirn,et al.  A new mode of communication between man and his surroundings , 1990, IEEE Transactions on Biomedical Engineering.

[5]  Charles W. Anderson,et al.  Classification of EEG Signals from Four Subjects During Five Mental Tasks , 2007 .

[6]  José del R. Millán,et al.  Adaptive brain interfaces , 2003, Commun. ACM.

[7]  K. Pope,et al.  Cognitive tasks augment gamma EEG power , 2004, Clinical Neurophysiology.

[8]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[9]  T. Cutmore,et al.  Identifying and reducing noise in psychophysiological recordings. , 1999, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[10]  James Fogarty,et al.  Examining task engagement in sensor-based statistical models of human interruptibility , 2005, CHI.

[11]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[12]  Roel Vertegaal,et al.  Using mental load for managing interruptions in physiologically attentive user interfaces , 2004, CHI EA '04.

[13]  John Paulin Hansen,et al.  New technological windows into mind: there is more in eyes and brains for human-computer interaction , 1996, CHI.

[14]  J. Doyle,et al.  EEG patterns during 'cognitive' tasks. II. Analysis of controlled tasks. , 1979, Electroencephalography and clinical neurophysiology.

[15]  Margot J. Taylor,et al.  Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. , 2000, Psychophysiology.

[16]  P. Hazemann,et al.  Handbook of Electroencephalography and Clinical Neurophysiology , 1975 .

[17]  A S Gevins,et al.  EEG patterns during 'cognitive' tasks. I. Methodology and analysis of complex behaviors. , 1979, Electroencephalography and clinical neurophysiology.

[18]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[19]  G.J.M. van Boxtel,et al.  Computational and statistical methods for analyzing event-related potential data , 1998 .

[20]  R. Palaniappan,et al.  Brain Computer Interface Design Using Band Powers Extracted During Mental Tasks , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[21]  Ian Witten,et al.  Data Mining , 2000 .

[22]  Robert Du,et al.  Towards measurement of brain function in operational environments , 1995, Biological Psychology.

[23]  G.E. Birch,et al.  A general framework for brain-computer interface design , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.