Controlling a Tactile ERP–BCI in a Dual Task

When using brain-computer interfaces (BCIs) to control a game, the BCI may have to compete with gaming tasks for the same perceptual and cognitive resources. We investigated: 1) if and to what extent event-related potentials (ERPs) and ERP-BCI performance are affected in a dual-task situation; and 2) if these effects are an area function of the level of difficulty of a concurrent task. Ten participants performed an ERP-BCI task that involved attending to a target location in sequences of tactile stimuli. The ERP-BCI task was performed either in isolation or secondary to a visual n-back task with two levels of difficulty. We observed: 1) a decreased P300 and BCI bit rate, and an increased level of subjective mental effort for both dual-task conditions compared to the BCI-only condition; the decreased classification accuracies were still well above chance, but arguably too low for effective BCI control; and 2) we did not find an effect of task difficulty on the P300, bit rates, and subjective mental effort. We discuss reallocation of attention caused by a concurrent task, but unaffected by task difficulty, and the role of task priority. Concluding, control of a tactile ERP-BCI in a dual-task situation is feasible, but performance is degraded.

[1]  Desney S. Tan,et al.  Feasibility and pragmatics of classifying working memory load with an electroencephalograph , 2008, CHI.

[2]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[3]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[4]  Robert Oostenveld,et al.  Estimating workload using EEG spectral power and ERPs in the n-back task , 2012, Journal of neural engineering.

[5]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[6]  T. Kida,et al.  Dual-task repetition alters event-related brain potentials and task performance , 2012, Clinical Neurophysiology.

[7]  J. V. Van Erp,et al.  Presenting directions with a vibrotactile torso display , 2005, Ergonomics.

[8]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[9]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[10]  Frank L. Greitzer,et al.  Cognitive science implications for enhancing training effectiveness in a serious gaming context , 2007, JERC.

[11]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[12]  Christa Neuper,et al.  Impact of auditory distraction on user performance in a brain–computer interface driven by different mental tasks , 2011, Clinical Neurophysiology.

[13]  T. Wasaka,et al.  Resource allocation and somatosensory P300 amplitude during dual task: effects of tracking speed and predictability of tracking direction , 2004, Clinical Neurophysiology.

[14]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.

[15]  C D Wickens,et al.  An Analysis of the Processing Requirements of a Complex Perceptual-Motor Task , 1983, Human factors.

[16]  T. Kida,et al.  Modulation of somatosensory processing in dual tasks: an event-related brain potential study , 2011, Experimental Brain Research.

[17]  S. Senthilkumar,et al.  Non-Invasive Brain-Machine Interaction , 2014 .

[18]  J A Veltman,et al.  Tactile cueing effects on performance in simulated aerial combat with high acceleration. , 2007, Aviation, space, and environmental medicine.

[19]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[20]  Benjamin Blankertz,et al.  Does bimodal stimulus presentation increase ERP components usable in BCIs? , 2012, Journal of neural engineering.

[21]  A. Kok Event-related-potential (ERP) reflections of mental resource̊s: a review and synthesis , 1997, Biological Psychology.

[22]  J. Wolpaw,et al.  Does the ‘P300’ speller depend on eye gaze? , 2010, Journal of neural engineering.

[23]  Ali Bahramisharif,et al.  Brain-computer interfacing using modulations of alpha activity induced by covert shifts of attention , 2011, Journal of NeuroEngineering and Rehabilitation.

[24]  C D Wickens,et al.  Compatibility and Resource Competition between Modalities of Input, Central Processing, and Output , 1983, Human factors.

[25]  Marieke E. Thurlings,et al.  BCIs in Multimodal Interaction and Multitask Environments: Theoretical Issues and Initial Guidelines , 2011, HCI.

[26]  Hillel Pratt,et al.  A comparison of sentence- and discourse-level semantic processing: An ERP study , 2002, Brain and Language.

[27]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[28]  C D Wickens,et al.  The Event-Related Brain Potential as an Index of Display-Monitoring Workload , 1980, Human factors.

[29]  Ricardo Chavarriaga,et al.  Non-Invasive Brain-Machine Interaction , 2008, Int. J. Pattern Recognit. Artif. Intell..

[30]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[31]  Urbano Nunes,et al.  Playing Tetris with non-invasive BCI , 2011, 2011 IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH).

[32]  Jan B. F. van Erp,et al.  Presenting directions with a vibrotactile torso display. , 2005 .

[33]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[34]  G. Geffen,et al.  The n-back as a dual-task: P300 morphology under divided attention. , 2001, Psychophysiology.

[35]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[36]  Bettina Forster,et al.  ERP correlates of tactile spatial attention differ under intra- and intermodal conditions , 2009, Biological Psychology.

[37]  F. Lenz,et al.  Sequential neural processes of tactile–visual crossmodal working memory , 2006, Neuroscience.

[38]  Arthur F. Kramer,et al.  Assessing the development of automatic processing: An application of dual-task and event-related brain potential methodologies , 1988, Biological Psychology.

[39]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  Marieke E. Thurlings,et al.  EEG-Based Navigation from a Human Factors Perspective , 2010, Brain-Computer Interfaces.

[41]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[42]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[43]  G. Pfurtscheller,et al.  Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  F.R.H. Zijlstra,et al.  Efficiency in work behaviour: A design approach for modern tools , 1993 .

[45]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[46]  N. Birbaumer,et al.  Predictability of Brain-Computer Communication , 2004 .

[47]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[48]  W. Verwey,et al.  Detecting short periods of elevated workload: A comparison of nine workload assessment techniques , 1996 .

[49]  V. Ponomarev,et al.  Comparative efficiencies of different methods for removing blink artifacts in analyzing quantitative electroencephalogram and event-related potentials , 2009, Human Physiology.

[50]  Benjamin Blankertz,et al.  Control-display mapping in brain–computer interfaces , 2012, Ergonomics.

[51]  E. Donchin,et al.  P300 and tracking difficulty: evidence for multiple resources in dual-task performance. , 1980, Psychophysiology.