Brain Painting: First Evaluation of a New Brain–Computer Interface Application with ALS-Patients and Healthy Volunteers

Brain–computer interfaces (BCIs) enable paralyzed patients to communicate; however, up to date, no creative expression was possible. The current study investigated the accuracy and user-friendliness of P300-Brain Painting, a new BCI application developed to paint pictures using brain activity only. Two different versions of the P300-Brain Painting application were tested: A colored matrix tested by a group of ALS-patients (n = 3) and healthy participants (n = 10), and a black and white matrix tested by healthy participants (n = 10). The three ALS-patients achieved high accuracies; two of them reaching above 89% accuracy. In healthy subjects, a comparison between the P300-Brain Painting application (colored matrix) and the P300-Spelling application revealed significantly lower accuracy and P300 amplitudes for the P300-Brain Painting application. This drop in accuracy and P300 amplitudes was not found when comparing the P300-Spelling application to an adapted, black and white matrix of the P300-Brain Painting application. By employing a black and white matrix, the accuracy of the P300-Brain Painting application was significantly enhanced and reached the accuracy of the P300-Spelling application. ALS-patients greatly enjoyed P300-Brain Painting and were able to use the application with the same accuracy as healthy subjects. P300-Brain Painting enables paralyzed patients to express themselves creatively and to participate in the prolific society through exhibitions.

[1]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[2]  E. Deci.  INTRINSIC MOTIVATION, EXTRINSIC REINFORCEMENT, AND INEQUITY , 1972 .

[3]  N. Cowan.  Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. , 1988, Psychological bulletin.

[4]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[5]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[6]  S. Rose.  Selective attention , 1992, Nature.

[7]  J Theeuwes,et al.  Visual selective attention: a theoretical analysis. , 1993, Acta psychologica.

[8]  J. Browne,et al.  The Schedule for the Evaluation of Individual Quality of Life (SEIQoL): a Direct Weighting procedure for Quality of Life Domains (SEIQoL-DW). Administration Manual. , 1993 .

[9]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[10]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[11]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[12]  Regina Vollmeyer,et al.  FAM: Ein Fragebogen zur Erfassung aktuller Motivation in Lern- und Leistungssituationen , 2001 .

[13]  I. Magnano,et al.  Visual and auditory event-related potentials in sporadic amyotrophic lateral sclerosis , 2002, Clinical Neurophysiology.

[14]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[15]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[16]  J. Browne,et al.  Development of a direct weighting procedure for quality of life domains , 1997, Quality of Life Research.

[17]  N. Birbaumer,et al.  Predictability of Brain-Computer Communication , 2004 .

[18]  Andrea Kübler,et al.  Brain-computer interfaces--the key for the conscious brain locked into a paralyzed body. , 2005, Progress in brain research.

[19]  Niels Birbaumer,et al.  Das ALS-Depressionsinventar (ADI): , 2005 .

[20]  Niels Birbaumer,et al.  Severity of Depressive Symptoms and Quality of Life in Patients with Amyotrophic Lateral Sclerosis , 2005, Neurorehabilitation and neural repair.

[21]  J. Theeuwes,et al.  Electrophysiological Evidence of the Capture of Visual Attention , 2006, Journal of Cognitive Neuroscience.

[22]  Gernot R. Müller-Putz,et al.  Brain-computer interfaces for control of neuroprostheses: from synchronous to asynchronous mode of operation / Brain-Computer Interfaces zur Steuerung von Neuroprothesen: von der synchronen zur asynchronen Funktionsweise , 2006 .

[23]  G. Pfurtscheller,et al.  Brain-computer interfaces for control of neuroprostheses: from synchronous to asynchronous mode of operation. , 2006, Biomedizinische Technik. Biomedical engineering.

[24]  F. Piccione,et al.  P300-based brain computer interface: Reliability and performance in healthy and paralysed participants , 2006, Clinical Neurophysiology.

[25]  J. Wolpaw,et al.  Toward enhanced P 300 speller performance , 2007 .

[26]  R. Fazel-Rezai,et al.  Human Error in P300 Speller Paradigm for Brain-Computer Interface , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Wolfgang Rosenstiel,et al.  Nessi: An EEG-Controlled Web Browser for Severely Paralyzed Patients , 2007, Comput. Intell. Neurosci..

[28]  José del R. Millán,et al.  Evaluation Criteria for BCI Research , 2007 .

[29]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[30]  N. Birbaumer,et al.  Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? , 2008, Clinical Neurophysiology.

[31]  Martin Hautzinger,et al.  Validity of the ALS-Depression-Inventory (ADI-12)--a new screening instrument for depressive disorders in patients with amyotrophic lateral sclerosis. , 2008, Journal of affective disorders.

[32]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[33]  Wolfgang Rosenstiel,et al.  Control of an Internet Browser Using the P300 Event- Related Potential , 2008 .

[34]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[35]  P. Tonin,et al.  P300-Based Brain–Computer Interface Communication: Evaluation and Follow-up in Amyotrophic Lateral Sclerosis , 2009, Front. Neuropro..

[36]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[37]  N. Birbaumer,et al.  An auditory oddball (P300) spelling system for brain-computer interfaces. , 2009, Psychophysiology.

[38]  Michael Bensch,et al.  Design and Implementation of a P300-Based Brain-Computer Interface for Controlling an Internet Browser , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[40]  N. Birbaumer,et al.  The Influence of Psychological State and Motivation on Brain–Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis – a Longitudinal Study , 2010, Front. Neuropharma..

[41]  Anne-Marie Brouwer,et al.  A tactile P 300 brain-computer interface , 2010 .

[42]  A Kübler,et al.  A P 300-based brain-computer interface for people with amyotrophic lateral sclerosis , 2010 .

[43]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[44]  A. Kübler,et al.  Motivation modulates the P300 amplitude during brain–computer interface use , 2010, Clinical Neurophysiology.

[45]  Merit Cudkowicz,et al.  Measures and markers in Amyotrophic Lateral Sclerosis , 2004, NeuroRX.

[46]  Tomohiro Yoshikawa,et al.  選択的刺激呈示法による注視点非依存なP300-based Brain-Computer Interfaceの判別速度改善に関する検討(BCI/BMIとその周辺,一般) , 2011 .