Electrophysiological responses of relatedness to consecutive word stimuli in relation to an actively recollected target word

In this paper, we investigate the robustness of electrophysiological responses of relatedness to multiple consecutive word stimuli (probes), in relation to an actively recollected target word. Such relatedness information could be used by a Brain Computer Interface to infer the active semantic concept on a user’s mind, by integrating the knowledge of the relationship between the multiple probe words and the ‘unknown’ target. Such a BCI can take advantage of the N400: an event related potential that is sensitive to semantic content of a stimulus in relation to an established semantic context. However, it is unknown whether the N400 is suited for the multiple probing paradigm we propose, as other intervening words might distract from the established context (i.e., the target word). We perform an experiment in which we present up to ten words after an initial target word, and find no attenuation of the strength of the N400 in grand average ERPs and no decrease in classification accuracy for probes occurring later in the sequences. These results are groundwork for developing a BCI that infers the concept on a user’s mind through repeated probing, however, low single trial decoding accuracy, and high subject variability may limit practical applicability.

[1]  Jason Farquhar,et al.  Towards a Communication Brain Computer Interface Based on Semantic Relations , 2014, PloS one.

[2]  Christian Mühl,et al.  Guessing what ' s on your mind : Using the N 400 in Brain Computer Interfaces , 2010 .

[3]  S. Eickhoff,et al.  N400 predicts recovery from disorders of consciousness , 2013, Annals of neurology.

[4]  D Deacon,et al.  How automatically is meaning accessed: a review of the effects of attention on semantic processing. , 2000, Frontiers in bioscience : a journal and virtual library.

[5]  F. Perrin,et al.  Spherical splines for scalp potential and current density mapping. , 1989, Electroencephalography and clinical neurophysiology.

[6]  B Blankertz,et al.  Real-time inference of word relevance from electroencephalogram and eye gaze , 2017, Journal of neural engineering.

[7]  M. Kutas,et al.  The Search for Common Sense: An Electrophysiological Study of the Comprehension of Words and Pictures in Reading , 1996, Journal of Cognitive Neuroscience.

[8]  G. Gratton Dealing with artifacts: The EOG contamination of the event-related brain potential , 1998 .

[9]  Benjamin Blankertz,et al.  A gaze independent spelling based on rapid serial visual presentation , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[11]  Matti Laine,et al.  Anomia: Theoretical and Clinical Aspects , 2006 .

[12]  J. Schoffelen,et al.  Beta oscillations relate to the N400m during language comprehension , 2012, Human brain mapping.

[13]  J. Wolpaw,et al.  A practical, intuitive brain–computer interface for communicating ‘yes’ or ‘no’ by listening , 2014, Journal of neural engineering.

[14]  M. Kutas,et al.  Interactions between sentence context and word frequencyinevent-related brainpotentials , 1990, Memory & cognition.

[15]  Jason Farquhar,et al.  Interactions Between Pre-Processing and Classification Methods for Event-Related-Potential Classification , 2012, Neuroinformatics.

[16]  Peter Desain,et al.  Broad-Band Visually Evoked Potentials: Re(con)volution in Brain-Computer Interfacing , 2015, PloS one.

[17]  Peter Desain,et al.  Detecting Semantic Priming at the Single-Trial Level , 2013, PloS one.

[18]  J. Wolpaw,et al.  Answering questions with an electroencephalogram-based brain-computer interface. , 1998, Archives of physical medicine and rehabilitation.

[19]  N. Birbaumer,et al.  Information processing in severe disorders of consciousness: Vegetative state and minimally conscious state , 2005, Clinical Neurophysiology.

[20]  W. Ritter,et al.  The relationship between N2 and N400: scalp distribution, stimulus probability, and task relevance. , 1991, Psychophysiology.

[21]  N. Birbaumer,et al.  Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? , 2008, Clinical Neurophysiology.

[22]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[23]  Bin Xia,et al.  Brain–Computer Interface–Based Communication in the Completely Locked-In State , 2017, GBCIC.

[24]  M. Rugg Event-related brain potentials dissociate repetition effects of high-and low-frequency words , 1990, Memory & cognition.

[25]  Peter Desain,et al.  Introducing the tactile speller: an ERP-based brain–computer interface for communication , 2012, Journal of neural engineering.

[26]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[27]  S. Luck,et al.  How inappropriate high-pass filters can produce artifactual effects and incorrect conclusions in ERP studies of language and cognition. , 2015, Psychophysiology.

[28]  H. Neville,et al.  Language and , 2019, Adventure Diffusion.

[29]  Jeffrey G Malins,et al.  Neuroimage: Clinical the Reliability of the N400 in Single Subjects: Implications for Patients with Disorders of Consciousness , 2022 .

[30]  E. Maris Statistical testing in electrophysiological studies. , 2012, Psychophysiology.

[31]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[32]  Kara D. Federmeier,et al.  Never seem to find the time: evaluating the physiological time course of visual word recognition with regression analysis of single-item event-related potentials , 2014 .

[33]  Gert Storms,et al.  Word associations: Norms for 1,424 Dutch words in a continuous task , 2008, Behavior research methods.

[34]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[35]  Colin M. Brown,et al.  ERP effects of listening to speech: semantic ERP effects , 2000, Neuropsychologia.

[36]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.