Eye-movement related brain potentials during assisted navigation in real-world

Conducting neuroscience research in the real world remains challenging because of movement- and environment-related artifacts as well as missing control over stimulus presentation. The present study demonstrated that it is possible to investigate the neuronal correlates underlying visuo-spatial information processing during real-world navigation. Using mobile EEG allowed for extraction of saccade- and blink-related potentials as well as gait-related EEG activity. In combination with source-based cleaning of non-brain activity and unfolding of overlapping event-related activity, brain activity of naturally behaving humans was revealed even in a complex and dynamic city environment.

[1]  Daniel P Ferris,et al.  Imaging natural cognition in action. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[2]  Gerhard Tröster,et al.  Eye Movement Analysis for Activity Recognition Using Electrooculography , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Francisco J. Parada.  Understanding Natural Cognition in Everyday Settings: 3 Pressing Challenges , 2018, Front. Hum. Neurosci..

[4]  J. Stern,et al.  The endogenous eyeblink. , 1984, Psychophysiology.

[5]  Olaf Dimigen,et al.  Unfold: an integrated toolbox for overlap correction, non-linear modeling, and regression-based EEG analysis , 2018, bioRxiv.

[6]  A. Bentivoglio,et al.  Analysis of blink rate patterns in normal subjects , 1997, Movement disorders : official journal of the Movement Disorder Society.

[7]  P. Maldonado,et al.  Superposition Model Predicts EEG Occipital Activity during Free Viewing of Natural Scenes , 2010, The Journal of Neuroscience.

[8]  Thierry Baccino,et al.  Eye movements and concurrent event-related potentials: Eye fixation-related potential investigations in reading , 2011 .

[9]  Akihiro Yagi,et al.  Comparison between the lambda response of eye-fixation-related potentials and the P100 component of pattern-reversal visual evoked potentials , 2003, Cognitive, affective & behavioral neuroscience.

[10]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[11]  K. Holmqvist,et al.  Right visual field advantage in parafoveal processing: Evidence from eye-fixation-related potentials , 2009, Brain and Language.

[12]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[13]  Juan E. Kamienkowski,et al.  Eye movements blink the attentional blink. , 2012, Journal of experimental psychology. Human perception and performance.

[14]  Joanne L. Park,et al.  Navigation in Real-World Environments: New Opportunities Afforded by Advances in Mobile Brain Imaging , 2018, Front. Hum. Neurosci..

[15]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[16]  Atsuyuki Okabe,et al.  Wayfinding with a GPS-based mobile navigation system: A comparison with maps and direct experience , 2008 .

[17]  J C ARMINGTON,et al.  Averaged Brain Activity Following Saccadic Eye Movement , 1964, Science.

[18]  Klaus Gramann,et al.  Electrocortical Evidence for Long-Term Incidental Spatial Learning Through Modified Navigation Instructions , 2018, bioRxiv.

[19]  Véronique D. Bohbot,et al.  Habitual use of GPS negatively impacts spatial memory during self-guided navigation , 2020, Scientific Reports.

[20]  Romain Meeusen,et al.  Temporal and spatial organization of gait-related electrocortical potentials , 2015, Neuroscience Letters.

[21]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[22]  Mariano Sigman,et al.  Fixation-related potentials in visual search: a combined EEG and eye tracking study. , 2012, Journal of vision.

[23]  Kenneth Kreutz-Delgado,et al.  AMICA : An Adaptive Mixture of Independent Component Analyzers with Shared Components , 2011 .

[24]  Mariano Sigman,et al.  Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search , 2018, NeuroImage.

[25]  E. Wascher,et al.  Age-Sensitive Effects of Enduring Work with Alternating Cognitive and Physical Load. A Study Applying Mobile EEG in a Real Life Working Scenario , 2016, Front. Hum. Neurosci..

[26]  G. Woodman,et al.  Event-related potential studies of attention , 2000, Trends in Cognitive Sciences.

[27]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.

[28]  S J Luck,et al.  Visual event-related potentials index focused attention within bilateral stimulus arrays. II. Functional dissociation of P1 and N1 components. , 1990, Electroencephalography and clinical neurophysiology.

[29]  Jeffrey M. Hausdorff,et al.  A new approach to quantifying the EEG during walking: Initial evidence of gait related potentials and their changes with aging and dual tasking , 2019, Experimental Gerontology.

[30]  M. Marton,et al.  Context effects on saccade-related brain potentials to words during reading , 1988, Neuropsychologia.

[31]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[32]  Thierry Baccino,et al.  Eye fixation–related potentials (EFRPs) during object identification , 2010, Visual Neuroscience.

[33]  Sven Hoffmann,et al.  Towards the measurement of event-related EEG activity in real-life working environments. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  Mariano Sigman,et al.  Looking for a face in the crowd: Fixation-related potentials in an eye-movement visual search task , 2014, NeuroImage.

[35]  R. Oostenveld,et al.  Validating the boundary element method for forward and inverse EEG computations in the presence of a hole in the skull , 2002, Human brain mapping.

[36]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[37]  Robert Oostenveld,et al.  The five percent electrode system for high-resolution EEG and ERP measurements , 2001, Clinical Neurophysiology.

[38]  Daniel P Ferris,et al.  Isolating gait-related movement artifacts in electroencephalography during human walking , 2015, Journal of neural engineering.

[39]  M. Hegarty,et al.  A dissociation between mental rotation and perspective-taking spatial abilities , 2004 .

[40]  Michele A. Basso,et al.  Not looking while leaping: the linkage of blinking and saccadic gaze shifts , 2004, Experimental Brain Research.

[41]  K K Kwong,et al.  Functional MRI of brain activation by eye blinking. , 1999, Experimental eye research.

[42]  Kenneth Kreutz-Delgado,et al.  ICLabel: An automated electroencephalographic independent component classifier, dataset, and website , 2019, NeuroImage.

[43]  Klaus Gramann,et al.  Modified Navigation Instructions for Spatial Navigation Assistance Systems Lead to Incidental Spatial Learning , 2017, Front. Psychol..

[44]  Gerhard Tröster,et al.  Eye Movement Analysis for Activity Recognition Using Electrooculography , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Maximilian Schwalm,et al.  Computer-assisted navigation and the acquisition of route and survey knowledge , 2006 .

[46]  Christopher W Tyler,et al.  Measurement of saccadic eye movements by electrooculography for simultaneous EEG recording , 2019, Behavior Research Methods.