Decision-making in information seeking on texts: an eye-fixation-related potentials investigation

Reading on a web page is known to be not linear and people need to make fast decisions about whether they have to stop or not reading. In such context, reading, and decision-making processes are intertwined and this experiment attempts to separate them through electrophysiological patterns provided by the Eye-Fixation-Related Potentials technique (EFRPs). We conducted an experiment in which EFRPs were recorded while participants read blocks of text that were semantically highly related, moderately related, and unrelated to a given goal. Participants had to decide as fast as possible whether the text was related or not to the semantic goal given at a prior stage. Decision making (stopping information search) may occur when the paragraph is highly related to the goal (positive decision) or when it is unrelated to the goal (negative decision). EFRPs were analyzed on and around typical eye fixations: either on words belonging to the goal (target), subjected to a high rate of positive decisions, or on low frequency unrelated words (incongruent), subjected to a high rate of negative decisions. In both cases, we found EFRPs specific patterns (amplitude peaking between 51 to 120 ms after fixation onset) spreading out on the next words following the goal word and the second fixation after an incongruent word, in parietal and occipital areas. We interpreted these results as delayed late components (P3b and N400), reflecting the decision to stop information searching. Indeed, we show a clear spill-over effect showing that the effect on word N spread out on word N + 1 and N + 2.

[1]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[2]  T W Picton,et al.  The P300 Wave of the Human Event‐Related Potential , 1992, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[3]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[4]  Petr Marsalek,et al.  under revision to get out as mini-review in ANE * * * Event-Related Potentials-the P 3 Wave , 2002 .

[5]  M. Pratarelli,et al.  Semantic Processing of Pictures and Spoken Words: Evidence from Event-Related Brain Potentials , 1994, Brain and Cognition.

[6]  A. Friederici,et al.  Music, language and meaning: brain signatures of semantic processing , 2004, Nature Neuroscience.

[7]  G. McCarthy,et al.  On the influence of task relevance and stimulus probability on event-related-potential components. , 1977, Electroencephalography and clinical neurophysiology.

[8]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[9]  A. Kok On the utility of P3 amplitude as a measure of processing capacity. , 2001, Psychophysiology.

[10]  O. Mimura [Eye movements]. , 1992, Nippon Ganka Gakkai zasshi.

[11]  Jonathan Grainger,et al.  Watching the Word Go by: On the Time-course of Component Processes in Visual Word Recognition , 2009, Lang. Linguistics Compass.

[12]  M. Posner,et al.  Establishing a time‐line of word recognition: evidence from eye movements and event‐related potentials , 1998, Neuroreport.

[13]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[14]  S. Yamaguchi,et al.  Anterior and posterior association cortex contributions to the somatosensory P300 , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Mariano Sigman,et al.  Fixation-related potentials in visual search: a combined EEG and eye tracking study. , 2012, Journal of vision.

[17]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[18]  S. Hillyard,et al.  Selective attention to multidimensional auditory stimuli. , 1983, Journal of experimental psychology. Human perception and performance.

[19]  J P Rosenfeld,et al.  Parietal P3 response as an indicator of stimulus categorization: increased P3 amplitude to categorically deviant target and nontarget stimuli. , 1990, Psychophysiology.

[20]  A Pollatsek,et al.  The use of information below fixation in reading and in visual search. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[21]  P. Gordon,et al.  The interplay of discourse congruence and lexical association during sentence processing: Evidence from ERPs and eye tracking. , 2007, Journal of memory and language.

[22]  M. Kutas,et al.  An electrophysiological study of scene effects on object identification. , 2003, Brain research. Cognitive brain research.

[23]  K. Rayner,et al.  Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity , 1986, Memory & cognition.

[24]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[25]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[26]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[27]  Monica Gonzalez-Marquez,et al.  Methods in cognitive linguistics , 2007 .

[28]  A. Jacobs,et al.  Coregistration of eye movements and EEG in natural reading: analyses and review. , 2011, Journal of experimental psychology. General.

[29]  P. Hagoort Interplay between Syntax and Semantics during Sentence Comprehension: ERP Effects of Combining Syntactic and Semantic Violations , 2003, Journal of Cognitive Neuroscience.

[30]  M. Woldorff,et al.  Distortion of ERP averages due to overlap from temporally adjacent ERPs: analysis and correction. , 2007, Psychophysiology.

[31]  J. Andreassi Psychophysiology: Human Behavior and Physiological Response , 1980 .

[32]  Jonathan Grainger,et al.  Effects of stimulus font and size on masked repetition priming: An event-related potentials (ERP) investigation , 2008, Language and cognitive processes.

[33]  J. Polich Updating P 300 : An Integrative Theory of P 3 a and P 3 b , 2009 .

[34]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[35]  R. Knight Contribution of human hippocampal region to novelty detection , 1996, Nature.

[36]  H. Redkey,et al.  A new approach. , 1967, Rehabilitation record.

[37]  Reinhold Kliegl,et al.  Eye movements and brain electric potentials during reading , 2012, Psychological research.

[38]  Rolf Verleger,et al.  P3b: Towards some decision about memory , 2008, Clinical Neurophysiology.

[39]  J. Polich Neuropsychology of P300 , 2011 .

[40]  Mario Braun,et al.  Welcome to the real world: Validating fixation-related brain potentials for ecologically valid settings , 2007, Brain Research.

[41]  Katherine J. Midgley,et al.  On the time course of letter perception: A masked priming ERP investigation , 2006, Psychonomic bulletin & review.

[42]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[43]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[44]  Petr Marsalek,et al.  Event-related potentials--the P3 wave. , 2003, Acta neurobiologiae experimentalis.

[45]  H. Gray,et al.  P300 as an index of attention to self-relevant stimuli , 2004 .

[46]  Michael W. Berry,et al.  Mathematical Foundations Behind Latent Semantic Analysis , 2007 .

[47]  Thierry Baccino,et al.  Eye movements and concurrent event-related potentials: Eye fixation-related potential investigations in reading , 2011 .

[48]  Jie-Li Tsai,et al.  The Time Course of Contextual Effects on Visual Word Recognition , 2012, Front. Psychology.

[49]  Ronald P. Carver,et al.  Reading Rate: A Review of Research and Theory , 1990 .

[50]  William D. Marslen-Wilson,et al.  Morphology and frequency: Contrasting methodologies , 2003 .

[51]  Cees van Leeuwen,et al.  Eye fixation-related potentials in free viewing identify encoding failures in change detection , 2011, NeuroImage.

[52]  K. Rayner,et al.  The Effect of Clause Wrap-Up on Eye Movements during Reading , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[53]  J. Cacioppo,et al.  Bioelectrical echoes from evaluative categorization: II. A late positive brain potential that varies as a function of attitude registration rather than attitude report. , 1995, Journal of personality and social psychology.

[54]  Piotr Jaskowski,et al.  Evidence for an Integrative Role of P3b in Linking Reaction to Perception , 2005 .

[55]  M. Rugg,et al.  Event-related potentials and the semantic matching of faces , 1989, Neuropsychologia.

[56]  Jonathan Grainger,et al.  On the Time Course of Visual Word Recognition: An Event-related Potential Investigation using Masked Repetition Priming , 2006, Journal of Cognitive Neuroscience.

[57]  Effect of task decision on P300. , 1992, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[58]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[59]  J. Guérit Manuel d'interprétation des potentiels évoqués endogènes (P300 et VCN), M Timsit-Berthier, A Gerono. Margaga, Paris (1998), 64 , 1998 .

[60]  J. Debruille,et al.  The N400 potential could index a semantic inhibition , 2007, Brain Research Reviews.

[61]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[62]  Jonathan Grainger,et al.  How Initial Fixation Position Influences Visual Word Recognition: A Comparison of French and Arabic , 1996, Brain and Language.

[63]  Erik D. Reichle,et al.  Eye movements in reading and information processing : , 2015 .

[64]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[65]  K. Rayner Eye movements in reading and information processing. , 1978, Psychological bulletin.

[66]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[67]  M. Rugg,et al.  Event-related potentials and the semantic matching of pictures , 1990, Brain and Cognition.

[68]  Guy Dove,et al.  Linking Brainwaves to the Brain: An ERP Primer , 2005, Developmental neuropsychology.

[69]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[70]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[71]  William D. Marslen-Wilson,et al.  The time course of visual word recognition as revealed by linear regression analysis of ERP data , 2006, NeuroImage.

[72]  David M. Groppe,et al.  Overlapping dual ERP responses to low cloze probability sentence continuations. , 2011, Psychophysiology.