EEG Cross-Frequency Phase Synchronization as an Index of Memory Matching in Visual Search

Visual perception is influenced by our expectancies about incoming sensory information. It is assumed that mental templates of expected sensory input are created and compared to actual input, which can be matching or not. When such mental templates are held in working memory, cross-frequency phase synchronization (CFS) between theta and gamma band activity has been proposed to serve matching processes between prediction and sensation. We investigated how this is affected by the number of activated templates that could be matched by comparing conditions where participants had to keep either one or multiple templates in mind for successful visual search. We found that memory matching appeared as transient CFS between EEG theta and gamma activity in an early time window around 150ms after search display presentation, in right hemispheric parietal cortex. Our results suggest that for single template conditions, stronger transient theta-gamma CFS at posterior sites contralateral to target presentation can be observed than for multiple templates. This lends evidence to the idea of sequential attentional templates and is understood in line with previous theoretical accounts strongly arguing for transient synchronization between posterior theta and gamma phase as a neuronal correlate of matching incoming sensory information with contents from working memory.

[1]  U. Kamil,et al.  Functional imaging , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Ole Jensen,et al.  The Neural Mechanisms of Prediction in Visual Search. , 2016, Cerebral cortex.

[3]  A. Karim,et al.  Brain Oscillatory Substrates of Visual Short-Term Memory Capacity , 2009, Current Biology.

[4]  Ramakrishna Chakravarthi,et al.  For whom the bell tolls: periodic reactivation of sensory cortex in the gamma band as a substrate of visual working memory maintenance , 2014, Front. Hum. Neurosci..

[5]  Wolfgang Klimesch,et al.  Human frontal midline theta and its synchronization to gamma during a verbal delayed match to sample task , 2010, Neurobiology of Learning and Memory.

[6]  W. Singer,et al.  Temporal binding and the neural correlates of sensory awareness , 2001, Trends in Cognitive Sciences.

[7]  O. Jensen,et al.  Alpha Oscillations Serve to Protect Working Memory Maintenance against Anticipated Distracters , 2012, Current Biology.

[8]  C. D. Frith,et al.  Brain Activations during Visual Search: Contributions of Search Efficiency versus Feature Binding , 2003, NeuroImage.

[9]  Robert Desimone,et al.  Top–Down Attentional Deficits in Macaques with Lesions of Lateral Prefrontal Cortex , 2007, The Journal of Neuroscience.

[10]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[11]  Herrmann Christoph,et al.  Gamma amplitudes are coupled to theta phase in human EEG during visual perception , 2010 .

[12]  P. Fries.  A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[13]  Harold Pashler,et al.  A Boolean map theory of visual attention. , 2007, Psychological review.

[14]  Steven J. Luck,et al.  Electrophysiological Correlates of the Focusing of Attention within Complex Visual Scenes : N 2 pc and Related Electrophysiological Correlates , 2012 .

[15]  Sabine Weiss,et al.  Quantification of phase synchronization phenomena and their importance for verbal memory processes , 2005, Biological Cybernetics.

[16]  Kyle R. Cave,et al.  Costs in Searching for Two Targets: Dividing Search Across Target Types Could Improve Airport Security Screening , 2007 .

[17]  Niels Birbaumer,et al.  Cross-frequency phase synchronization: A brain mechanism of memory matching and attention , 2008, NeuroImage.

[18]  Christian N. L. Olivers,et al.  Lack of Free Choice Reveals the Cost of Having to Search for More Than One Object , 2017, Psychological science.

[19]  Robert T Knight,et al.  Temporal kinetics of prefrontal modulation of the extrastriate cortex during visual attention , 2004, Cognitive, affective & behavioral neuroscience.

[20]  P. Roelfsema,et al.  Different States in Visual Working Memory: When It Guides Attention and When It Does Not , 2022 .

[21]  H. Petsche,et al.  Synchronization between prefrontal and posterior association cortex during human working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[22]  P. König,et al.  Top-down processing mediated by interareal synchronization. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[23]  J. Fell,et al.  The role of phase synchronization in memory processes , 2011, Nature Reviews Neuroscience.

[24]  M. Eimer.  The neural basis of attentional control in visual search , 2014, Trends in Cognitive Sciences.

[25]  Chris J. Tinsley,et al.  Selective representation of task‐relevant objects and locations in the monkey prefrontal cortex , 2006, The European journal of neuroscience.

[26]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  G. Humphreys,et al.  Dissociating the neural mechanisms of memory-based guidance of visual selection , 2007, Proceedings of the National Academy of Sciences.

[28]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[29]  J. Palva,et al.  Phase Synchrony among Neuronal Oscillations in the Human Cortex , 2005, The Journal of Neuroscience.

[30]  E. Miller,et al.  Top-Down Versus Bottom-Up Control of Attention in the Prefrontal and Posterior Parietal Cortices , 2007, Science.

[31]  T. Braver.  The variable nature of cognitive control: a dual mechanisms framework , 2012, Trends in Cognitive Sciences.

[32]  J. Kaiser,et al.  Human gamma-frequency oscillations associated with attention and memory , 2007, Trends in Neurosciences.

[33]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[34]  G. Humphreys,et al.  Automatic guidance of attention from working memory , 2008, Trends in Cognitive Sciences.

[35]  S. Luck,et al.  The Oxford handbook of event-related potential components , 2011 .

[36]  W. Klimesch,et al.  Control mechanisms in working memory: A possible function of EEG theta oscillations , 2010, Neuroscience & Biobehavioral Reviews.

[37]  Sean M Montgomery,et al.  Entrainment of Neocortical Neurons and Gamma Oscillations by the Hippocampal Theta Rhythm , 2008, Neuron.

[38]  J. Pernier,et al.  Stimulus Specificity of Phase-Locked and Non-Phase-Locked 40 Hz Visual Responses in Human , 1996, The Journal of Neuroscience.

[39]  Michael X Cohen,et al.  Analyzing Neural Time Series Data: Theory and Practice , 2014 .

[40]  R. Kliegl,et al.  How to capitalize on a priori contrasts in linear (mixed) models: A tutorial , 2018, Journal of Memory and Language.

[41]  Elisa Mira Holz,et al.  Theta–gamma phase synchronization during memory matching in visual working memory , 2010, NeuroImage.

[42]  A. Vallesi.  Monitoring mechanisms in visual search: An fMRI study , 2014, Brain Research.

[43]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[44]  Steven J. Luck,et al.  Electrophysiological Correlates of the Focusing of Attention within Complex Visual Scenes: N2pc and Related ERP Components , 2011 .

[45]  C. Bundesen,et al.  A neural theory of visual attention: bridging cognition and neurophysiology. , 2005, Psychological review.

[46]  O Jensen,et al.  An Oscillatory Short-Term Memory Buffer Model Can Account for Data on the Sternberg Task , 1998, The Journal of Neuroscience.

[47]  J. Fell,et al.  Memory formation by neuronal synchronization , 2006, Brain Research Reviews.

[48]  Nelson J. Trujillo-Barreto,et al.  Successful memory encoding is associated with increased cross-frequency coupling between frontal theta and posterior gamma oscillations in human scalp-recorded EEG , 2013, NeuroImage.

[49]  G. Humphreys,et al.  Dividing the mind: The necessary role of the frontal lobes in separating memory from search , 2006, Neuropsychologia.

[50]  D. Lehmann,et al.  Functional imaging with low-resolution brain electromagnetic tomography (LORETA): a review. , 2002, Methods and findings in experimental and clinical pharmacology.

[51]  P. Schwartzkroin,et al.  Neural mechanisms. , 1994, Science.

[52]  C. Bundesen.  A theory of visual attention. , 1990, Psychological review.

[53]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.

[54]  Kara D. Federmeier,et al.  Revisiting the incremental effects of context on word processing: Evidence from single-word event-related brain potentials. , 2015, Psychophysiology.

[55]  Thomas Geyer,et al.  Predictive coding in visual search as revealed by cross-frequency EEG phase synchronization , 2015, Front. Psychol..

[56]  Eduard Ort,et al.  Lack of free choice reveals the cost of multiple-target search within and across feature dimensions , 2018, Attention, perception & psychophysics.

[57]  Paul Goldhaber,et al.  Control Mechanisms , 1978 .

[58]  Andreas K. Engel,et al.  Temporal binding and the neural correlates of consciousness , 2003 .

[59]  Manuel Schabus,et al.  Fronto-parietal EEG coherence in theta and upper alpha reflect central executive functions of working memory. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[60]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[61]  Phillip M. Alday,et al.  Electrophysiology Reveals the Neural Dynamics of Naturalistic Auditory Language Processing: Event-Related Potentials Reflect Continuous Model Updates , 2016, eNeuro.

[62]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[63]  W. Klimesch,et al.  What does phase information of oscillatory brain activity tell us about cognitive processes? , 2008, Neuroscience & Biobehavioral Reviews.

[64]  Reinhold Kliegl,et al.  hypr: An R package for hypothesis-driven contrast coding , 2020, J. Open Source Softw..

[65]  H. Petsche,et al.  Phase-coupling of theta-gamma EEG rhythms during short-term memory processing. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[66]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[67]  J. Visser-Meily,et al.  The right hemisphere is dominant in organization of visual search—A study in stroke patients , 2016, Behavioural Brain Research.

[68]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[69]  Valerie M. Beck,et al.  Simultaneous Control of Attention by Multiple Working Memory Representations , 2012, Psychological science.

[70]  Anders Lansner,et al.  Nested theta to gamma oscillations and precise spatiotemporal firing during memory retrieval in a simulated attractor network , 2013, Brain Research.

[71]  Michiyo Iba,et al.  Involvement of the dorsolateral prefrontal cortex of monkeys in visuospatial target selection. , 2003, Journal of neurophysiology.

[72]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[73]  L. Lenchik.  Functional imaging , 2007, Annals of Biomedical Engineering.

[74]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[75]  A. Engel,et al.  Cognitive functions of gamma-band activity: memory match and utilization , 2004, Trends in Cognitive Sciences.

[76]  Satu Palva,et al.  Functional integration across oscillation frequencies by cross‐frequency phase synchronization , 2018, The European journal of neuroscience.