Temporal unpredictability of a stimulus sequence affects brain activation differently depending on cognitive task demands

Within cognitive neuroscience, in nearly every experimental setting, subjects are presented with stimuli that appear at either constant or variable points in time, referred to as interstimulus intervals (ISIs). These temporal patterns differ in the degree to which an exact stimulus onset may be predicted. We investigated whether this experimental feature affects brain and behavior, and whether the impact is modulated by the cognitive demands of a task. Subjects (N=26) were assessed via fMRI while solving three different tasks under either temporally predictable (constant ISI) or unpredictable (variable ISI) conditions. The tasks differed with regard to demands on working memory and response uncertainty. Compared to constant ISIs, variable (i.e., less predictable) ISIs led to a general increase in reaction time and in right amygdala activation. Depending on the cognitive demands required by the specific task, the left amygdala, the parietal cortex, the supplementary motor area, and the dorsolateral prefrontal cortex were engaged as well. The results indicate that the temporal structure in a stimulus sequence affects both overt and covert behaviors. Implicit temporal uncertainty increases activation in several brain regions depending on cognitive demands. Thus, an often-overlooked basic design feature, the application of constant or variable ISIs, may contribute to heterogeneity in cognitive neuroscience findings.

[1]  A S Gevins,et al.  Effects of prolonged mental work on functional brain topography. , 1990, Electroencephalography and clinical neurophysiology.

[2]  Y. Kuroiwa,et al.  The effect of stimulus-onset asynchrony on human visual event-related potentials during simple and choice reaction paradigms under constant or random conditions , 2003, Neuroscience Letters.

[3]  M. Shadlen,et al.  A representation of the hazard rate of elapsed time in macaque area LIP , 2005, Nature Neuroscience.

[4]  R. Näätänen,et al.  Foreperiod and simple reaction time. , 1981 .

[5]  M. MacDonald,et al.  Reversal of a full-length mutant huntingtin neuronal cell phenotype by chemical inhibitors of polyglutamine-mediated aggregation , 2005, BMC Neuroscience.

[6]  A. Nobre,et al.  The hazards of time , 2007, Current Opinion in Neurobiology.

[7]  N. Makris,et al.  Gyri of the human neocortex: an MRI-based analysis of volume and variance. , 1998, Cerebral cortex.

[8]  Rudolf N Cardinal,et al.  Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats , 2005, BMC Neuroscience.

[9]  Andy Clark,et al.  Are we predictive engines? Perils, prospects, and the puzzle of the porous perceiver. , 2013, The Behavioral and brain sciences.

[10]  J. Mackie,et al.  What's to be done? , 1992 .

[11]  Antonino Vallesi,et al.  The neural basis of temporal preparation: Insights from brain tumor patients , 2007, Neuropsychologia.

[12]  Paul J. Whalen,et al.  The uncertainty of it all , 2007, Trends in Cognitive Sciences.

[13]  Andrew L. Alexander,et al.  Contextual Modulation of Amygdala Responsivity to Surprised Faces , 2004, Journal of Cognitive Neuroscience.

[14]  Thomas S. Redick,et al.  Complex span and n-back measures of working memory: A meta-analysis , 2013, Psychonomic bulletin & review.

[15]  Gary H. Glover,et al.  Sensitivity of the nucleus accumbens to violations in expectation of reward , 2007, NeuroImage.

[16]  Karl J. Friston,et al.  Stochastic Designs in Event-Related fMRI , 1999, NeuroImage.

[17]  Geoffrey M. Ghose,et al.  Attentional modulation in visual cortex depends on task timing , 2002, Nature.

[18]  A. Lüthi,et al.  Processing of Temporal Unpredictability in Human and Animal Amygdala , 2007, The Journal of Neuroscience.

[19]  Moshe Bar,et al.  Predictions: a universal principle in the operation of the human brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[20]  Katsuyuki Sakai,et al.  Learning of sequences of finger movements and timing: frontal lobe and action-oriented representation. , 2002, Journal of neurophysiology.

[21]  B. Gallhofer,et al.  Sensory and Motor Encoding Strategies in n-Back Tasks: A Simulation of Schizophrenic Working Memory Deficits in Healthy Subjects , 2011, Neuropsychobiology.

[22]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[23]  Jillian H. Fecteau,et al.  Exploring the consequences of the previous trial , 2003, Nature Reviews Neuroscience.

[24]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[25]  E. Jara,et al.  The Brain Network of Expectancy and Uncertainty Processing , 2012, PloS one.

[26]  P. Montague,et al.  Ready…Go: Amplitude of the fMRI Signal Encodes Expectation of Cue Arrival Time , 2009, PLoS biology.

[27]  Karine Sergerie,et al.  The role of the amygdala in emotional processing: A quantitative meta-analysis of functional neuroimaging studies , 2008, Neuroscience & Biobehavioral Reviews.

[28]  R. Adolphs,et al.  Annals of the New York Academy of Sciences What Does the Amygdala Contribute to Social Cognition? , 2022 .

[29]  Peter Kirsch,et al.  Test–retest reliability of evoked BOLD signals from a cognitive–emotive fMRI test battery , 2012, NeuroImage.

[30]  M. Annett The Binomial Distribution of Right, Mixed and Left Handedness , 1967, The Quarterly journal of experimental psychology.

[31]  E. Wagenmakers,et al.  Temporal expectation and information processing: A model-based analysis , 2012, Cognition.

[32]  Luiz Pessoa,et al.  Reprint of: Emotion and cognition and the amygdala: From “what is it?” to “what's to be done?” , 2011, Neuropsychologia.

[33]  Joaquin M. Fuster,et al.  Physiology of executive functions: The perception-action cycle. , 2002 .

[34]  Guillem R. Esber,et al.  Surprise! Neural correlates of Pearce–Hall and Rescorla–Wagner coexist within the brain , 2012, The European journal of neuroscience.

[35]  W. Sommer,et al.  The effects of serial order in long sequences of auditory stimuli on event-related potentials. , 1981, Psychophysiology.

[36]  O. Hikosaka,et al.  What and When: Parallel and Convergent Processing in Motor Control , 2000, The Journal of Neuroscience.

[37]  Henrik Walter,et al.  Prediction error as a linear function of reward probability is coded in human nucleus accumbens , 2006, NeuroImage.

[38]  Mark G. Stokes,et al.  Functionally dissociating temporal and motor components of response preparation in left intraparietal sulcus , 2011, NeuroImage.

[39]  Antonino Vallesi,et al.  When Time Shapes Behavior: fMRI Evidence of Brain Correlates of Temporal Monitoring , 2009, Journal of Cognitive Neuroscience.

[40]  Alexa Riehle,et al.  Preparation for Action: one of the Key Functions of Motor Cortex , 2004 .

[41]  N. Squires,et al.  The effect of stimulus sequence on the waveform of the cortical event-related potential. , 1976, Science.

[42]  A. Nobre,et al.  Dissociating explicit timing from temporal expectation with fMRI , 2008, Current Opinion in Neurobiology.

[43]  Joseph J. Paton,et al.  Expectation Modulates Neural Responses to Pleasant and Aversive Stimuli in Primate Amygdala , 2007, Neuron.

[44]  Stewart H Mostofsky,et al.  Interstimulus jitter facilitates response control in children with ADHD , 2009, Journal of the International Neuropsychological Society.

[45]  Emiliano Macaluso,et al.  Auditory temporal expectations modulate activity in visual cortex , 2010, NeuroImage.

[46]  J. Thayer,et al.  eview meta-analysis of heart rate variability and neuroimaging studies : Implications or heart rate variability as a marker of stress and health , 2012 .

[47]  R. Passingham,et al.  The Attentional Role of the Left Parietal Cortex: The Distinct Lateralization and Localization of Motor Attention in the Human Brain , 2001, Journal of Cognitive Neuroscience.

[48]  Antonino Vallesi,et al.  Role of the prefrontal cortex in the foreperiod effect: TMS evidence for dual mechanisms in temporal preparation. , 2006, Cerebral cortex.

[49]  Joseph A Maldjian,et al.  Precentral gyrus discrepancy in electronic versions of the Talairach atlas , 2004, NeuroImage.

[50]  R. Buxton,et al.  Detection Power, Estimation Efficiency, and Predictability in Event-Related fMRI , 2001, NeuroImage.

[51]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[52]  Stewart H Mostofsky,et al.  Moderate variability in stimulus presentation improves motor response control , 2009, Journal of clinical and experimental neuropsychology.

[53]  P. A. Lewis,et al.  A right hemispheric prefrontal system for cognitive time measurement , 2006, Behavioural Processes.

[54]  W. Meck,et al.  Neuroanatomical and Neurochemical Substrates of Timing , 2011, Neuropsychopharmacology.

[55]  H. T. Blair,et al.  Neural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray , 2010, Nature Neuroscience.

[56]  John Polich,et al.  P300 Sequence Effects, Probability, and Interstimulus Interval , 1997, Physiology & Behavior.

[57]  Anna Christina Nobre,et al.  Orienting attention to instants in time , 2001, Neuropsychologia.

[58]  Rolf Ulrich,et al.  Locus of the effect of temporal preparation: evidence from the lateralized readiness potential. , 2003, Psychophysiology.

[59]  P. Whalen Fear, Vigilance, and Ambiguity , 1998 .

[60]  Thomas T. Liu,et al.  Efficiency, power, and entropy in event-related FMRI with multiple trial types Part I: theory , 2004, NeuroImage.

[61]  E. Yeterian,et al.  MRI-Based Topographic Parcellation of Human Cerebral White Matter and Nuclei II. Rationale and Applications with Systematics of Cerebral Connectivity , 1999, NeuroImage.

[62]  J. Grafman,et al.  The roles of the cerebellum and basal ganglia in timing and error prediction , 2002, The European journal of neuroscience.

[63]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[64]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[65]  J. Rosen,et al.  Animal studies of amygdala function in fear and uncertainty: Relevance to human research , 2006, Biological Psychology.

[66]  Moshe Bar,et al.  The proactive brain: Using rudimentary information to make predictive judgments , 2008 .

[67]  J. Grafman,et al.  The Human Amygdala: An Evolved System for Relevance Detection , 2003, Reviews in the neurosciences.

[68]  A. Aertsen,et al.  Spike synchronization and rate modulation differentially involved in motor cortical function. , 1997, Science.

[69]  J. Coull fMRI studies of temporal attention: allocating attention within, or towards, time. , 2004, Brain research. Cognitive brain research.

[70]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[71]  J. Coull Neural Substrates of Mounting Temporal Expectation , 2009, PLoS biology.

[72]  Moshe Bar,et al.  The proactive brain: memory for predictions , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[73]  Clayton E. Curtis,et al.  Maintenance of Spatial and Motor Codes during Oculomotor Delayed Response Tasks , 2004, The Journal of Neuroscience.

[74]  Joseph E LeDoux,et al.  Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior , 2005, Neuron.