Beat-based and memory-based temporal expectations in rhythm: similar perceptual effects, different underlying mechanisms

Predicting the timing of incoming information allows the brain to optimize information processing in dynamic environments. Behaviorally, temporal expectations have been shown to facilitate processing of events at expected time points, such as sounds that coincide with the beat in musical rhythm. Yet, temporal expectations can develop based on different forms of structure in the environment, not just the regularity afforded by a musical beat. Little is still known about how different types of temporal expectations are neurally implemented and affect performance. Here, we orthogonally manipulated the periodicity and predictability of rhythmic sequences to examine the mechanisms underlying beat-based and memory-based temporal expectations, respectively. Behaviorally and using EEG, we looked at the effects of beat-based and memory-based expectations on auditory processing when rhythms were task relevant or task irrelevant. At expected time points, both beat-based and memory-based expectations facilitated target detection and led to attenuation of P1 and N1 responses, even when expectations were task-irrelevant (unattended). For beat-based expectations, we additionally found reduced target detection and enhanced N1 responses for events at unexpected time points (e.g., off-beat), regardless of the presence of memory-based expectations or task relevance. This latter finding supports the notion that periodicity selectively induces rhythmic fluctuations in neural excitability and furthermore indicates that while beat-based and memory-based expectations may similarly affect auditory processing of expected events, their underlying neural mechanisms may be different.

[1]  Karl J. Friston,et al.  Predictive Processes and the Peculiar Case of Music , 2019, Trends in Cognitive Sciences.

[2]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[3]  Karl J. Friston,et al.  Not All Predictions Are Equal: “What” and “When” Predictions Modulate Activity in Auditory Cortex through Different Mechanisms , 2018, The Journal of Neuroscience.

[4]  K. Lange Brain correlates of early auditory processing are attenuated by expectations for time and pitch , 2009, Brain and Cognition.

[5]  Richard B. Ivry,et al.  Double dissociation of single-interval and rhythmic temporal prediction in cerebellar degeneration and Parkinson’s disease , 2018, Proceedings of the National Academy of Sciences.

[6]  Nicol S Harper,et al.  Temporal predictability enhances auditory detection. , 2014, The Journal of the Acoustical Society of America.

[7]  Luc H. Arnal,et al.  Delta-Beta Coupled Oscillations Underlie Temporal Prediction Accuracy. , 2015, Cerebral cortex.

[8]  I. Arisi,et al.  Nerve growth factor regulates axial rotation during early stages of chick embryo development , 2012, Proceedings of the National Academy of Sciences.

[9]  Trevor Hastie,et al.  Neural mechanisms of rhythm-based temporal prediction : Delta phase-locking reflects temporal predictability but not rhythmic entrainment , 2017 .

[10]  Aniruddh D. Patel,et al.  UC Office of the President Recent Work Title Synchronization to auditory and visual rhythms in hearing and deaf individuals Permalink , 2014 .

[11]  H. Honing,et al.  Temporal attending and prediction influence the perception of metrical rhythm: evidence from reaction times and ERPs , 2015, Front. Psychol..

[12]  S. Kotz,et al.  Dissociation of formal and temporal predictability in early auditory evoked potentials , 2013, Neuropsychologia.

[13]  Sabine Kastner,et al.  The Oxford Handbook of Attention , 2014 .

[14]  R. VanRullen,et al.  Oscillatory Mechanisms of Stimulus Processing and Selection in the Visual and Auditory Systems: State-of-the-Art, Speculations and Suggestions , 2017, Front. Neurosci..

[15]  Jarmo A. Hämäläinen,et al.  Distinctive Representation of Mispredicted and Unpredicted Prediction Errors in Human Electroencephalography , 2015, The Journal of Neuroscience.

[16]  Cooper A. Smout,et al.  Attention promotes the neural encoding of prediction errors , 2019, bioRxiv.

[17]  Simon van Gaal,et al.  No Evidence that Predictions and Attention Modulate the First Feedforward Sweep of Cortical Information Processing , 2018, bioRxiv.

[18]  J. Devin McAuley,et al.  FMRI investigation of cross-modal interactions in beat perception: Audition primes vision, but not vice versa , 2011, NeuroImage.

[19]  Assaf Breska,et al.  When Synchronizing to Rhythms Is Not a Good Thing: Modulations of Preparatory and Post-Target Neural Activity When Shifting Attention Away from On-Beat Times of a Distracting Rhythm , 2016, The Journal of Neuroscience.

[20]  Björn Herrmann,et al.  Low-Frequency Neural Oscillations Support Dynamic Attending in Temporal Context , 2014 .

[21]  C. Schroeder,et al.  Multi-Scale Entrainment of Coupled Neuronal Oscillations in Primary Auditory Cortex , 2015, Front. Hum. Neurosci..

[22]  Daniel Sanabria,et al.  Electrophysiological evidence of temporal preparation driven by rhythms in audition , 2013, Biological Psychology.

[23]  Peter Essens,et al.  Perception of Temporal Patterns , 1985 .

[24]  M E Lutman,et al.  Recording the middle latency response of the auditory evoked potential as a measure of depth of anaesthesia. A technical note. , 2004, British journal of anaesthesia.

[25]  Matthew Brett,et al.  Rhythm and Beat Perception in Motor Areas of the Brain , 2007, Journal of Cognitive Neuroscience.

[26]  A. Nobre,et al.  Temporal Expectation Improves the Quality of Sensory Information , 2012, The Journal of Neuroscience.

[27]  Marta I. Garrido,et al.  Timing in Predictive Coding: The Roles of Task Relevance and Global Probability , 2017, Journal of Cognitive Neuroscience.

[28]  Henkjan Honing,et al.  Differences in auditory timing between human and nonhuman primates , 2014, Behavioral and Brain Sciences.

[29]  Lisa D. Sanders,et al.  Musical Meter Modulates the Allocation of Attention across Time , 2015, Journal of Cognitive Neuroscience.

[30]  S. Haegens,et al.  Rhythmic facilitation of sensory processing: A critical review , 2017, Neuroscience & Biobehavioral Reviews.

[31]  Aniruddh D. Patel,et al.  Top‐Down Control of Rhythm Perception Modulates Early Auditory Responses , 2009, Annals of the New York Academy of Sciences.

[32]  Justin London,et al.  Hearing in Time: Psychological Aspects of Musical Meter , 2004 .

[33]  Juhani Partanen,et al.  Optimal digital filters for analyzing the mid-latency auditory P50 event-related potential in patients with Alzheimer’s disease , 2016, Journal of Neuroscience Methods.

[34]  Jennifer T. Coull,et al.  Behavioural Dissociation between Exogenous and Endogenous Temporal Orienting of Attention , 2011, PloS one.

[35]  Assaf Breska,et al.  Automatic Bias of Temporal Expectations following Temporally Regular Input Independently of High-level Temporal Expectation , 2014, Journal of Cognitive Neuroscience.

[36]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[37]  A. Nobre,et al.  Time for the Fourth Dimension in Attention , 2014 .

[38]  Suzanne R. Jongman,et al.  Entrainment to an Auditory Signal: Is Attention Involved? , 2017, Journal of experimental psychology. General.

[39]  A. Driver Music and Movement , 1937 .

[40]  Hugo Merchant,et al.  Finding the beat: a neural perspective across humans and non-human primates , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  E. Schröger,et al.  Attention and prediction in human audition: a lesson from cognitive psychophysiology , 2015, The European journal of neuroscience.

[42]  Erich Schröger,et al.  Interrelation of attention and prediction in visual processing: Effects of task-relevance and stimulus probability , 2017, Biological Psychology.

[43]  S. Luck,et al.  How inappropriate high-pass filters can produce artifactual effects and incorrect conclusions in ERP studies of language and cognition. , 2015, Psychophysiology.

[44]  Roni Y. Granot,et al.  Differential Brain Response to Metrical Accents in Isochronous Auditory Sequences , 2005 .

[45]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[46]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[47]  Jessica A. Grahn,et al.  Individual differences in rhythmic ability: Behavioral and neuroimaging investigations. , 2012 .

[48]  B Tillmann,et al.  Regularity of unit length boosts statistical learning in verbal and nonverbal artificial languages , 2013, Psychonomic bulletin & review.

[49]  Erich Schröger,et al.  Maturation of obligatory auditory responses and their neural sources: Evidence from EEG and MEG , 2011, NeuroImage.

[50]  J. Obleser,et al.  What do we talk about when we talk about rhythm? , 2017, PLoS biology.

[51]  C. Drake,et al.  The “Ticktock” of Our Internal Clock , 2003, Psychological science.

[52]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[53]  Karl J. Friston,et al.  Expectation violation and attention to pain jointly modulate neural gain in somatosensory cortex , 2017, NeuroImage.

[54]  Fleur L. Bouwer,et al.  Rhesus Monkeys (Macaca mulatta) Sense Isochrony in Rhythm, but Not the Beat: Additional Support for the Gradual Audiomotor Evolution Hypothesis , 2018, Front. Neurosci..

[55]  B. Repp Do metrical accents create illusory phenomenal accents? , 2010, Attention, perception & psychophysics.

[56]  Timothy D. Griffiths,et al.  Distinct Neural Substrates of Duration-Based and Beat-Based Auditory Timing , 2011, The Journal of Neuroscience.

[57]  Barbara Tillmann,et al.  The implicit learning of metrical and nonmetrical temporal patterns , 2013, Quarterly journal of experimental psychology.

[58]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[59]  Timothy D. Griffiths,et al.  The basal ganglia in perceptual timing: Timing performance in Multiple System Atrophy and Huntington's disease , 2014, Neuropsychologia.

[60]  Geraint A. Wiggins,et al.  Entraining IDyOT: Timing in the Information Dynamics of Thinking , 2016, Front. Psychol..

[61]  C. Schroeder,et al.  The Spectrotemporal Filter Mechanism of Auditory Selective Attention , 2013, Neuron.

[62]  Douglas D. Potter,et al.  Perceiving rhythm where none exists: Event-related potential (ERP) correlates of subjective accenting , 2009, Cortex.

[63]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[64]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[65]  Dharmesh Patel Rhythm , 1919, The Craft of Poetry.

[66]  F. Waszak,et al.  The processing of mispredicted and unpredicted sensory inputs interact differently with attention , 2018, Neuropsychologia.

[67]  Janneke F. M. Jehee,et al.  Attention Reverses the Effect of Prediction in Silencing Sensory Signals , 2011, Cerebral cortex.

[68]  Kamini Rege,et al.  Music and Movement , 1992, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[69]  Anna C. Nobre,et al.  Anticipated moments: temporal structure in attention , 2017, Nature Reviews Neuroscience.

[70]  F. Waszak,et al.  Temporal expectation and spectral expectation operate in distinct fashion on neuronal populations , 2013, Neuropsychologia.

[71]  Luc H. Arnal,et al.  Temporal Prediction in lieu of Periodic Stimulation , 2016, The Journal of Neuroscience.

[72]  Isabelle Peretz,et al.  Without it no music: cognition, biology and evolution of musicality , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[73]  Pejman Sehatpour,et al.  Complementary fMRI and EEG evidence for more efficient neural processing of rhythmic vs. unpredictably timed sounds , 2015, Front. Psychol..

[74]  M. Grube,et al.  A Unified Model of Time Perception Accounts for Duration-Based and Beat-Based Timing Mechanisms , 2011, Front. Integr. Neurosci..

[75]  J. Grahn See what I hear? Beat perception in auditory and visual rhythms , 2012, Experimental Brain Research.

[76]  Fleur L. Bouwer,et al.  Perceiving temporal regularity in music: the role of auditory event-related potentials (ERPs) in probing beat perception. , 2014, Advances in experimental medicine and biology.

[77]  N. Lesica,et al.  Midbrain adaptation may set the stage for the perception of musical beat , 2017, Proceedings of the Royal Society B: Biological Sciences.

[78]  Nina Kraus,et al.  Neural responses to sounds presented on and off the beat of ecologically valid music , 2013, Front. Syst. Neurosci..

[79]  David Poeppel,et al.  Rhythmicity and cross-modal temporal cues facilitate detection , 2014, Neuropsychologia.

[80]  Elyse Sussman,et al.  Auditory Target Detection Is Affected by Implicit Temporal and Spatial Expectations , 2011, Journal of Cognitive Neuroscience.

[81]  P. Davies,et al.  Bandpass filter settings differentially affect measurement of P50 sensory gating in children and adults , 2012, Clinical Neurophysiology.

[82]  Jan-Mathijs Schoffelen,et al.  Temporal Expectation and Attention Jointly Modulate Auditory Oscillatory Activity in the Beta Band , 2015, PloS one.

[83]  Henkjan Honing,et al.  Are non-human primates capable of rhythmic entrainment? Evidence for the gradual audiomotor evolution hypothesis , 2014, Front. Neurosci..

[84]  K. Lange The ups and downs of temporal orienting: a review of auditory temporal orienting studies and a model associating the heterogeneous findings on the auditory N1 with opposite effects of attention and prediction , 2013, Front. Hum. Neurosci..

[85]  J. Vandekerckhove Bayesian inference for psychology , 2016 .

[86]  J. Obleser,et al.  Frequency modulation entrains slow neural oscillations and optimizes human listening behavior , 2012, Proceedings of the National Academy of Sciences.

[87]  Jeffrey N. Rouder,et al.  Bayesian inference for psychology. Part II: Example applications with JASP , 2017, Psychonomic Bulletin & Review.

[88]  R. Schaefer,et al.  Decomposing rhythm processing: electroencephalography of perceived and self-imposed rhythmic patterns , 2010, Psychological research.

[89]  Fleur L. Bouwer,et al.  Beat Processing Is Pre-Attentive for Metrically Simple Rhythms with Clear Accents: An ERP Study , 2014, PloS one.

[90]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[91]  S. Kotz,et al.  Temporal regularity effects on pre-attentive and attentive processing of deviance , 2011, Biological Psychology.

[92]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[93]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[94]  Luc H. Arnal,et al.  Proactive Sensing of Periodic and Aperiodic Auditory Patterns , 2018, Trends in Cognitive Sciences.

[95]  M. Jones,et al.  The influence of temporal regularities on the implicit learning of pitch structures , 2014, Quarterly journal of experimental psychology.

[96]  Dance to the rhythm, cautiously: Isolating unique indicators of oscillatory entrainment , 2017, PLoS biology.

[97]  Karl J. Friston,et al.  Attentional Enhancement of Auditory Mismatch Responses: a DCM/MEG Study , 2015, Cerebral cortex.

[98]  S. Hillyard,et al.  Human auditory evoked potentials. I. Evaluation of components. , 1974, Electroencephalography and clinical neurophysiology.

[99]  Christoph S. Herrmann,et al.  Auditory rhythms entrain visual processes in the human brain: Evidence from evoked oscillations and event-related potentials , 2015, NeuroImage.

[100]  Fleur L. Bouwer,et al.  What makes a rhythm complex? The influence of musical training and accent type on beat perception , 2018, PloS one.

[101]  Sonja A. Kotz,et al.  Bridging prediction and attention in current research on perception and action , 2015, Brain Research.

[102]  Hugo Merchant,et al.  Subsecond timing in primates: comparison of interval production between human subjects and rhesus monkeys. , 2009, Journal of neurophysiology.

[103]  Hugo Merchant,et al.  Neurobiology of Interval Timing , 2014, Advances in Experimental Medicine and Biology.

[104]  Sonja A. Kotz,et al.  A dual-pathway neural architecture for specific temporal prediction , 2013, Neuroscience & Biobehavioral Reviews.

[105]  Fleur L. Bouwer,et al.  Disentangling beat perception from sequential learning and examining the influence of attention and musical abilities on ERP responses to rhythm , 2016, Neuropsychologia.

[106]  Jeesun Kim,et al.  The Processing of Attended and Predicted Sounds in Time , 2016, Journal of Cognitive Neuroscience.

[107]  David Bartrés-Faz,et al.  Reorganization of brain networks in aging: a review of functional connectivity studies , 2015, Front. Psychol..

[108]  E. Large,et al.  Neural Networks for Beat Perception in Musical Rhythm , 2015, Front. Syst. Neurosci..

[109]  M. Pearce,et al.  A Probabilistic Model of Meter Perception: Simulating Enculturation , 2017, Front. Psychol..