Exploring how musical rhythm entrains brain activity with electroencephalogram frequency-tagging

The ability to perceive a regular beat in music and synchronize to this beat is a widespread human skill. Fundamental to musical behaviour, beat and meter refer to the perception of periodicities while listening to musical rhythms and often involve spontaneous entrainment to move on these periodicities. Here, we present a novel experimental approach inspired by the frequency-tagging approach to understand the perception and production of rhythmic inputs. This approach is illustrated here by recording the human electroencephalogram responses at beat and meter frequencies elicited in various contexts: mental imagery of meter, spontaneous induction of a beat from rhythmic patterns, multisensory integration and sensorimotor synchronization. Collectively, our observations support the view that entrainment and resonance phenomena subtend the processing of musical rhythms in the human brain. More generally, they highlight the potential of this approach to help us understand the link between the phenomenology of musical beat and meter and the bias towards periodicities arising under certain circumstances in the nervous system. Entrainment to music provides a highly valuable framework to explore general entrainment mechanisms as embodied in the human brain.

[1]  Daniel Bendor,et al.  Neural coding of periodicity in marmoset auditory cortex. , 2010, Journal of neurophysiology.

[2]  J. Vroomen,et al.  Perception of intersensory synchrony: A tutorial review , 2010, Attention, perception & psychophysics.

[3]  H Shibasaki,et al.  Cortical activation during fast repetitive finger movements in humans: steady-state movement-related magnetic fields and their cortical generators. , 1998, Electroencephalography and clinical neurophysiology.

[4]  Gérard Faucon,et al.  Temporal envelope processing in the human auditory cortex: Response and interconnections of auditory cortical areas , 2008, Hearing Research.

[5]  Peter König,et al.  Visual stimulus locking of EEG is modulated by temporal congruency of auditory stimuli , 2009, Experimental Brain Research.

[6]  J. Devin McAuley Tempo and Rhythm , 2010 .

[7]  B. Repp Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[8]  Mathieu Bourguignon,et al.  Neuronal network coherent with hand kinematics during fast repetitive hand movements , 2012, NeuroImage.

[9]  Björn Herrmann,et al.  Low-Frequency Neural Oscillations Support Dynamic Attending in Temporal Context , 2014 .

[10]  C. Spence,et al.  Audiovisual synchrony perception for music, speech, and object actions , 2006, Brain Research.

[11]  Justin London,et al.  Book Review: Hearing in Time: Psychological Aspects of Musical Meter (2nd Edition) , 2004 .

[12]  Riitta Hari,et al.  Functional motor-cortex mapping using corticokinematic coherence , 2011, NeuroImage.

[13]  Peter Desain,et al.  The Formation of Rhythmic Categories and Metric Priming , 2003, Perception.

[14]  Isabelle Peretz,et al.  Capturing with EEG the neural entrainment and coupling underlying sensorimotor synchronization to the beat. , 2015, Cerebral cortex.

[15]  L. H. Van Der Tweel,et al.  HUMAN VISUAL RESPONSES TO SINUSOIDALLY MODULATED LIGHT. , 1965, Electroencephalography and clinical neurophysiology.

[16]  A. Freud Cognitive Contributions To The Perception Of Spatial And Temporal Events , 2016 .

[17]  B. Rossion,et al.  Perceptual biases for rhythm: The Mismatch Negativity latency indexes the privileged status of binary vs non-binary interval ratios , 2007, Clinical Neurophysiology.

[18]  D. Poeppel,et al.  Auditory Cortex Tracks Both Auditory and Visual Stimulus Dynamics Using Low-Frequency Neuronal Phase Modulation , 2010, PLoS biology.

[19]  Felix V. Almonte,et al.  Neurodynamics, tonality, and the auditory brainstem response , 2012, Annals of the New York Academy of Sciences.

[20]  Jeff Pressing,et al.  Black Atlantic Rhythm: Its Computational and Transcultural Foundations , 2002 .

[21]  Kirill V Nourski,et al.  Representation of temporal sound features in the human auditory cortex , 2011, Reviews in the neurosciences.

[22]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[23]  F. Pollick,et al.  When knowing can replace seeing in audiovisual integration of actions , 2009, Cognition.

[24]  M. R. Jones,et al.  Time, our lost dimension: toward a new theory of perception, attention, and memory. , 1976, Psychological review.

[25]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[26]  Rufin VanRullen,et al.  On the cyclic nature of perception in vision versus audition , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  D. Regan Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine , 1989 .

[28]  Andreas Daffertshofer,et al.  Stabilization of bimanual coordination due to active interhemispheric inhibition: a dynamical account , 2005, Biological Cybernetics.

[29]  S. Martens,et al.  Using frequency tagging to quantify attentional deployment in a visual divided attention task. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[30]  R. Sekuler,et al.  Sound alters visual motion perception , 1997, Nature.

[31]  Olivier Bertrand,et al.  Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex , 2009, Hearing Research.

[32]  Zhiguo Zhang,et al.  Distinct Features of Auditory Steady-State Responses as Compared to Transient Event-Related Potentials , 2013, PloS one.

[33]  G. Madison Experiencing Groove Induced by Music: Consistency and Phenomenology , 2006 .

[34]  J. Gross,et al.  Steady-State Visual Evoked Potentials Can Be Explained by Temporal Superposition of Transient Event-Related Responses , 2011, PloS one.

[35]  Waka Fujisaki,et al.  Temporal frequency characteristics of synchrony–asynchrony discrimination of audio-visual signals , 2005, Experimental Brain Research.

[36]  M. Grube,et al.  Metricality-enhanced temporal encoding and the subjective perception of rhythmic sequences , 2009, Cortex.

[37]  C. Pantev,et al.  Tonotopic organization of the sources of human auditory steady-state responses , 1996, Hearing Research.

[38]  Jürgen Kurths,et al.  Synchronization: Phase locking and frequency entrainment , 2001 .

[39]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[40]  Peter Essens,et al.  Perception of Temporal Patterns , 1985 .

[41]  A. Glenberg,et al.  Modality effects in the coding and reproduction of rhythms. , 1989, Memory & cognition.

[42]  Shozo Tobimatsu,et al.  Steady-state vibration somatosensory evoked potentials: physiological characteristics and tuning function , 1999, Clinical Neurophysiology.

[43]  Justin London,et al.  Hearing in Time: Psychological Aspects of Musical Meter , 2004 .

[44]  L. Trainor,et al.  Hearing what the body feels: Auditory encoding of rhythmic movement , 2007, Cognition.

[45]  H. Flor,et al.  Steady-State Movement-Related Potentials Evoked by Fast Repetitive Movements , 2004, Brain Topography.

[46]  Aniruddh D. Patel,et al.  Top‐Down Control of Rhythm Perception Modulates Early Auditory Responses , 2009, Annals of the New York Academy of Sciences.

[47]  Neil P. McAngus Todd,et al.  Motion in Music: A Neurobiological Perspective , 1999 .

[48]  Isabelle Peretz,et al.  Steady-state evoked potentials as an index of multisensory temporal binding , 2012, NeuroImage.

[49]  C Athena Aktipis,et al.  The ecology of entrainment: Foundations of coordinated rhythmic movement. , 2010, Music perception.

[50]  Bruno Rossion,et al.  Understanding individual face discrimination by means of fast periodic visual stimulation , 2014, Experimental Brain Research.

[51]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[52]  Felix V. Almonte,et al.  Mode-locking neurodynamics predict human auditory brainstem responses to musical intervals , 2014, Hearing Research.

[53]  Y. Yarom,et al.  Resonance, oscillation and the intrinsic frequency preferences of neurons , 2000, Trends in Neurosciences.

[54]  Robert Albert,et al.  The beat goes on: rhythmic modulation of cortical potentials by imagined tapping. , 2006, Journal of experimental psychology. Human perception and performance.

[55]  M Hallett,et al.  Steady-state movement-related cortical potentials: a new approach to assessing cortical activity associated with fast repetitive finger movements. , 1997, Electroencephalography and clinical neurophysiology.

[56]  Isabelle Peretz,et al.  Tagging the Neuronal Entrainment to Beat and Meter , 2011, The Journal of Neuroscience.

[57]  J. Eggermont Between sound and perception: reviewing the search for a neural code , 2001, Hearing Research.

[58]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[59]  K. Shapiro,et al.  The contingent negative variation (CNV) event-related potential (ERP) predicts the attentional blink , 2008 .

[60]  Edward W. Large,et al.  Pulse Detection in Syncopated Rhythms Using Neural Oscillators , 2011, ISMIR.

[61]  E. Large Resonating to Musical Rhythm : Theory and Experiment , 2008 .

[62]  L. V. Noorden,et al.  Resonance in the Perception of Musical Pulse , 1999 .

[63]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[64]  McAngus N. Todd,et al.  A sensorimotor theory of temporal tracking and beat induction , 2002, Psychological research.

[65]  J. Devin McAuley,et al.  FMRI investigation of cross-modal interactions in beat perception: Audition primes vision, but not vice versa , 2011, NeuroImage.

[66]  Jessica A. Grahn,et al.  Neural Mechanisms of Rhythm Perception: Current Findings and Future Perspectives , 2012, Top. Cogn. Sci..

[67]  Arthur M. Glenberg,et al.  Modality effects in the coding reproduction of rhythms , 1989 .

[68]  C. Schroeder,et al.  Thalamocortical mechanisms for integrating musical tone and rhythm , 2014, Hearing Research.

[69]  R. Zatorre,et al.  Listening to musical rhythms recruits motor regions of the brain. , 2008, Cerebral cortex.

[70]  A. Norcia,et al.  An objective signature for visual binding of face parts in the human brain. , 2013, Journal of vision.

[71]  R. Schaefer,et al.  Decomposing rhythm processing: electroencephalography of perceived and self-imposed rhythmic patterns , 2010, Psychological research.

[72]  D. Poeppel,et al.  Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “Cocktail Party” , 2013, Neuron.

[73]  Terence W. Picton,et al.  Frequency specificity of 40-Hz auditory steady-state responses , 2003, Hearing Research.

[74]  Peter Praamstra,et al.  Movement-related changes in cortical excitability: A steady-state SEP approach , 2008, Brain Research.

[75]  Daniel Senkowski,et al.  Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations , 2007, Neuropsychologia.

[76]  B. Ross,et al.  Endogenous Neuromagnetic Activity for Mental Hierarchy of Timing , 2010, The Journal of Neuroscience.

[77]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[78]  L. Trainor,et al.  Feeling the Beat: Movement Influences Infant Rhythm Perception , 2005, Science.

[79]  Wolfgang Prinz,et al.  Neuromagnetic Correlates of Sensorimotor Synchronization , 2000, Journal of Cognitive Neuroscience.

[80]  Catherine J. Stevens,et al.  Music Perception and Cognition: A Review of Recent Cross-Cultural Research , 2012, Top. Cogn. Sci..

[81]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[82]  C. Spence,et al.  Audiovisual temporal order judgments , 2003, Experimental Brain Research.

[83]  C. Drake,et al.  The “Ticktock” of Our Internal Clock , 2003, Psychological science.

[84]  P. Keller,et al.  Searching for Roots of Entrainment and Joint Action in Early Musical Interactions , 2012, Front. Hum. Neurosci..

[85]  Aniruddh D. Patel,et al.  The influence of metricality and modality on synchronization with a beat , 2005, Experimental Brain Research.

[86]  B. Repp Do metrical accents create illusory phenomenal accents? , 2010, Attention, perception & psychophysics.

[87]  Matthew Brett,et al.  Rhythm and Beat Perception in Motor Areas of the Brain , 2007, Journal of Cognitive Neuroscience.

[88]  Israel Nelken,et al.  Auditory Neuroscience: Making Sense of Sound , 2012 .

[89]  Wolfgang Prinz,et al.  Cortical activations associated with auditorily paced finger tapping , 2003, Neuroreport.

[90]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[91]  D. Regan Some characteristics of average steady-state and transient responses evoked by modulated light. , 1966, Electroencephalography and clinical neurophysiology.

[92]  Christoph Kayser,et al.  Phase Resetting as a Mechanism for Supramodal Attentional Control , 2009, Neuron.

[93]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[94]  A. Puce,et al.  Neuronal oscillations and visual amplification of speech , 2008, Trends in Cognitive Sciences.

[95]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[96]  M. Grube,et al.  A Unified Model of Time Perception Accounts for Duration-Based and Beat-Based Timing Mechanisms , 2011, Front. Integr. Neurosci..

[97]  J. Obleser,et al.  Frequency modulation entrains slow neural oscillations and optimizes human listening behavior , 2012, Proceedings of the National Academy of Sciences.

[98]  B. Rossion,et al.  Robust sensitivity to facial identity in the right human occipito-temporal cortex as revealed by steady-state visual-evoked potentials. , 2011, Journal of vision.

[99]  J. Snyder,et al.  Gamma-band activity reflects the metric structure of rhythmic tone sequences. , 2005, Brain research. Cognitive brain research.

[100]  Aniruddh D. Patel,et al.  The evolutionary neuroscience of musical beat perception: the Action Simulation for Auditory Prediction (ASAP) hypothesis , 2013, Front. Syst. Neurosci..

[101]  Jason M Haberman,et al.  Sensorimotor coupling in music and the psychology of the groove. , 2012, Journal of experimental psychology. General.

[102]  P. Bertelson Chapter 14 Ventriloquism: A case of crossmodal perceptual grouping , 1999 .

[103]  Isabelle Peretz,et al.  Selective Neuronal Entrainment to the Beat and Meter Embedded in a Musical Rhythm , 2012, The Journal of Neuroscience.

[104]  Alex R. Wade,et al.  Figure-ground interaction in the human visual cortex. , 2008, Journal of vision.

[105]  S. Hillyard,et al.  Selective attention to stimulus location modulates the steady-state visual evoked potential. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[106]  Bruno Rossion,et al.  A steady-state visual evoked potential approach to individual face perception: Effect of inversion, contrast-reversal and temporal dynamics , 2012, NeuroImage.

[107]  Hans Forssberg,et al.  Listening to rhythms activates motor and premotor cortices , 2009, Cortex.

[108]  André Mouraux,et al.  Steady-state evoked potentials to tag specific components of nociceptive cortical processing , 2012, NeuroImage.

[109]  S. Makeig,et al.  A 40-Hz auditory potential recorded from the human scalp. , 1981, Proceedings of the National Academy of Sciences of the United States of America.

[110]  Zhishen Wu,et al.  x$%x#%x , 2015 .

[111]  Robert Galambos,et al.  TACTILE AND AUDITORY STIMULI REPEATED AT HIGH RATES (30–50 PER SEC) PRODUCE SIMILAR EVENT RELATED POTENTIALS * , 1980 .

[112]  Björn Herrmann,et al.  A Precluding Role of Low-Frequency Oscillations for Auditory Perception in a Continuous Processing Mode , 2012, The Journal of Neuroscience.

[113]  H. Honing,et al.  How much beat do you need? An EEG study on the effects of attention on beat perception using only temporal accents , 2013 .

[114]  Björn Herrmann,et al.  Oscillatory Phase Dynamics in Neural Entrainment Underpin Illusory Percepts of Time , 2013, The Journal of Neuroscience.