The reliability of continuous brain responses during naturalistic listening to music

Low-level (timbral) and high-level (tonal and rhythmical) musical features during continuous listening to music, studied by functional magnetic resonance imaging (fMRI), have been shown to elicit large-scale responses in cognitive, motor, and limbic brain networks. Using a similar methodological approach and a similar group of participants, we aimed to study the replicability of previous findings. Participants' fMRI responses during continuous listening of a tango Nuevo piece were correlated voxelwise against the time series of a set of perceptually validated musical features computationally extracted from the music. The replicability of previous results and the present study was assessed by two approaches: (a) correlating the respective activation maps, and (b) computing the overlap of active voxels between datasets at variable levels of ranked significance. Activity elicited by timbral features was better replicable than activity elicited by tonal and rhythmical ones. These results indicate more reliable processing mechanisms for low-level musical features as compared to more high-level features. The processing of such high-level features is probably more sensitive to the state and traits of the listeners, as well as of their background in music.

[1]  Abraham Z. Snyder,et al.  Atlas-based head modeling and spatial normalization for high-density diffuse optical tomography: In vivo validation against fMRI , 2014, NeuroImage.

[2]  Vinoo Alluri,et al.  Capturing the musical brain with Lasso: Dynamic decoding of musical features from fMRI data , 2014, NeuroImage.

[3]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[4]  L. Davachi,et al.  Enhanced Intersubject Correlations during Movie Viewing Correlate with Successful Episodic Encoding , 2008, Neuron.

[5]  T. Jacobsen,et al.  Toward a Neural Chronometry for the Aesthetic Experience of Music , 2013, Front. Psychol..

[6]  K. Hong,et al.  Lateralization of music processing with noises in the auditory cortex: an fNIRS study , 2014, Front. Behav. Neurosci..

[7]  Mark E. Bastin,et al.  Single subject fMRI test–retest reliability metrics and confounding factors , 2013, NeuroImage.

[8]  Jean-Baptiste Poline,et al.  Analysis of a large fMRI cohort: Statistical and methodological issues for group analyses , 2007, NeuroImage.

[9]  Marc Leman,et al.  The Cortical Topography of Tonal Structures Underlying Western Music , 2002, Science.

[10]  H. Critchley,et al.  fMRI Scanner Noise Interaction with Affective Neural Processes , 2013, PloS one.

[11]  P. Janata,et al.  Listening to polyphonic music recruits domain-general attention and working memory circuits , 2002, Cognitive, affective & behavioral neuroscience.

[12]  Stephen McAdams,et al.  Separate Neural Processing of Timbre Dimensions in Auditory Sensory Memory , 2006, Journal of Cognitive Neuroscience.

[13]  Mikko Sams,et al.  Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm , 2012, NeuroImage.

[14]  G. Kramer Auditory Scene Analysis: The Perceptual Organization of Sound by Albert Bregman (review) , 2016 .

[15]  M. Scherg,et al.  Morphology of Heschl's gyrus reflects enhanced activation in the auditory cortex of musicians , 2002, Nature Neuroscience.

[16]  Joseph T. Devlin,et al.  Consistency and variability in functional localisers , 2009, NeuroImage.

[17]  Kentaro Uesugi,et al.  Measuring Airway Surface Liquid Depth in Ex Vivo Mouse Airways by X-Ray Imaging for the Assessment of Cystic Fibrosis Airway Therapies , 2013, PloS one.

[18]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[19]  M. B. Nebel,et al.  Quantifying the reliability of image replication studies: The image intraclass correlation coefficient (I2C2) , 2013, Cognitive, affective & behavioral neuroscience.

[20]  K. Amunts,et al.  Individual variability is not noise , 2013, Trends in Cognitive Sciences.

[21]  Tapani Ristaniemi,et al.  From Vivaldi to Beatles and back: Predicting lateralized brain responses to music , 2013, NeuroImage.

[22]  E. Brattico,et al.  Cognitive Control in Auditory Working Memory Is Enhanced in Musicians , 2010, PloS one.

[23]  M. Tervaniemi,et al.  Lateralization of auditory-cortex functions , 2003, Brain Research Reviews.

[24]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[25]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[26]  Andreas Schulze-Bonhage,et al.  The reliability of fMRI activations in the medial temporal lobes in a verbal episodic memory task , 2005, NeuroImage.

[27]  Jessica A. Grahn,et al.  Feeling the Beat: Premotor and Striatal Interactions in Musicians and Nonmusicians during Beat Perception , 2009, The Journal of Neuroscience.

[28]  R. Patterson,et al.  Analyzing Pitch Chroma and Pitch Height in the Human Brain , 2003, Annals of the New York Academy of Sciences.

[29]  Wolfgang Grodd,et al.  Hemispheric Lateralization Effects of Rhythm Implementation during Syllable Repetitions: An fMRI Study , 2002, NeuroImage.

[30]  Adam C. Riggall,et al.  The Relationship between Working Memory Storage and Elevated Activity as Measured with Functional Magnetic Resonance Imaging , 2012, The Journal of Neuroscience.

[31]  K. Ochsner,et al.  The Need for a Cognitive Neuroscience of Naturalistic Social Cognition , 2009, Annals of the New York Academy of Sciences.

[32]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[33]  R. Zatorre,et al.  Listening to musical rhythms recruits motor regions of the brain. , 2008, Cerebral cortex.

[34]  R. Malach,et al.  Human brain activation during viewing of dynamic natural scenes. , 2006, Novartis Foundation symposium.

[35]  Kevin N. Ochsner,et al.  Attention and emotion: Does rating emotion alter neural responses to amusing and sad films? , 2005, NeuroImage.

[36]  N Jon Shah,et al.  Assessment of reliability in functional imaging studies , 2003, Journal of magnetic resonance imaging : JMRI.

[37]  H. Bülthoff,et al.  View dependencies in the visual recognition of social interactions , 2013, Front. Psychol..

[38]  Elke B Lange,et al.  Differentiating between Verbal and Spatial Encoding using Eye-Movement Recordings , 2013, Quarterly journal of experimental psychology.

[39]  G. Glover,et al.  Physiological noise in oxygenation‐sensitive magnetic resonance imaging , 2001, Magnetic resonance in medicine.

[40]  R. Zatorre,et al.  Behavioral and neural correlates of perceived and imagined musical timbre , 2004, Neuropsychologia.

[41]  G. Fisone,et al.  Acquisition and expression of conditioned taste aversion differentially affects extracellular signal regulated kinase and glutamate receptor phosphorylation in rat prefrontal cortex and nucleus accumbens , 2014, Front. Behav. Neurosci..

[42]  Adriaan Moelker,et al.  Acoustic noise concerns in functional magnetic resonance imaging , 2003, Human brain mapping.

[43]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[44]  R. Patterson,et al.  The Processing of Temporal Pitch and Melody Information in Auditory Cortex , 2002, Neuron.

[45]  Michael B. Miller,et al.  How reliable are the results from functional magnetic resonance imaging? , 2010, Annals of the New York Academy of Sciences.

[46]  Ching-Yune C. Sylvester,et al.  The Cognitive Neuroscience of Working Memory and Aging , 2005 .

[47]  W. Uttal Mind and Brain: A Critical Appraisal of Cognitive Neuroscience , 2011 .

[48]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[49]  R. Peterman,et al.  Comparison of methods to account for autocorrelation in correlation analyses of fish data , 1998 .

[50]  Sophie Achard The Statistical Analysis of Functional MRI Data , 2008 .

[51]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[52]  S. Zeki,et al.  Functional brain mapping during free viewing of natural scenes , 2004, Human brain mapping.

[53]  M. Tervaniemi Musicians—Same or Different? , 2009, Annals of the New York Academy of Sciences.

[54]  Mark D'Esposito,et al.  Distributed and Dynamic Storage of Working Memory Stimulus Information in Extrastriate Cortex , 2014, Journal of Cognitive Neuroscience.

[55]  Karl J. Friston,et al.  Variability in fMRI: An Examination of Intersession Differences , 2000, NeuroImage.

[56]  B. Breitmeyer,et al.  Mechanisms of visual attention revealed by saccadic eye movements , 1987, Neuropsychologia.

[57]  Christopher J. Honey,et al.  Future trends in Neuroimaging: Neural processes as expressed within real-life contexts , 2012, NeuroImage.

[58]  Ed Vul,et al.  Voodoo and circularity errors , 2012, NeuroImage.

[59]  Steven L. Small,et al.  Test–retest reliability in fMRI of language: Group and task effects , 2007, Brain and Language.

[60]  M. Kendall Statistical Methods for Research Workers , 1937, Nature.

[61]  D. Barch,et al.  Introduction to the special issue on reliability and replication in cognitive and affective neuroscience research , 2013, Cognitive, affective & behavioral neuroscience.

[62]  R. Wallace The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason , 1988 .

[63]  W. Ebisuzaki A Method to Estimate the Statistical Significance of a Correlation When the Data Are Serially Correlated , 1997 .

[64]  John W. Tukey,et al.  Statistical Methods for Research Workers , 1930, Nature.

[65]  G. Bydder,et al.  Magnetic Resonance Scanning and Epilepsy , 1994, NATO ASI Series.