Advantage of audition over vision in a perceptual timing task but not in a sensorimotor timing task

Timing is essential for various behaviors and relative to vision, audition is considered to be specialized for temporal processing. The present study conducted a sensorimotor timing task that required tapping in synchrony with a temporally regular sequence and a perceptual timing task that required detecting a timing deviation among a temporally regular sequence. The sequence was composed of auditory tones, visual flashes, or a visual bouncing ball. In the sensorimotor task, sensorimotor timing performance (synchronization stability) of the bouncing ball was much greater than that of flashes and was comparable to that of tones. In the perceptual task, where perceptual timing performance of the bouncing ball was greater than that of flashes, it was poorer than that of tones. These results suggest the facilitation of both perceptual and sensorimotor processing of temporal information by the bouncing ball. Given such facilitation of temporal processing, however, audition is still superior over vision in perceptual detection of timing.

[1]  S. Castro,et al.  Moving Stimuli Facilitate Synchronization But Not Temporal Perception , 2016, Front. Psychol..

[2]  Aniruddh D. Patel,et al.  The evolutionary neuroscience of musical beat perception: the Action Simulation for Auditory Prediction (ASAP) hypothesis , 2013, Front. Syst. Neurosci..

[3]  Junkai Yang,et al.  Relative Contributions of the Speed Characteristic and Other Possible Ecological Factors in Synchronization to a Visual Beat Consisting of Periodically Moving Stimuli , 2018, Front. Psychol..

[4]  James Ashe,et al.  Role of olivocerebellar system in timing without awareness , 2011, Proceedings of the National Academy of Sciences.

[5]  D. Buonomano,et al.  The neural basis of temporal processing. , 2004, Annual review of neuroscience.

[6]  Daniël Lakens,et al.  Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs , 2013, Front. Psychol..

[7]  B. Repp Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[8]  Chris Davis,et al.  Influence of pacer continuity on continuous and discontinuous visuo-motor synchronisation. , 2016, Acta psychologica.

[9]  Li Gu,et al.  Auditory Over Visual Advantage of Sensorimotor Synchronization in 6- to 7-Year-Old Children but Not in 12- to 15-Year-Old Children and Adults , 2017, Journal of experimental psychology. Human perception and performance.

[10]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[11]  R. Abrams,et al.  Motion Onset Captures Attention , 2003, Psychological science.

[12]  Manuel Varlet,et al.  The influence of visual cues on temporal anticipation and movement synchronization with musical sequences. , 2018, Acta psychologica.

[13]  H Stanislaw,et al.  Calculation of signal detection theory measures , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[14]  Benoît G. Bardy,et al.  Continuity of Visual and Auditory Rhythms Influences Sensorimotor Coordination , 2012, PloS one.

[15]  Juan M. Toro,et al.  Look at the Beat, Feel the Meter: Top–Down Effects of Meter Induction on Auditory and Visual Modalities , 2016, Front. Hum. Neurosci..

[16]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[17]  Michael J. Richardson,et al.  Influence of stimulus velocity profile on rhythmic visuomotor coordination. , 2014, Journal of experimental psychology. Human perception and performance.

[18]  Jakub S. Sowinski,et al.  Uncovering beat deafness: detecting rhythm disorders with synchronized finger tapping and perceptual timing tasks. , 2015, Journal of visualized experiments : JoVE.

[19]  Bruno H. Repp,et al.  Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. , 2002, Journal of experimental psychology. Human perception and performance.

[20]  B. Repp,et al.  Synchronization with competing visual and auditory rhythms: bouncing ball meets metronome , 2013, Psychological research.

[21]  Aniruddh D. Patel,et al.  The influence of metricality and modality on synchronization with a beat , 2005, Experimental Brain Research.

[22]  Timothy D. Griffiths,et al.  Distinct Neural Substrates of Duration-Based and Beat-Based Auditory Timing , 2011, The Journal of Neuroscience.

[23]  M. Goodale,et al.  The visual brain in action , 1995 .

[24]  Peter E. Keller,et al.  Synchronizing with auditory and visual rhythms: An fMRI assessment of modality differences and modality appropriateness , 2013, NeuroImage.

[25]  Peter Essens,et al.  Perception of Temporal Patterns , 1985 .

[26]  Michael Schutz,et al.  “Moving to the beat” improves timing perception , 2013, Psychonomic Bulletin & Review.

[27]  N. Fisher,et al.  Statistical Analysis of Circular Data , 1993 .

[28]  Jessica A. Grahn,et al.  Feeling the Beat: Premotor and Striatal Interactions in Musicians and Nonmusicians during Beat Perception , 2009, The Journal of Neuroscience.

[29]  J. Vroomen,et al.  Intersensory binding across space and time: A tutorial review , 2013, Attention, Perception, & Psychophysics.

[30]  J. Iversen,et al.  Synchronization and temporal processing , 2016, Current Opinion in Behavioral Sciences.

[31]  Ray Jackendoff,et al.  An overview of hierarchical structure in music , 1983 .

[32]  J. Devin McAuley,et al.  FMRI investigation of cross-modal interactions in beat perception: Audition primes vision, but not vice versa , 2011, NeuroImage.

[33]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[34]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[35]  B. Repp,et al.  Rhythmic movement is attracted more strongly to auditory than to visual rhythms , 2004, Psychological research.

[36]  B. Repp,et al.  Sensorimotor synchronization: A review of recent research (2006–2012) , 2013, Psychonomic Bulletin & Review.

[37]  Aniruddh D. Patel The Evolutionary Biology of Musical Rhythm: Was Darwin Wrong? , 2014, PLoS biology.

[38]  B. Repp Perception of timing is more context sensitive than sensorimotor synchronization , 2002, Perception & psychophysics.

[39]  Michael J. Spivey,et al.  Compatibility of motion facilitates visuomotor synchronization. , 2010, Journal of experimental psychology. Human perception and performance.

[40]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[41]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[42]  Jeesun Kim,et al.  The dual influence of pacer continuity and pacer pattern for visuomotor synchronisation , 2018, Neuroscience Letters.

[43]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[44]  R. Ivry The representation of temporal information in perception and motor control , 1996, Current Opinion in Neurobiology.

[45]  P. Tse,et al.  Time and the Brain: How Subjective Time Relates to Neural Time , 2005 .

[46]  Yi-Huang Su Sensorimotor Synchronization with Different Metrical Levels of Point-Light Dance Movements , 2016, Front. Hum. Neurosci..

[47]  M. Grube,et al.  Dissociation of duration-based and beat-based auditory timing in cerebellar degeneration , 2010, Proceedings of the National Academy of Sciences.

[48]  Johann Issartel,et al.  The supplementation of spatial information improves coordination , 2013, Neuroscience Letters.

[49]  G. Schlaug,et al.  The Harvard Beat Assessment Test (H-BAT): a battery for assessing beat perception and production and their dissociation , 2013, Front. Hum. Neurosci..

[50]  Liang Zhou,et al.  Synchronization to a bouncing ball with a realistic motion trajectory , 2015, Scientific Reports.

[51]  A. Costall Are theories of perception necessary? A review of Gibson's The Ecological Approach to Visual Perception. , 1984, Journal of the experimental analysis of behavior.

[52]  Aniruddh D. Patel,et al.  UC Office of the President Recent Work Title Synchronization to auditory and visual rhythms in hearing and deaf individuals Permalink , 2014 .

[53]  A. Hamilton,et al.  Interference effect of observed human movement on action is due to velocity profile of biological motion , 2007, Social neuroscience.

[54]  A. Holcombe Seeing slow and seeing fast: two limits on perception , 2009, Trends in Cognitive Sciences.

[55]  Randolph Blake,et al.  Hearing What the Eyes See , 2005, Psychological science.

[56]  Michael J. Richardson,et al.  Influence of stimulus velocity profile on unintentional visuomotor entrainment depends on eye movements , 2017, Experimental Brain Research.

[57]  E. Pöppel,et al.  Body movement enhances the extraction of temporal structures in auditory sequences , 2011, Psychological Research.