Microsaccadic Responses Indicate Fast Categorization of Sounds: A Novel Approach to Study Auditory Cognition

The mental chronometry of the human brain's processing of sounds to be categorized as targets has intensively been studied in cognitive neuroscience. According to current theories, a series of successive stages consisting of the registration, identification, and categorization of the sound has to be completed before participants are able to report the sound as a target by button press after ∼300–500 ms. Here we use miniature eye movements as a tool to study the categorization of a sound as a target or nontarget, indicating that an initial categorization is present already after 80–100 ms. During visual fixation, the rate of microsaccades, the fastest components of miniature eye movements, is transiently modulated after auditory stimulation. In two experiments, we measured microsaccade rates in human participants in an auditory three-tone oddball paradigm (including rare nontarget sounds) and observed a difference in the microsaccade rates between targets and nontargets as early as 142 ms after sound onset. This finding was replicated in a third experiment with directed saccades measured in a paradigm in which tones had to be matched to score-like visual symbols. Considering the delays introduced by (motor) signal transmission and data analysis constraints, the brain must have differentiated target from nontarget sounds as fast as 80–100 ms after sound onset in both paradigms. We suggest that predictive information processing for expected input makes higher cognitive attributes, such as a sound's identity and category, available already during early sensory processing. The measurement of eye movements is thus a promising approach to investigate hearing.

[1]  M. Tervaniemi,et al.  From symbols to sounds: visual symbolic information activates sound representations. , 2004, Psychophysiology.

[2]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[3]  Jeff Miller,et al.  Jackknife-based method for measuring LRP onset latency differences. , 1998, Psychophysiology.

[4]  Ziad M. Hafed Mechanisms for generating and compensating for the smallest possible saccades , 2011, The European journal of neuroscience.

[5]  W. G. Gardner,et al.  HRTF measurements of a KEMAR , 1995 .

[6]  S. Martinez-Conde,et al.  The impact of microsaccades on vision: towards a unified theory of saccadic function , 2013, Nature Reviews Neuroscience.

[7]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[8]  S. Grimm,et al.  Novelty Detection in the Human Auditory Brainstem , 2012, The Journal of Neuroscience.

[9]  Reinhold Kliegl,et al.  Microsaccadic inhibition and P300 enhancement in a visual oddball task. , 2009, Psychophysiology.

[10]  Shlomit Yuval-Greenberg,et al.  Scalp-Recorded Induced Gamma-Band Responses to Auditory Stimulation and Its Correlations with Saccadic Muscle-Activity , 2011, Brain Topography.

[11]  Carles Escera,et al.  Early processing of pitch in the human auditory system , 2012, The European journal of neuroscience.

[12]  I. Winkler,et al.  Predictive Regularity Representations in Violation Detection and Auditory Stream Segregation: From Conceptual to Computational Models , 2014, Brain Topography.

[13]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[14]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[15]  Erich Schröger,et al.  Filter Effects and Filter Artifacts in the Analysis of Electrophysiological Data , 2012, Front. Psychology.

[16]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[17]  A. Engel,et al.  Cognitive functions of gamma-band activity: memory match and utilization , 2004, Trends in Cognitive Sciences.

[18]  D. Ridder,et al.  From sensation to percept: The neural signature of auditory event-related potentials , 2014, Neuroscience & Biobehavioral Reviews.

[19]  D. Robinson Eye movements evoked by collicular stimulation in the alert monkey. , 1972, Vision research.

[20]  D L Sparks,et al.  Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. , 1986, Physiological reviews.

[21]  You Yun Lee,et al.  Quantitative assessment of divergence eye movements. , 2008, Journal of vision.

[22]  E. Donchin,et al.  Parsing the late positive complex: mental chronometry and the ERP components that inhabit the neighborhood of the P300. , 2004, Psychophysiology.

[23]  Ralf Engbert,et al.  Toward a model of microsaccade generation: the case of microsaccadic inhibition. , 2008, Journal of vision.

[24]  Ralf Engbert Microsaccades: A microcosm for research on oculomotor control, attention, and visual perception. , 2006, Progress in brain research.

[25]  M. Tervaniemi,et al.  Binding symbols and sounds: evidence from event-related oscillatory gamma-band activity. , 2007, Cerebral cortex.

[26]  D Friedman,et al.  A brain event related to the making of a sensory discrimination. , 1979, Science.

[27]  I. Nelken,et al.  Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades , 2008, Neuron.

[28]  Jeff Miller,et al.  Measurement of ERP latency differences: a comparison of single-participant and jackknife-based scoring methods. , 2008, Psychophysiology.

[29]  Guillaume A. Rousselet,et al.  Does Filtering Preclude Us from Studying ERP Time-Courses? , 2012, Front. Psychology.

[30]  Ralf Engbert,et al.  An integrated model of fixational eye movements and microsaccades , 2011, Proceedings of the National Academy of Sciences.

[31]  Ralf Engbert,et al.  Computational Modeling of Collicular Integration of Perceptual Responses and Attention in Microsaccades , 2012, The Journal of Neuroscience.

[32]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[33]  M. Turatto,et al.  Visual oddballs induce prolonged microsaccadic inhibition , 2007, Experimental Brain Research.

[34]  Ralf Engbert,et al.  Microsaccades are triggered by low retinal image slip. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Ziad M. Hafed,et al.  A Neural Mechanism for Microsaccade Generation in the Primate Superior Colliculus , 2009, Science.

[36]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. I. Relation of visual and auditory responses to saccades. , 1983, Journal of neurophysiology.

[37]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  S. Grimm,et al.  Ultrafast tracking of sound location changes as revealed by human auditory evoked potentials , 2012, Biological Psychology.

[39]  Rufin VanRullen,et al.  Four Common Conceptual Fallacies in Mapping the Time Course of Recognition , 2011, Front. Psychology.

[40]  S. Grimm,et al.  Auditory deviance detection revisited: evidence for a hierarchical novelty system. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[41]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.

[42]  Kenneth J. Ciuffreda,et al.  Eye Movement Basics For The Clinician , 1995 .

[43]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[44]  Risto N t nen Attention and brain function , 1992 .

[45]  Erich Schröger,et al.  Mapping Symbols to Sounds: Electrophysiological Correlates of the Impaired Reading Process in Dyslexia , 2012, Front. Psychology.

[46]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[47]  Guy Dove,et al.  Linking Brainwaves to the Brain: An ERP Primer , 2005, Developmental neuropsychology.

[48]  Matteo Valsecchi,et al.  Microsaccadic responses in a bimodal oddball task , 2009, Psychological research.

[49]  E. Donchin,et al.  Probability effects on stimulus evaluation and response processes. , 1992, Journal of experimental psychology. Human perception and performance.

[50]  I. Winkler,et al.  The concept of auditory stimulus representation in cognitive neuroscience. , 1999, Psychological bulletin.