Neural Processing of Speech Sounds in ASD and First-Degree Relatives

This tutorial provides a comprehensive overview of the methodological approach to collecting and analyzing auditory brain stem responses to complex sounds (cABRs). cABRs provide a window into how behaviorally relevant sounds such as speech and music are processed in the brain. Because temporal and spectral characteristics of sounds are preserved in this subcortical response, cABRs can be used to assess specific impairments and enhancements in auditory processing. Notably, subcortical auditory function is neither passive nor hardwired but dynamically interacts with higher-level cognitive processes to refine how sounds are transcribed into neural code. This experience-dependent plasticity, which can occur on a number of time scales (e.g., life-long experience with speech or music, short-term auditory training, on-line auditory processing), helps shape sensory perception. Thus, by being an objective and noninvasive means for examining cognitive function and experience-dependent processes in sensory activity, cABRs have considerable utility in the study of populations where auditory function is of interest (e.g., auditory experts such as musicians, and persons with hearing loss, auditory processing, and language disorders). This tutorial is intended for clinicians and researchers seeking to integrate cABRs into their clinical or research programs.

[1]  P N Plyler,et al.  Human frequency-following responses: representation of second formant transitions in normal-hearing and hearing-impaired listeners. , 2001, Journal of the American Academy of Audiology.

[2]  Pascal Wallisch,et al.  MATLAB for Neuroscientists: An Introduction to Scientific Computing in MATLAB , 2008 .

[3]  N. Kraus,et al.  Musical experience shapes top-down auditory mechanisms: Evidence from masking and auditory attention performance , 2010, Hearing Research.

[4]  N. Kraus,et al.  Musical experience and neural efficiency – effects of training on subcortical processing of vocal expressions of emotion , 2009, The European journal of neuroscience.

[5]  David M. Howard,et al.  Acoustics and Psychoacoustics , 2006 .

[6]  R. Burkard Human Auditory Evoked Potentials , 2010 .

[7]  Gavin M. Bidelman,et al.  Neural Correlates of Consonance, Dissonance, and the Hierarchy of Musical Pitch in the Human Brainstem , 2009, The Journal of Neuroscience.

[8]  J. Grey Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[9]  Giles Wilkeson Gray Phonemic microtomy: The minimum duration of perceptible speech sounds , 1942 .

[10]  S. Schwerman,et al.  The Physics of Musical Instruments , 1991 .

[11]  N. Weinberger Associative representational plasticity in the auditory cortex: a synthesis of two disciplines. , 2007, Learning & memory.

[12]  Boaz Porat,et al.  A course in digital signal processing , 1996 .

[13]  Steven Greenberg,et al.  WPP, No. 52: Temporal Neural Coding of Pitch and Vowel Quality , 1980 .

[14]  James W. Hall Handbook of Auditory Evoked Responses , 1991 .

[15]  Ananthanarayan Krishnan,et al.  Human frequency-following responses: representation of steady-state synthetic vowels , 2002, Hearing Research.

[16]  L. Collet,et al.  The temporal relationship between speech auditory brainstem responses and the acoustic pattern of the phoneme /ba/ in normal-hearing adults , 2008, Clinical Neurophysiology.

[17]  C. Lam,et al.  Musician Enhancement for Speech-In-Noise , 2009, Ear and hearing.

[18]  Nina Kraus The dynamic brainstem: implications for APD , 2008 .

[19]  J. Hall Auditory brainstem frequency following responses to waveform envelope periodicity. , 1979, Science.

[20]  Erika Skoe,et al.  Experience‐induced Malleability in Neural Encoding of Pitch, Timbre, and Timing , 2009, Annals of the New York Academy of Sciences.

[21]  D R Moore,et al.  Anatomy and physiology of binaural hearing. , 1991, Audiology : official organ of the International Society of Audiology.

[22]  P. Hazemann,et al.  Handbook of Electroencephalography and Clinical Neurophysiology , 1975 .

[23]  D. Fabry,et al.  Detection and recognition of stop consonants by normal-hearing and hearing-impaired listeners. , 1992, Journal of speech and hearing research.

[24]  J. Hohnsbein,et al.  The human frequency-following response (FFR): Normal variability and relation to the click-evoked brainstem response , 1992, Hearing Research.

[25]  G C Galbraith,et al.  Brainstem frequency-following and behavioral responses during selective attention to pure tone and missing fundamental stimuli. , 1995, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[26]  Wendy J. Holmes,et al.  Speech Synthesis and Recognition , 1988 .

[27]  Roy D. Patterson,et al.  The stimulus duration required to identify vowels, their octave, and their pitch chroma , 1995 .

[28]  G Moushegian,et al.  Laboratory note. Scalp-recorded early responses in man to frequencies in the speech range. , 1973, Electroencephalography and clinical neurophysiology.

[29]  Nina Kraus,et al.  Atypical brainstem representation of onset and formant structure of speech sounds in children with language-based learning problems , 2004, Biological Psychology.

[30]  Nina Kraus,et al.  Deficits in auditory brainstem pathway encoding of speech sounds in children with learning problems , 2002, Neuroscience Letters.

[31]  R. Fay,et al.  Speech Processing in the Auditory System , 2010, Springer Handbook of Auditory Research.

[32]  Erika Skoe,et al.  Subcortical Laterality of Speech Encoding , 2008, Audiology and Neurotology.

[33]  L. Hood,et al.  Clinical Applications of the Auditory Brainstem Response , 1998 .

[34]  D L Jewett,et al.  Auditory-evoked far fields averaged from the scalp of humans. , 1971, Brain : a journal of neurology.

[35]  Nina Kraus,et al.  Brainstem transcription of speech is disrupted in children with autism spectrum disorders. , 2009, Developmental science.

[36]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[37]  S. Rosen Temporal information in speech: acoustic, auditory and linguistic aspects. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[38]  G. Moushegian,et al.  Frequency-following response: effects of interaural time and intensity differences. , 2000, Journal of the American Academy of Audiology.

[39]  F. Alton Everest,et al.  Master handbook of acoustics , 1981 .

[40]  N. Kraus,et al.  Stimulus Rate and Subcortical Auditory Processing of Speech , 2010, Audiology and Neurotology.

[41]  G. Galbraith,et al.  Selective attention affects human brain stem frequency-following response , 2003, Neuroreport.

[42]  Ian Maddieson,et al.  Patterns of sounds , 1986 .

[43]  Dennis H. Klatt,et al.  Software for a cascade/parallel formant synthesizer , 1980 .

[44]  G. Galbraith,et al.  Selective attention and brainstem frequency-following responses , 1993, Biological Psychology.

[45]  N. Kraus,et al.  On the Relationship between Speech- and Nonspeech-Evoked Auditory Brainstem Responses , 2006, Audiology and Neurotology.

[46]  G. Moushegian,et al.  Rate, frequency, and intensity effects on early auditory evoked potentials and binaural interaction component in humans. , 1993, Journal of the American Academy of Audiology.

[47]  S. Shamma,et al.  Physiological Representations of Speech , 2004 .

[48]  M. Sams,et al.  Musicians have enhanced subcortical auditory and audiovisual processing of speech and music , 2007, Proceedings of the National Academy of Sciences.

[49]  Erika Skoe,et al.  Brainstem encoding of voiced consonant–vowel stop syllables , 2008, Clinical Neurophysiology.

[50]  Nina Kraus,et al.  Correlation between brainstem and cortical auditory processes in normal and language-impaired children. , 2004, Brain : a journal of neurology.

[51]  Nina Kraus,et al.  Brainstem responses to speech syllables , 2004, Clinical Neurophysiology.

[52]  G C Galbraith,et al.  Brain stem frequency‐following response to dichotic vowels during attention , 1998, Neuroreport.

[53]  T W Picton,et al.  Human auditory evoked potentials. II. Effects of attention. , 1974, Electroencephalography and clinical neurophysiology.

[54]  N. Kraus,et al.  Subcortical differentiation of stop consonants relates to reading and speech-in-noise perception , 2009, Proceedings of the National Academy of Sciences.

[55]  J. Dubno,et al.  Effects of age and mild hearing loss on speech recognition in noise. , 1984, The Journal of the Acoustical Society of America.

[56]  Hilmi R. Dajani,et al.  Recording human evoked potentials that follow the pitch contour of a natural vowel , 2005, IEEE Transactions on Biomedical Engineering.

[57]  S. David,et al.  Auditory attention : focusing the searchlight on sound , 2007 .

[58]  P. Cariani,et al.  Encoding of pitch in the human brainstem is sensitive to language experience. , 2005, Brain research. Cognitive brain research.

[59]  J. Fermaglich Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[60]  D L Jewett,et al.  Human Auditory Evoked Potentials: Possible Brain Stem Components Detected on the Scalp , 1970, Science.

[61]  C. Schreiner,et al.  Periodicity coding in the inferior colliculus of the cat. I. Neuronal mechanisms. , 1988, Journal of neurophysiology.

[62]  N. Kraus,et al.  The scalp-recorded brainstem response to speech: neural origins and plasticity. , 2010, Psychophysiology.

[63]  Christian Vollaire,et al.  Speech auditory brainstem response (speech ABR) characteristics depending on recording conditions, and hearing status An experimental parametric study , 2008, Journal of Neuroscience Methods.

[64]  Steven Greenberg,et al.  Neural temporal coding of low pitch. I. Human frequency-following responses to complex tones , 1987, Hearing Research.

[65]  G C Galbraith,et al.  Intelligible speech encoded in the human brain stem frequency-following response. , 1995, Neuroreport.

[66]  N. Kraus,et al.  Musical Experience Limits the Degradative Effects of Background Noise on the Neural Processing of Sound , 2009, The Journal of Neuroscience.

[67]  J. Eggermont,et al.  Auditory Evoked Potentials: Basic Principles and Clinical Application , 2006 .

[68]  P. Boersma Praat : doing phonetics by computer (version 5.1.05) , 2009 .

[69]  Jayaganesh Swaminathan,et al.  Applications of Static and Dynamic Iterated Rippled Noise to Evaluate Pitch Encoding in the Human Auditory Brainstem , 2008, IEEE Transactions on Biomedical Engineering.

[70]  Jun Yan,et al.  Corticofugal Modulation of Initial Sound Processing in the Brain , 2008, The Journal of Neuroscience.

[71]  R. Patterson,et al.  The Duration Required to Identify the Instrument, the Octave, or the Pitch Chroma of a Musical Note , 1995 .

[72]  Nicole M. Russo,et al.  Musical experience shapes human brainstem encoding of linguistic pitch patterns , 2007, Nature Neuroscience.

[73]  Wim van Drongelen,et al.  Signal processing for Neuroscientists : introduction to the analysis of physiological signals , 2007 .

[74]  Gavin M. Bidelman,et al.  Cross-domain Effects of Music and Language Experience on the Representation of Pitch in the Human Auditory Brainstem , 2011, Journal of Cognitive Neuroscience.

[75]  Nina Kraus,et al.  Developmental Plasticity in the Human Auditory Brainstem , 2008, The Journal of Neuroscience.

[76]  P. Tallal,et al.  Speech acoustic-cue discrimination abilities of normally developing and language-impaired children. , 1981, The Journal of the Acoustical Society of America.

[77]  J. Swaminathan,et al.  Experience-dependent neural representation of dynamic pitch in the brainstem , 2009, Neuroreport.

[78]  A. Krishnan,et al.  The role of the auditory brainstem in processing linguistically-relevant pitch patterns , 2009, Brain and Language.

[79]  W James,et al.  New Handbook Of Auditory Evoked Responses >>>CLICK HERE<<< , 2007 .

[80]  Mounya Elhilali,et al.  Task Difficulty and Performance Induce Diverse Adaptive Patterns in Gain and Shape of Primary Auditory Cortical Receptive Fields , 2009, Neuron.

[81]  E. D. Boer,et al.  Low-Level frequency-Following responses , 1977 .

[82]  N. Kraus,et al.  Reading and subcortical auditory function. , 2009, Cerebral cortex.

[83]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[84]  A. Liberman,et al.  The role of consonant-vowel transitions in the perception of the stop and nasal consonants. , 1954 .

[85]  Mikko Sams,et al.  Seeing speech affects acoustic information processing in the human brainstem , 2005, Experimental Brain Research.

[86]  R Quian Quiroga,et al.  Wavelet Transform in the analysis of the frequency composition of evoked potentials. , 2001, Brain research. Brain research protocols.

[87]  Nina Kraus,et al.  Neural plasticity following auditory training in children with learning problems , 2003, Clinical Neurophysiology.

[88]  Y. Sininger,et al.  Auditory Brain Stem Response for Objective Measures of Hearing , 1993, Ear and hearing.

[89]  J E Hind,et al.  Time structure of discharges in single auditory nerve fibers of the squirrel monkey in response to complex periodic sounds. , 1969, Journal of neurophysiology.

[90]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[91]  Terence W. Picton,et al.  Envelope Following Responses to Natural Vowels , 2006, Audiology and Neurotology.

[92]  P. Deltenre,et al.  The Frequency-Following Response , 2012 .

[93]  Nina Kraus,et al.  Auditory training improves neural timing in the human brainstem , 2005, Behavioural Brain Research.

[94]  Nina Kraus,et al.  Auditory Brainstem Correlates of Perceptual Timing Deficits , 2007, Journal of Cognitive Neuroscience.

[95]  Bharath Chandrasekaran,et al.  Neuroplasticity in the processing of pitch dimensions: a multidimensional scaling analysis of the mismatch negativity. , 2007, Restorative neurology and neuroscience.

[96]  G C Galbraith,et al.  Two-channel brain-stem frequency-following responses to pure tone and missing fundamental stimuli. , 1994, Electroencephalography and clinical neurophysiology.

[97]  M. Daneman,et al.  How young and old adults listen to and remember speech in noise. , 1995, The Journal of the Acoustical Society of America.

[98]  N. Kraus,et al.  Context-Dependent Encoding in the Human Auditory Brainstem Relates to Hearing Speech in Noise: Implications for Developmental Dyslexia , 2009, Neuron.

[99]  R A Dobie,et al.  Binaural interaction in brainstem-evoked responses. , 1979, Archives of otolaryngology.

[100]  Terence W. Picton,et al.  Envelope and spectral frequency-following responses to vowel sounds , 2008, Hearing Research.

[101]  Michael Falkenstein,et al.  Effects of spatial attention on the brain stem frequency-following potential , 2004, Neuroreport.

[102]  Eric Moulines,et al.  Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones , 1989, Speech Commun..

[103]  Sensitive response to low-frequency cochlear distortion products in the auditory midbrain. , 2009, Journal of neurophysiology.

[104]  Yisheng Xu,et al.  Human frequency-following response: representation of pitch contours in Chinese tones , 2004, Hearing Research.

[105]  Asymmetric frequency-following responses. , 1994, Journal of the American Academy of Audiology.

[106]  Nina Kraus,et al.  Speaking clearly for children with learning disabilities: sentence perception in noise. , 2003, Journal of speech, language, and hearing research : JSLHR.

[107]  Mikko Sams,et al.  Auditory selective attention modulates activation of human inferior colliculus. , 2008, Journal of neurophysiology.

[108]  T W Picton,et al.  Auditory steady-state responses to multiple simultaneous stimuli. , 1994, Electroencephalography and clinical neurophysiology.

[109]  T. Carrell,et al.  Auditory Neurophysiologic Responses and Discrimination Deficits in Children with Learning Problems , 1996, Science.

[110]  J. Kane,et al.  Brainstem Frequency-Following Responses and Cortical Event-Related Potentials during Attention , 1993, Perceptual and motor skills.

[111]  Nina Kraus,et al.  Brainstem origins for cortical ‘what’ and ‘where’ pathways in the auditory system , 2005, Trends in Neurosciences.

[112]  N. Kraus,et al.  Brainstem Timing: Implications for Cortical Processing and Literacy , 2005, The Journal of Neuroscience.

[113]  N. Kraus,et al.  Learning to Encode Timing: Mechanisms of Plasticity in the Auditory Brainstem , 2009, Neuron.

[114]  Robert V Shannon Speech and music have different requirements for spectral resolution. , 2005, International review of neurobiology.

[115]  Yisheng Xu,et al.  Specificity of experience-dependent pitch representation in the brainstem , 2006, Neuroreport.

[116]  Mylien T. Duong,et al.  Brain stem evoked response to forward and reversed speech in humans , 2004, Neuroreport.

[117]  M. Sachs,et al.  Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers. , 1979, The Journal of the Acoustical Society of America.

[118]  D. Abrams,et al.  Sensory-based learning disability: Insights from brainstem processing of speech sounds , 2007, International journal of audiology.

[119]  Erika Skoe,et al.  Selective Subcortical Enhancement of Musical Intervals in Musicians , 2009, The Journal of Neuroscience.

[120]  Jayaganesh Swaminathan,et al.  Experience-dependent Enhancement of Linguistic Pitch Representation in the Brainstem Is Not Specific to a Speech Context , 2009, Journal of Cognitive Neuroscience.

[121]  N. Kraus,et al.  Auditory-Processing Malleability , 2007 .

[122]  A. Krishnan,et al.  Comparison of the acoustic and neural distortion product at 2f1-f2 in normal-hearing adults , 2008, International journal of audiology.

[123]  N. Kraus,et al.  Neurobiologic responses to speech in noise in children with learning problems: deficits and strategies for improvement , 2001, Clinical Neurophysiology.

[124]  A. Krishnan,et al.  Binaural Interaction in the Human Frequency-Following Response: Effects of Interaural Intensity Difference , 1998, Audiology and Neurotology.

[125]  N. Kraus,et al.  Exploring the relationship between physiological measures of cochlear and brainstem function , 2009, Clinical Neurophysiology.

[126]  Nicole M. Russo,et al.  Deficient brainstem encoding of pitch in children with Autism Spectrum Disorders , 2008, Clinical Neurophysiology.

[127]  Lei Gao,et al.  Auditory neuropathy. , 2015, Handbook of clinical neurology.

[128]  M. P. Regan,et al.  The transducer characteristic of hair cells in the human ear: a possible objective measure , 1988, Brain Research.

[129]  J. Ziegler,et al.  Speech-perception-in-noise deficits in dyslexia. , 2009, Developmental science.

[130]  N. Kraus,et al.  Relationships between behavior, brainstem and cortical encoding of seen and heard speech in musicians and non-musicians , 2008, Hearing Research.

[131]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[132]  Erika Skoe,et al.  Plasticity in the Adult Human Auditory Brainstem following Short-term Linguistic Training , 2008, Journal of Cognitive Neuroscience.

[133]  P.S. Addison,et al.  Time--frequency analysis of biosignals , 2009, IEEE Engineering in Medicine and Biology Magazine.

[134]  Evan Balaban,et al.  An Auditory Neural Correlate Suggests a Mechanism Underlying Holistic Pitch Perception , 2007, PloS one.

[135]  J. Eggermont,et al.  Variable effects of click polarity on auditory brain-stem response latencies: analyses of narrow-band ABRs suggest possible explanations. , 1996, The Journal of the Acoustical Society of America.