A Sensorimotor Approach to Sound Localization

Sound localization is known to be a complex phenomenon, combining multisensory information processing, experience-dependent plasticity, and movement. Here we present a sensorimotor model that addresses the question of how an organism could learn to localize sound sources without any a priori neural representation of its head-related transfer function or prior experience with auditory spatial information. We demonstrate quantitatively that the experience of the sensory consequences of its voluntary motor actions allows an organism to learn the spatial location of any sound source. Using examples from humans and echolocating bats, our model shows that a naive organism can learn the auditory space based solely on acoustic inputs and their relation to motor states.

[1]  A. A. Handzel,et al.  Biomimetic sound-source localization , 2002 .

[2]  D. Wolpert,et al.  The cerebellum is involved in predicting the sensory consequences of action , 1999, Neuroreport.

[3]  Eric D. Young,et al.  What's a cerebellar circuit doing in the auditory system? , 2004, Trends in Neurosciences.

[4]  R. Held,et al.  MOVEMENT-PRODUCED STIMULATION IN THE DEVELOPMENT OF VISUALLY GUIDED BEHAVIOR. , 1963, Journal of comparative and physiological psychology.

[5]  Poincaré’s Philosophy of Space , 1972 .

[6]  H. Versnel,et al.  Involvement of Monkey Inferior Colliculus in Spatial Hearing , 2004, The Journal of Neuroscience.

[7]  Jörg Lewald,et al.  Eye-position effects in directional hearing , 1997, Behavioural Brain Research.

[8]  I. Thompson,et al.  The influence of early experience on the development of sensory systems , 2004, Current Opinion in Neurobiology.

[9]  J.-M. Prieur,et al.  Accuracy of spatial localization depending on head posture in a perturbed gravitoinertial force field , 2005, Experimental Brain Research.

[10]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[11]  David I. Anderson,et al.  Travel Broadens the Mind. , 2000, Infancy : the official journal of the International Society on Infant Studies.

[12]  Anthony I. Tew,et al.  Analyzing head-related transfer function measurements using surface spherical harmonics , 1998 .

[13]  A J King,et al.  Altered spectral localization cues disrupt the development of the auditory space map in the superior colliculus of the ferret. , 1998, Journal of neurophysiology.

[14]  A. V. van Opstal,et al.  Relearning Sound Localization with a New Ear , 2005, The Journal of Neuroscience.

[15]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[16]  J. Kelly,et al.  Directional responses to sounds in young gerbils (Meriones unguiculatus). , 1986, Journal of comparative psychology.

[17]  张振跃,et al.  Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment , 2004 .

[18]  C. Moss,et al.  The bat head-related transfer function reveals binaural cues for sound localization in azimuth and elevation. , 2004, The Journal of the Acoustical Society of America.

[19]  J. Kevin O'Regan,et al.  Perception of the Structure of the Physical World Using Unknown Multimodal Sensors and Effectors , 2003, NIPS.

[20]  Eric I. Knudsen,et al.  Early auditory experience modifies sound localization in barn owls , 1982, Nature.

[21]  R. Held.  Shifts in binaural localization after prolonged exposures to atypical combinations of stimuli. , 1955, The American journal of psychology.

[22]  D. Sparks.  An argument for using ethologically "natural" behaviors as estimates of unobservable sensory processes. Focus on "Sound localization performance in the cat: the effect of restraining the head". , 2005, Journal of neurophysiology.

[23]  Daniel J Tollin,et al.  Sound-localization performance in the cat: the effect of restraining the head. , 2005, Journal of neurophysiology.

[24]  E D Young,et al.  Proprioceptive Information from the Pinna Provides Somatosensory Input to Cat Dorsal Cochlear Nucleus , 2001, The Journal of Neuroscience.

[25]  R. K. Clifton.  The development of spatial hearing in human infants. , 1992 .

[26]  D R Moore,et al.  A developmental study of the sound pressure transformation by the head of the cat. , 1979, Acta oto-laryngologica.

[27]  Hongyuan Zha,et al.  Spectral analysis of alignment in manifold learning , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[28]  D. Fitzpatrick,et al.  The contribution of sensory experience to the maturation of orientation selectivity in ferret visual cortex , 2001, Nature.

[29]  Andrew J. King,et al.  Visual influences on auditory spatial learning , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[30]  E. Saff,et al.  Distributing many points on a sphere , 1997 .

[31]  W. Ehrenstein,et al.  Influence of head-to-trunk position on sound lateralization , 1998, Experimental Brain Research.

[32]  J R Lackner,et al.  Gravitoinertial force magnitude and direction influence head-centric auditory localization. , 2001, Journal of neurophysiology.

[33]  P. Bach-y-Rita.  Tactile Sensory Substitution Studies , 2004, Annals of the New York Academy of Sciences.

[34]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[35]  D. Griffin,et al.  Listening in the Dark , 1959 .

[36]  Paul M. Hofman,et al.  Relearning sound localization with new ears , 1998, Nature Neuroscience.

[37]  Stephan Getzmann,et al.  The effect of eye position and background noise on vertical sound localization , 2002, Hearing Research.

[38]  Joyce Vliegen,et al.  Dynamic Sound Localization during Rapid Eye-Head Gaze Shifts , 2004, The Journal of Neuroscience.

[39]  K. E. Binns,et al.  The Maturation of the Superior Collicular Map of Auditory Space in the Guinea Pig is Disrupted by Developmental Visual Deprivation , 1990, The European journal of neuroscience.

[40]  Eric I Knudsen,et al.  Hunting Increases Adaptive Auditory Map Plasticity in Adult Barn Owls , 2005, The Journal of Neuroscience.

[41]  B. May,et al.  Spectral cues for sound localization in cats: a model for discharge rate representations in the auditory nerve. , 1997, The Journal of the Acoustical Society of America.

[42]  Fernando R Nodal,et al.  Training-Induced Plasticity of Auditory Localization in Adult Mammals , 2006, PLoS biology.

[43]  J M Loomis,et al.  Active localization of virtual sounds. , 1990, The Journal of the Acoustical Society of America.

[44]  J. Cruysberg,et al.  Two-dimensional sound-localization behavior of early-blind humans , 2001, Experimental Brain Research.

[45]  D. Schwarz,et al.  Plasticity in human directional hearing. , 1995, The Journal of otolaryngology.

[46]  M. Kawato,et al.  Modular organization of internal models of tools in the human cerebellum , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[47]  R. Held,et al.  Development and segmentation of visually controlled movement by selective exposure during rearing. , 1970, Journal of comparative and physiological psychology.

[48]  E. Knudsen,et al.  Vision calibrates sound localization in developing barn owls , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  J Lewald,et al.  Vestibular influence on human auditory space perception. , 2000, Journal of neurophysiology.

[50]  H. Poincaré.  The Value of Science: Essential Writings of Henri Poincare , 2001 .

[51]  Jörg Lewald,et al.  Vertical sound localization in blind humans , 2002, Neuropsychologia.

[52]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[53]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[54]  H. Colburn,et al.  Models of Sound Localization , 2005 .

[55]  D H Ashmead,et al.  Spatial Hearing in Children with Visual Disabilities , 1998, Perception.

[56]  S. Inati,et al.  Eye Position Influences Auditory Responses in Primate Inferior Colliculus , 2001, Neuron.

[57]  A J King,et al.  Plasticity in the neural coding of auditory space in the mammalian brain. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[58]  K. E. Binns,et al.  The Maturation of the Superior Collicular Map of Auditory Space in the Guinea Pig is Disrupted by Developmental Auditory Deprivation , 1990, The European journal of neuroscience.

[59]  Bruno Gas,et al.  Extracting space dimension information from the auditory modality sensori-motor flow using a bio-inspired model of the cochlea , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[60]  E. B. Newman,et al.  The localization of actual sources of sound. , 1936 .

[61]  Mark Wexler,et al.  Depth perception by the active observer , 2005, Trends in Cognitive Sciences.

[62]  H H Goossens,et al.  Influence of head position on the spatial representation of acoustic targets. , 1999, Journal of neurophysiology.

[63]  Edward F Chang,et al.  Environmental Noise Retards Auditory Cortical Development , 2003, Science.

[64]  M. Wexler,et al.  Voluntary Head Movement and Allocentric Perception of Space , 2003, Psychological science.

[65]  Giorgio Metta,et al.  BabyRoBot: A study in sensori-motor development , 1999 .

[66]  Richard Held,et al.  Growth in head size during infancy: Implications for sound localization. , 1988 .

[67]  T. G. R. Bower,et al.  The Rational Infant: Learning In Infancy , 1989 .

[68]  Lincoln Gray,et al.  Binaural processing after corrected congenital unilateral conductive hearing loss , 1994, Hearing Research.

[69]  E I Knudsen,et al.  Vision guides the adjustment of auditory localization in young barn owls. , 1985, Science.

[70]  M. P. Zwiers,et al.  A Spatial Hearing Deficit in Early-Blind Humans , 2001, The Journal of Neuroscience.

[71]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[72]  Proprioceptive effects on evoked responses to sounds in the cat auditory cortex , 1976, Experimental Brain Research.

[73]  R K Clifton,et al.  The development of a human auditory localization response: a U-shaped function. , 1989, Canadian journal of psychology.

[74]  M. Kawato,et al.  Internal forward models in the cerebellum: fMRI study on grip force and load force coupling. , 2003, Progress in brain research.

[75]  Andrew J. King,et al.  How Plastic Is Spatial Hearing? , 2001, Audiology and Neurotology.

[76]  E. Young,et al.  Pinna-based spectral cues for sound localization in cat , 1992, Hearing Research.

[77]  Kilian Q. Weinberger,et al.  Spectral Methods for Dimensionality Reduction , 2006, Semi-Supervised Learning.

[78]  David L. Sparks,et al.  Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[79]  E D Young,et al.  Effects of pinna position on head-related transfer functions in the cat. , 1996, The Journal of the Acoustical Society of America.

[80]  Jörg Lewald,et al.  Sound localization with eccentric head position , 2000, Behavioural Brain Research.

[81]  D. Muir,et al.  The U-Shaped Developmental Function for Auditory Localization , 2004 .

[82]  Lawrence K. Saul,et al.  Analysis and extension of spectral methods for nonlinear dimensionality reduction , 2005, ICML.