Sensorimotor learning of sound localization from an auditory evoked behavior

A new method for self-supervised sensorimotor learning of sound source localization is presented, that allows a simulated listener to learn online an auditorimotor map from the sensorimotor experience provided by an auditory evoked behavior. The map represents the auditory space and is used to estimate the azimuthal direction of sound sources. The learning mainly consists in non-linear dimensionality reduction of sensorimotor data. Our results show that an auditorimotor map can be learned, both from real and simulated data, and that the online learning leads to accurate estimations of azimuthal sources direction.

[1]  Gordon Wyeth,et al.  Active audition using the parameter-less self-organising map , 2008, Auton. Robots.

[2]  Barbara Webb,et al.  Robot phonotaxis in the wild: a biologically inspired approach to outdoor sound localization , 2004, Adv. Robotics.

[3]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[4]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[5]  Jean-Arcady Meyer,et al.  Phonotaxis behavior in the artificial rat Psikharpax , 2010 .

[6]  MAURICE CROSLAND,et al.  Foundations of Science , 1970, Nature.

[7]  R. Patterson,et al.  B OF THE SVOS FINAL REPORT ( Part A : The Auditory Filterbank ) AN EFFICIENT AUDITORY FIL TERBANK BASED ON THE GAMMATONE FUNCTION , 2010 .

[8]  D. Shepard.  A two-dimensional interpolation function for irregularly-spaced data , 1968, ACM National Conference.

[9]  R K Clifton,et al.  The development of a human auditory localization response: a U-shaped function. , 1989, Canadian journal of psychology.

[10]  Jonathan Z. Simon,et al.  A Sensorimotor Approach to Sound Localization , 2008, Neural Computation.

[11]  Nicolas Le Roux,et al.  Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering , 2003, NIPS.

[12]  P. S. Krishnaprasad,et al.  Robot phonotaxis with dynamic sound-source localization , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[13]  Bill Gardner,et al.  HRTF Measurements of a KEMAR Dummy-Head Microphone , 1994 .

[14]  José Santos-Victor,et al.  Sound Localization for Humanoid Robots - Building Audio-Motor Maps based on the HRTF , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Martin Cooke,et al.  Motion strategies for binaural localisation of speech sources in azimuth and distance by artificial listeners , 2011, Speech Commun..

[16]  R. Kearsley,et al.  The newborn's response to auditory stimulation: a demonstration of orienting and defensive behavior. , 1973, Child development.

[17]  Gerald M. Edelman,et al.  Adaptation of orienting behavior: from the barn owl to a robotic system , 1999, IEEE Trans. Robotics Autom..

[18]  Radu Horaud,et al.  Learning the Direction of a Sound Source Using Head Motions and Spectral Features , 2011 .

[19]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[20]  Laurent Kneip,et al.  Binaural model for artificial spatial sound localization based on interaural time delays and movements of the interaural axis. , 2008, The Journal of the Acoustical Society of America.

[21]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[22]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[23]  Bruno Gas,et al.  Extracting space dimension information from the auditory modality sensori-motor flow using a bio-inspired model of the cochlea , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  F. E. Grubbs.  Procedures for Detecting Outlying Observations in Samples , 1969 .

[25]  Giulio Sandini,et al.  Development of auditory-evoked reflexes: Visuo-acoustic cues integration in a binocular head , 2002, Robotics Auton. Syst..

[26]  Eduardo Castillo Castañeda,et al.  Space dimension perception from the multimodal sensorimotor flow of a naive robotic agent , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Brian R Glasberg,et al.  Derivation of auditory filter shapes from notched-noise data , 1990, Hearing Research.