Three-dimensional acoustic localisation via directed movements of a two-dimensional model of the lizard peripheral auditory system

Three-dimensional acoustic localisation is relevant in personal and social robot platforms. Conventional approaches extract interaural time difference cues via impractically large stationary two-dimensional multi-microphone grids with at least four microphones or spectral cues via head-related transfer functions of stationary KEMAR dummy heads equipped with two microphones. We present a preliminary approach using two sound sensors, whose directed movements resolve the location of a stationary acoustic target in three dimensions. A model of the peripheral auditory system of lizards provides sound direction information in a single plane which by itself is insufficient to localise the acoustic target in three dimensions. Two spatial orientations of this plane by rotating the sound sensors by −45° and +45° along the sagittal axis generate a pair of measurements, each encoding the location of the acoustic target with respect to one plane of rotation. A multi-layer perceptron neural network is trained via supervised learning to translate the combination of the two measurements into an estimate of the relative location of the acoustic target in terms of its azimuth and elevation. The acoustic localisation performance of the system is evaluated in simulation for noiseless as well as noisy sinusoidal auditory signals with a 20 dB signal-to-noise ratio for four different sound frequencies of 1450 Hz, 1650 Hz, 1850 Hz and 2050 Hz that span the response frequency range of the peripheral auditory model. Three different neural networks with respectively one hidden layer with ten neurons, one hidden layer with twenty neurons and two hidden layers with ten neurons are comparatively evaluated. The neural networks are evaluated for varying locations of the acoustic target on the surface of the frontal spherical section in space defined by an azimuth and elevation range of [−90°, +90°] with a resolution of 1° in both planes.

[1]  Hong Liu,et al.  Sound Source Localization for HRI Using FOC-Based Time Difference Feature and Spatial Grid Matching , 2013, IEEE Transactions on Cybernetics.

[2]  Muhammad Imran,et al.  A methodology for sound source localization and tracking: Development of 3D microphone array for near-field and far-field applications , 2016, 2016 13th International Bhurban Conference on Applied Sciences and Technology (IBCAST).

[3]  Jie Huang,et al.  Robotic spatial sound localization and its 3D sound human interface , 2002, First International Symposium on Cyber Worlds, 2002. Proceedings..

[4]  Shengkui Zhao,et al.  A real-time 3D sound localization system with miniature microphone array for virtual reality , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[5]  Gregory H. Wakefield,et al.  Introduction to Head-Related Transfer Functions (HRTFs): Representations of HRTFs in Time, Frequency, and Space , 2001 .

[6]  Fakheredine Keyrouz Humanoid hearing: A novel three-dimensional approach , 2011, 2011 IEEE International Symposium on Robotic and Sensors Environments (ROSE).

[7]  Wen-Chih Wu,et al.  Hearing aid system with 3D sound localization , 2007, TENCON 2007 - 2007 IEEE Region 10 Conference.

[8]  Klaus Diepold,et al.  A novel biologically inspired neural network solution for robotic 3D sound source sensing , 2008, Soft Comput..

[9]  Rajesh M. Hegde,et al.  Binaural source localization using a HRTF data model with enhanced frequency diversity , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[10]  Stephen E. Levinson,et al.  A Bayes-rule based hierarchical system for binaural sound source localization , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[11]  Thushara D. Abhayapala,et al.  Novel head related transfer function model for sound source localisation , 2010, 2010 4th International Conference on Signal Processing and Communication Systems.

[12]  N. Fletcher,et al.  Physical models for the analysis of acoustical systems in biology. , 1979, Quarterly reviews of biophysics.

[13]  Jong-suk Choi,et al.  Real-Time Binaural Sound Source Localization Using Sparse Coding and SOM , 2010, ICIRA.

[14]  Hiroaki Kitano,et al.  Active Audition for Humanoid , 2000, AAAI/IAAI.

[15]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[16]  B. Kwon,et al.  Sound source localization for robot auditory system using the summed GCC method , 2008, 2008 International Conference on Control, Automation and Systems.

[17]  A P Lisiewski,et al.  Fly-ear inspired micro-sensor for sound source localization in two dimensions. , 2011, The Journal of the Acoustical Society of America.

[18]  Stefania Serafin,et al.  A comparison between measured and modelled head-related transfer functions for an enhancement of real-time 3D audio processing for virtual reality environments , 2017, 2017 IEEE 3rd VR Workshop on Sonic Interactions for Virtual Environments (SIVE).

[19]  William Fitzpatrick,et al.  3D sound imaging with head tracking , 2013, 2013 IEEE Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[20]  Ali Pourmohammad,et al.  TDE-ILD-HRTF-Based 3D entire-space sound source localization using only three microphones and source counting , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[21]  Fakheredine Keyrouz,et al.  Advanced Binaural Sound Localization in 3-D for Humanoid Robots , 2014, IEEE Transactions on Instrumentation and Measurement.

[22]  Michael S. Brandstein,et al.  Microphone Arrays - Signal Processing Techniques and Applications , 2001, Microphone Arrays.

[23]  Klaus Diepold,et al.  High performance 3D sound localization for surveillance applications , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[24]  Eugeniusz Kornatowski Localization of Sound Source Direction in Real Time , 2010, MISSI.

[25]  Hiroaki Kitano,et al.  Human–robot non-verbal interaction empowered by real-time auditory and visual multiple-talker tracking , 2003, Adv. Robotics.

[26]  Hong Wang,et al.  Voice source localization for automatic camera pointing system in videoconferencing , 1997, Proceedings of 1997 Workshop on Applications of Signal Processing to Audio and Acoustics.

[27]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[28]  Hiroshi Mizoguchi,et al.  Three ring microphone array for 3D sound localization and separation for mobile robot audition , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Jonathan Z. Simon,et al.  A Sensorimotor Approach to Sound Localization , 2008, Neural Computation.

[30]  Hong Liu,et al.  Sound source localization for mobile robot based on time difference feature and space grid matching , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  N. Fletcher,et al.  Acoustic systems in biology , 1992 .

[32]  G. Manley,et al.  Directionality of the lizard ear , 2005, Journal of Experimental Biology.