A Spiking Neural Network Approach to Auditory Source Lateralisation

A novel approach to multi-microphone acoustic source localisation based on spiking neural networks is presented. We demonstrate that a two microphone system connected to a spiking neural network can be used to localise acoustic sources based purely on inter microphone timing differences, with no need for manually configured delay lines. A two sensor example is provided which includes 1) a front end which converts the acoustic signal to a series of spikes, 2) a hidden layer of spiking neurons, 3) an output layer of spiking neurons which represents the location of the acoustic source. We present details on training the network, and evaluation of its performance in quiet and noisy conditions. The system is trained on two locations, and we show that the lateralisation accuracy is 100% when presented with previously unseen data in quiet conditions. We also demonstrate the network generalises to modulation rates and background noise on which it was not trained.

[1]  B. Grothe,et al.  Mechanisms of sound localization in mammals. , 2010, Physiological reviews.

[2]  Romain Brette,et al.  Learning to localise sounds with spiking neural networks , 2010, NIPS.

[3]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[4]  Julie Wall,et al.  A spiking neural network implementation of sound localisation , 2007 .

[5]  André van Schaik,et al.  AER EAR: A Matched Silicon Cochlea Pair With Address Event Representation Interface , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[6]  David McAlpine,et al.  Sound localization and delay lines – do mammals fit the model? , 2003, Trends in Neurosciences.

[7]  Julie A. Wall,et al.  Spiking Neural Network Model of Sound Localization Using the Interaural Intensity Difference , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Laurel H Carney,et al.  Updated parameters and expanded simulation options for a model of the auditory periphery. , 2014, The Journal of the Acoustical Society of America.

[9]  Surya Ganguli,et al.  SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks , 2017, Neural Computation.

[10]  L A JEFFRESS,et al.  A place theory of sound localization. , 1948, Journal of comparative and physiological psychology.

[11]  Jan Wouters,et al.  Assessing temporal modulation sensitivity using electrically evoked auditory steady state responses , 2015, Hearing Research.

[12]  Patrick Marmaroli,et al.  Implementation of a binaural localization algorithm in hearing aids: Specifications and achievable solutions , 2014 .

[13]  Werner Hemmert,et al.  Modeling auditory coding: from sound to spikes , 2015, Cell and Tissue Research.