Combining Sound Localization and Laser-based Object Recognition

Mobile robots, in general, and service robots in human environments, in particular, need to have versatile abilities to perceive and interact with their environment. Biologically inspired sound source localization is an interesting ability for such a robot. When combined with other sensory input both the sound localization and the general interaction abilities can be improved. In particular, spatial filtering can be used to improve the signal-to-noise ratio of speech signals emanating from a given direction in order to enhance speech recognition abilities. In this paper we investigate and discuss the combination of sound source localization and laser-based object recognition on a mobile robot.

[1]  Terry T. Takahashi,et al.  Prediction of auditory spatial acuity from neural images on the owl's auditory space map , 2003, Nature.

[2]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[3]  M. Konishi,et al.  Axonal delay lines for time measurement in the owl's brainstem. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[4]  L A JEFFRESS,et al.  A place theory of sound localization. , 1948, Journal of comparative and physiological psychology.

[5]  David McAlpine,et al.  Sound localization and delay lines – do mammals fit the model? , 2003, Trends in Neurosciences.

[6]  Alexander Ferrein,et al.  Laser-Based Localization with Sparse Landmarks , 2005, RoboCup.

[7]  M. Konishi,et al.  Neural map of interaural phase difference in the owl's brainstem. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[9]  G. Blasdel,et al.  Sound localization by the barn owl (Tyto alba) measured with the search coil technique , 1979, Journal of comparative physiology.

[10]  E. Rubel,et al.  Organization and development of brain stem auditory nuclei of the chicken: Organization of projections from N. magnocellularis to N. laminaris , 1975, The Journal of comparative neurology.

[11]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[12]  Wolfram Burgard,et al.  Position Estimation for Mobile Robots in Dynamic Environments , 1998, AAAI/IAAI.

[13]  Gerhard Lakemeyer,et al.  Azimuthal sound localization using coincidence of timing across frequency on a robotic platform. , 2007, The Journal of the Acoustical Society of America.

[14]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[15]  M. Konishi,et al.  A circuit for detection of interaural time differences in the brain stem of the barn owl , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  B C Wheeler,et al.  Localization of multiple sound sources with two microphones. , 2000, The Journal of the Acoustical Society of America.