Probabilistic 3-D Mapping of Sound-Emitting Structures Based on Acoustic Ray Casting

This paper presents a two-step framework for creating the three-dimensional (3-D) sound map of an environment with a mobile robot. The first step is the creation of a map that describes the geometry of the environment. The second step is the addition of the acoustic information to the geometric map. The result is a sound map that shows the probability of emitting sound for all the structures in the environment. To build the sound map, a mobile robot equipped with a microphone array drives through the mapped environment. During this drive, the acoustic information gathered by the microphone array is accumulated in a probabilistic manner. First, the likelihood of sound source presence in a set of directions is evaluated from the acoustic power received from these directions. Then, using an estimate of the robot's pose, an acoustic ray casting procedure transfers this likelihood to the structures in the geometric map. Finally, the probability that these structures emit sound is updated accordingly to the likelihood. Experimental results show that the sound maps are: accurate as it was possible to localize sound sources in 3-D and practical as different types of environments were mapped.

[1]  A. Nuchter,et al.  Mapping of rescue environments with Kurt3D , 2005, IEEE International Safety, Security and Rescue Rototics, Workshop, 2005..

[2]  J. D. Maynard,et al.  Nearfield acoustic holography: I. Theory of generalized holography and the development of NAH , 1985 .

[3]  Kiyohiro Shikano,et al.  An improved permutation solver for blind signal separation based front-ends in robot audition , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Philippe Souères,et al.  A survey on sound source localization in robotics: From binaural to array processing methods , 2015, Comput. Speech Lang..

[5]  Christoph Studer,et al.  FPGA-based real-time acoustic camera prototype , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[6]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[7]  Michael Bosse,et al.  3D thermal mapping of building interiors using an RGB-D and thermal camera , 2013, 2013 IEEE International Conference on Robotics and Automation.

[8]  Tetsuya Ogata,et al.  Exploiting known sound source signals to improve ICA-based robot audition in speech separation and recognition , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[10]  Joachim Hertzberg,et al.  Evaluation of 3D registration reliability and speed - A comparison of ICP and NDT , 2009, 2009 IEEE International Conference on Robotics and Automation.

[11]  Dae Seung Cho,et al.  Noise mapping using measured noise and GPS data , 2007 .

[12]  Joachim Hertzberg,et al.  3D mapping the Kvarntorp mine : a rield experiment for evaluation of 3D scan matching algorithms , 2008 .

[13]  Norihiro Hagita,et al.  Probabilistic approach for building auditory maps with a mobile microphone array , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Silvia Coradeschi,et al.  Gas distribution mapping of multiple odour sources using a mobile robot , 2009, Robotica.

[15]  François Michaud,et al.  Evaluating real-time audio localization algorithms for artificial audition in robotics , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[17]  Patrick Danès,et al.  Broadband variations of the MUSIC high-resolution method for Sound Source Localization in Robotics , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Ronald C. Arkin,et al.  Noise maps for acoustically sensitive navigation , 2004, SPIE Optics East.

[19]  Michael S. Brandstein,et al.  Microphone Arrays - Signal Processing Techniques and Applications , 2001, Microphone Arrays.

[20]  Gerd K. Heinz,et al.  Acoustic photo- and cinematography based on interference transformation , 1999 .

[21]  Michael S. Brandstein,et al.  A robust method for speech signal time-delay estimation in reverberant rooms , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[22]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[23]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[24]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[25]  Julian D. Maynard,et al.  Nearfield acoustic holography (NAH) II. Holographic reconstruction algorithms and computer implementation , 1987 .

[26]  Wolfram Burgard,et al.  On the position accuracy of mobile robot localization based on particle filters combined with scan matching , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Wolfram Burgard,et al.  Semantic labeling of places using information extracted from laser and vision sensor data , 2006 .

[28]  P. Danielsson Euclidean distance mapping , 1980 .

[29]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[30]  Norihiro Hagita,et al.  Mapping sound emitting structures in 3D , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[31]  D Gabor,et al.  World modeling. , 1972, Science.

[32]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[33]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[34]  Satoshi Kagami,et al.  Spherical microphone array for spatial sound localization for a mobile robot , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Vinny Cahill,et al.  Environmental Noise Mapping Using Measurements in Transit , 2010 .

[36]  Christian Laugier,et al.  Update Policy of Dense Maps: Efficient Algorithms and Sparse Representation , 2007, FSR.

[37]  Joachim Hertzberg,et al.  Three-dimensional mapping with time-of-flight cameras , 2009 .

[38]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[40]  Jean Rouat,et al.  Robust localization and tracking of simultaneous moving sound sources using beamforming and particle filtering , 2007, Robotics Auton. Syst..

[41]  Eric Martinson,et al.  Auditory Perspective Taking , 2006, IEEE Transactions on Cybernetics.

[42]  Darren B. Ward,et al.  Particle filtering algorithms for tracking an acoustic source in a reverberant environment , 2003, IEEE Trans. Speech Audio Process..

[43]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[44]  Donald Meagher,et al.  Geometric modeling using octree encoding , 1982, Comput. Graph. Image Process..

[45]  Stefan May,et al.  3D Mapping with Time-of-Flight Cameras , 2009 .

[46]  Simon J. Godsill,et al.  Acoustic Source Localization and Tracking of a Time-Varying Number of Speakers , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[47]  Wolfram Burgard,et al.  Real-time 3D visual SLAM with a hand-held camera , 2011 .

[48]  Eric Martinson,et al.  Robotic Discovery of the Auditory Scene , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[49]  Andreas Nüchter,et al.  Robust 3D-mapping with time-of-flight cameras , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[50]  Eric Martinson,et al.  Auditory Evidence Grids , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Joachim Hertzberg,et al.  The Efficient Extension of Globally Consistent Scan Matching to 6 DoF , 2008 .

[52]  Satoshi Kagami,et al.  Map-generation and identification of multiple sound sources from robot in motion , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.