Sound-based control with two microphones

This paper presents a novel approach to robot audition by performing robotic tasks with auditory cues. Unlike many previous works, we propose a control scheme, that does not require any explicit sound source localization. This approach is capable of controlling all the three degrees of freedom in a plane from two microphones. Built upon the sensor-based control framework, this approach relies on implicit sound source direction obtained from the time difference of arrival (TDOA). We introduce an analytical modelling of auditory cues considering a robot equipped with a pair of microphones and multiple sound sources, from which a control scheme is designed. A stability analysis is provided as well. The results obtained in simulation show the feasibility and the suitability of this method even in reverberant area.

[1]  Patrick Rives,et al.  Singularities in the determination of the situation of a robot effector from the perspective view of 3 points , 1993 .

[2]  Patrick Rives,et al.  Classification and realization of the different vision-based tasks , 1993 .

[3]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[4]  Klaus Diepold,et al.  A New Method for Binaural 3-D Localization Based on Hrtfs , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[5]  Roland Siegwart,et al.  A bearing-only 2D/3D-homing method under a visual servoing framework , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  José Santos-Victor,et al.  Sound Localization for Humanoid Robots - Building Audio-Motor Maps based on the HRTF , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Jean Rouat,et al.  Robust sound source localization using a microphone array on a mobile robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[8]  Emmanuel Vincent,et al.  Multi-source TDOA estimation in reverberant audio using angular spectra and clustering , 2012, Signal Process..

[9]  Philippe Bonnifait,et al.  Design and experimental validation of an odometric and goniometric localization system for outdoor robot vehicles , 1998, IEEE Trans. Robotics Autom..

[10]  Peter I. Corke.  Mobile Robot Navigation As A Planar Visual Servoing Problem , 2001, ISRR.

[11]  Jean Rouat,et al.  Robust localization and tracking of simultaneous moving sound sources using beamforming and particle filtering , 2007, Robotics Auton. Syst..

[12]  Patrick Rives,et al.  Robustness of Image-Based Visual Servoing With a Calibrated Camera in the Presence of Uncertainties in the Three-Dimensional Structure , 2010, IEEE Transactions on Robotics.

[13]  Alban Portello,et al.  Active binaural localization of intermittent moving sources in the presence of false measurements , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  K. Kawamura,et al.  Music Playing Robot , 1999 .

[15]  Makoto Kumon,et al.  Adaptive audio servo for multirate robot systems , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[17]  S. Wermter,et al.  Robotic Sound-Source Localization and Tracking Using Interaural Time Difference and Cross-Correlation , 2004 .

[18]  Jie Huang,et al.  A model-based sound localization system and its application to robot navigation , 1999, Robotics Auton. Syst..