Audio-based robot control from interchannel level difference and absolute sound energy

This paper is a follow-up way to our previous works regarding audio-based control, that is an alternative method for auditory-based robot tasks. Conversely to classic methods oriented towards sound source localization, audio-based control is a sensor-based framework that does not localize the sound source. Instead, auditory features are used as inputs of a closed-loop control scheme. The audio-based control method presented in this paper relies on the sound signal energy measured by two microphones. By combining the interchannel level difference to the acoustic absolute energy level, the control scheme allows positioning the robot with respect to the sound source at a given distance and orientation. Moreover this method has the benefit of a low computation cost, since it only relies on the signal energy measurement. Experimental results conducted on a mobile robot validate the relevance and the robustness of this approach in dynamic and real world conditions.

[1]  Cao Zhi-gang Dual-Microphone Source Location Method in 2-D Space , 2008 .

[2]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[3]  François Chaumette,et al.  Sound-based control with two microphones , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Jean-Luc Zarader,et al.  Towards a systematic study of binaural cues , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Stanley T. Birchfield,et al.  Acoustic localization by interaural level difference , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[6]  Tobias Rodemann A study on distance estimation in binaural sound localization , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Ivan Markovic,et al.  Active speaker localization with circular likelihoods and bootstrap filtering , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[9]  José Santos-Victor,et al.  Sound Localization for Humanoid Robots - Building Audio-Motor Maps based on the HRTF , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Harald Viste,et al.  Binaural Source Localization by Joint Estimation of ILD and ITD , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[11]  Hiroaki Kitano,et al.  Active Audition for Humanoid , 2000, AAAI/IAAI.

[12]  Patrick Rives,et al.  Classification and realization of the different vision-based tasks , 1993 .

[13]  Gabriel Bustamante,et al.  Towards information-based feedback control for binaural active localization , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Dario Floreano,et al.  Audio-based localization for swarms of micro air vehicles , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Katsutoshi Itoyama,et al.  Noise correlation matrix estimation for improving sound source localization by multirotor UAV , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  François Chaumette,et al.  First applications of sound-based control on a mobile robot equipped with two microphones , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).