Robust Acoustic Self-Localization of Mobile Devices

Self-localization of smart portable devices serves as foundation for several novel applications. This work proposes a set of algorithms that enable a mobile device to passively determine its position relative to a known reference with centimeter precision, based exclusively on the capture of acoustic signals emitted by controlled sources around it. The proposed techniques tackle typical practical issues such as reverberation, unknown speed of sound, line-of-sight obstruction, clock skew, and the need for asynchronous operation. After their theoretical developments and off-line simulations, the methods are assessed as real-time applications embedded into off-the-shelf mobile devices operating in real scenarios. When line of sight is available, position estimation errors are at most 4 cm using recorded signals.

[1]  Emanuel A. P. Habets,et al.  Multiple-Hypothesis Extended Particle Filter for Acoustic Source Localization in Reverberant Environments , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Lei Zhang,et al.  On cross correlation based-discrete time delay estimation , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[3]  Peter Stoica,et al.  Source localization from range-difference measurements , 2006 .

[4]  Guobin Shen,et al.  BeepBeep: A high-accuracy acoustic-based system for ranging and localization using COTS devices , 2012, TECS.

[5]  Diego B. Haddad,et al.  Closed-form solutions for robust acoustic sensor localization , 2013, 2013 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[6]  Xiao-Ping Zhang,et al.  Novel closed-form auxiliary variables based algorithms for sensor node localization using AOA , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  M. Schroeder.  New Method of Measuring Reverberation Time , 1965 .

[8]  Gernot A. Fink,et al.  Towards acoustic self-localization of ad hoc smartphone arrays , 2011, 2011 Joint Workshop on Hands-free Speech Communication and Microphone Arrays.

[9]  T. Ajdler,et al.  Acoustic source localization in distributed sensor networks , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[10]  S. W. Chen,et al.  Virtual Reference Device-Based NLOS Localization in Multipath Environment , 2014, IEEE Antennas and Wireless Propagation Letters.

[11]  Ramani Duraiswami,et al.  Automatic position calibration of multiple microphones , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Augusto Sarti,et al.  Acoustic Source Localization With Distributed Asynchronous Microphone Networks , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[13]  R.L. Moses,et al.  Locating the nodes: cooperative localization in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[14]  T. Moon,et al.  Mathematical Methods and Algorithms for Signal Processing , 1999 .

[15]  David Chu,et al.  SwordFight: enabling a new class of phone-to-phone action games on commodity phones , 2012, MobiSys '12.

[16]  Shigeki Sagayama,et al.  Blind Estimation of Locations and Time Offsets for Distributed Recording Devices , 2010, LVA/ICA.

[17]  Stanley T. Birchfield,et al.  Microphone array position calibration by basis-point classical multidimensional scaling , 2005, IEEE Transactions on Speech and Audio Processing.

[18]  Soon Yim Tan,et al.  Non-Line-of-Sight Localization in Multipath Environments , 2008, IEEE Transactions on Mobile Computing.

[19]  Özgür B. Akan,et al.  A three dimensional localization algorithm for underwater acoustic sensor networks , 2009, IEEE Transactions on Wireless Communications.

[20]  Jian Li,et al.  Exact and Approximate Solutions of Source Localization Problems , 2008, IEEE Transactions on Signal Processing.

[21]  Agathoniki Trigoni,et al.  Robust localization in cluttered environments with NLOS propagation , 2010, The 7th IEEE International Conference on Mobile Ad-hoc and Sensor Systems (IEEE MASS 2010).

[22]  Jian Li,et al.  Lecture Notes - Source Localization from Range-Difference Measurements , 2006, IEEE Signal Processing Magazine.

[23]  Álvaro Fialho,et al.  Audio beacon providing location-aware content for low-end mobile devices , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[24]  Christian Schindelhauer,et al.  Acoustic Self-calibrating System for Indoor Smartphone Tracking (ASSIST) , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[25]  Matti S. Hämäläinen,et al.  Passive self-localization of microphones using ambient sounds , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[26]  Mohan M. Trivedi,et al.  Source localization in reverberant environments: modeling and statistical analysis , 2003, IEEE Trans. Speech Audio Process..

[27]  Gerald Friedland,et al.  Multimodal Indoor Localization: An Audio-Wireless-Based Approach , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.

[28]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[29]  G. Carter,et al.  The generalized correlation method for estimation of time delay , 1976 .

[30]  Prasant Misra,et al.  TWEET: an envelope detection based broadband ultrasonic ranging system , 2011, MSWiM '11.

[31]  Xiaolin Li,et al.  Towards accurate acoustic localization on a smartphone , 2013, 2013 Proceedings IEEE INFOCOM.

[32]  Guobin Shen,et al.  BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices , 2007, SenSys '07.

[33]  A. Haghighat,et al.  Beep: 3D indoor positioning using audible sound , 2005, Second IEEE Consumer Communications and Networking Conference, 2005. CCNC. 2005.

[34]  Radu Horaud,et al.  A Geometric Approach to Sound Source Localization from Time-Delay Estimates , 2013, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[35]  Rainer Lienhart,et al.  Position calibration of microphones and loudspeakers in distributed computing platforms , 2005, IEEE Transactions on Speech and Audio Processing.

[36]  Ivan Himawan,et al.  Microphone Array Shape Calibration in Diffuse Noise Fields , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[37]  Bin Yang,et al.  Joint consistent graph synthesis and speed of sound estimation for acoustic localization in multi-source reverberant environments , 2013 .

[38]  Ziqian Dong,et al.  Indoor localization for mobile devices , 2014, Proceedings of the 11th IEEE International Conference on Networking, Sensing and Control.

[39]  Amir Said,et al.  A Steered-Response Power Algorithm Employing Hierarchical Search for Acoustic Source Localization Using Microphone Arrays , 2014, IEEE Transactions on Signal Processing.