On the feasibility of real-time phone-to-phone 3D localization

High-speed, locational, phone-to-phone (HLPP) games and apps constitute a provocative class of mobile apps that are currently unsupported on commodity mobile devices. This work looks at a key problem for enabling HLPP: a specific variant of the localization problem in which two phones estimate each other's relative positions in 3D space without infrastructure support. Moreover, position estimates should reflect changes due to the phones' possible mobility. We present a solution for achieving high speed 3D continuous localization for phone-to-phone scenarios. Our basic approach uses acoustic cues based on time-of-arrival and power level. It assumes at least two microphones and one speaker per phone, which is common on new smartphones. Accelerometers and digital compasses assist in resolving ambiguous acoustic-only localization. Continuous localization is achieved with the aid of a loose time synchronization protocol and an extended Kalman filter. Experimental results across a range of motion paths show localization resolution to within 13.9 centimeters for 90% of estimates, and to within 4.9 centimeters for 50% of estimates when the phones are several meters apart.

[1]  Gregory H. Wakefield,et al.  Introduction to Head-Related Transfer Functions (HRTFs): Representations of HRTFs in Time, Frequency, and Space , 2001 .

[2]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[3]  James M. Rehg,et al.  Using Sound Source Localization in a Home Environment , 2005, Pervasive.

[4]  Guobin Shen,et al.  BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices , 2007, SenSys '07.

[5]  Ivan Tashev,et al.  MICROPHONE ARRAY POST-PROCESSOR USING INSTANTANEOUS DIRECTION OF ARRIVAL , 2006 .

[6]  Cristina V. Lopes,et al.  Localization of off-the-shelf mobile devices using audible sound: architectures, protocols and performance assessment , 2006, MOCO.

[7]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[8]  C. Moss,et al.  The bat head-related transfer function reveals binaural cues for sound localization in azimuth and elevation. , 2004, The Journal of the Acoustical Society of America.

[9]  Andy Hopper,et al.  The Anatomy of a Context-Aware Application , 1999, Wirel. Networks.

[10]  HopperAndy,et al.  The anatomy of a context-aware application , 2002 .

[11]  Kristian Kroschel,et al.  System for robust 3D speaker tracking using microphone array measurements , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  Barry D. Van Veen,et al.  A spatial feature extraction and regularization model for virtual auditory display , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  James Scott,et al.  Audio Location: Accurate Low-Cost Location Sensing , 2005, Pervasive.

[14]  Hari Balakrishnan,et al.  6th ACM/IEEE International Conference on on Mobile Computing and Networking (ACM MOBICOM ’00) The Cricket Location-Support System , 2022 .

[15]  Anthony LaMarca Location Systems: An Introduction to the Technology Behind Location (Synthesis Lectures on Mobile and Pervasive Computing) , 2008 .

[16]  Deborah Estrin,et al.  A self-calibrating distributed acoustic sensing platform , 2006, SenSys '06.