It's the Human that Matters: Accurate User Orientation Estimation for Mobile Computing Applications

Ubiquity of Internet-connected and sensor-equipped portable devices sparked a new set of mobile computing applications that leverage the proliferating sensing capabilities of smartphones. For many of these applications, accurate estimation of the user heading, as compared to the phone heading, is of paramount importance. This is of special importance for many crowd-sensing applications, where the phone can be carried in arbitrary positions and orientations relative to the user body. Current state-of-the-art focus mainly on estimating the phone orientation, require the phone to be placed in a particular position, require user intervention, and/or do not work accurately indoors; which limits their ubiquitous usability in different applications. In this paper we present Humaine, a novel system to reliably and accurately estimate the user orientation relative to the Earth coordinate system. Humaine requires no prior-configuration nor user intervention and works accurately indoors and outdoors for arbitrary cell phone positions and orientations relative to the user body. The system applies statistical analysis techniques to the inertial sensors widely available on today's cell phones to estimate both the phone and user orientation. Implementation of the system on different Android devices with 170 experiments performed at different indoor and outdoor testbeds shows that Humaine significantly outperforms the state-of-the-art in diverse scenarios, achieving a median accuracy of 15° averaged over a wide variety of phone positions. This is 558% better than the-state-of-the-art. The accuracy is bounded by the error in the inertial sensors readings and can be enhanced with more accurate sensors and sensor fusion.

[1]  Rahim Tafazolli,et al.  uDirect: A novel approach for pervasive observation of user direction with mobile phones , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[2]  Michael W. McElhinny,et al.  The Magnetic Field of the Earth: Paleomagnetism, the Core, and the Deep Mantle , 1997 .

[3]  Moustafa Youssef,et al.  CrowdInside: automatic construction of indoor floorplans , 2012, SIGSPATIAL/GIS.

[4]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[5]  Moustafa Youssef,et al.  UPTIME: Ubiquitous pedestrian tracking using mobile phones , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[6]  Romit Roy Choudhury,et al.  CompAcc : Using Mobile Phone Compasses and Accelerometers for Localization , 2009 .

[7]  Takeshi Kurata,et al.  A wearable augmented reality system with personal positioning based on walking locomotion analysis , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[8]  William Rowan Hamilton,et al.  Elements of Quaternions , 1969 .

[9]  Feng Zhao,et al.  A reliable and accurate indoor localization method using phone inertial sensors , 2012, UbiComp.

[10]  Stéphane Beauregard,et al.  Omnidirectional Pedestrian Navigation for First Responders , 2007, 2007 4th Workshop on Positioning, Navigation and Communication.

[11]  Moustafa Youssef,et al.  Dejavu: an accurate energy-efficient outdoor localization system , 2013, SIGSPATIAL/GIS.

[12]  Jeremy R. Cooperstock,et al.  Smartphone Sensor Reliability for Augmented Reality Applications , 2012, MobiQuitous.

[13]  Shuzhi Sam Ge,et al.  Autonomous vehicle positioning with GPS in urban canyon environments , 2001, IEEE Trans. Robotics Autom..

[14]  Takeshi Kurata,et al.  Personal positioning based on walking locomotion analysis with self-contained sensors and a wearable camera , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[15]  Heba Aly,et al.  Map++: A Crowd-sensing System for Automatic Map Semantics Identification , 2014, SECON.

[16]  Injong Rhee,et al.  Towards Mobile Phone Localization without War-Driving , 2010, 2010 Proceedings IEEE INFOCOM.

[17]  Paul Lukowicz,et al.  Which Way Am I Facing: Inferring Horizontal Device Orientation from an Accelerometer Signal , 2009, 2009 International Symposium on Wearable Computers.

[18]  Lei Yang,et al.  Accurate online power estimation and automatic battery behavior based power model generation for smartphones , 2010, 2010 IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[19]  Pei Zhang,et al.  Headio: zero-configured heading acquisition for indoor mobile devices through multimodal context sensing , 2013, UbiComp.

[20]  Gerhard Schall,et al.  Mobile Augmented Reality for Human Scale Interaction with Geospatial Models , 2012 .

[21]  Wei Chen,et al.  A novel pedestrian dead reckoning algorithm using wearable EMG sensors to measure walking strides , 2010, 2010 Ubiquitous Positioning Indoor Navigation and Location Based Service.

[22]  Bernt Schiele,et al.  Dead reckoning from the pocket - An experimental study , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[23]  Mohamed N. El-Derini,et al.  GAC: Energy-Efficient Hybrid GPS-Accelerometer-Compass GSM Localization , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[24]  Rahim Tafazolli,et al.  Design, Realization, and Evaluation of uDirect-An Approach for Pervasive Observation of User Facing Direction on Mobile Phones , 2014, IEEE Transactions on Mobile Computing.

[25]  Mi Zhang,et al.  Motion primitive-based human activity recognition using a bag-of-features approach , 2012, IHI '12.

[26]  M. Kourogi,et al.  A method of personal positioning based on sensor data fusion of wearable camera and self-contained sensors , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[27]  Gerhard Schall Mobile augmented reality for human scale interaction with geospatial models: the benefit for industrial applications , 2013 .

[28]  J. W. Humberston Classical mechanics , 1980, Nature.

[29]  B. Hofmann-Wellenhof,et al.  Global Positioning System , 1992 .