Humaine: a ubiquitous smartphone-based user heading estimation for mobile computing systems

Recently, there have been a wide range of mobile computing and crowd-sourcing applications that leverage the proliferating sensing capabilities of smartphones. Many of these place a paramount importance on accurate user heading estimation. Such applications include dead-reckoning-based localization and many crowd-sensing applications where the user typically carry her phone in arbitrary positions and orientations relative to her body and her transportation mode. However, there is no general solution available to estimate the user’s heading as current state-of-the-art focus on improving the phone orientation estimation, require the phone to be placed in a particular position, require a fixed transportation mode, require user intervention, and/or do not work accurately indoors. In this paper we present Humaine, a novel ubiquitous system that reliably and accurately estimates the user orientation relative to the Earth coordinate system. Humaine works accurately whether the user is riding a vehicle or walking indoors/outdoors for arbitrary cell phone positions and orientations relative to the user body. Moreover, it requires no prior-configuration nor user intervention. The system intelligently fuses the different inertial sensors widely available in off-the-shelf smartphones and employs statistical analysis techniques to their measurements to estimate the user orientation. Implementation of the system on different Android devices with 300 experiments performed at different indoor and outdoor testbeds shows that Humaine significantly outperforms the state-of-the-art in diverse scenarios, achieving a median accuracy of 14∘ and 16∘ for indoor and outdoor pedestrian users and 20∘ for in-vehicle users over a wide variety of phone positions. This is better than the-state-of-the-art by 523% and 594% for indoor and outdoor pedestrian users and 750% for in-vehicle users. This accuracy highlights the ubiquity of Humaine and its robustness against the various noise sources.

[1]  Lei Yang,et al.  Accurate online power estimation and automatic battery behavior based power model generation for smartphones , 2010, 2010 IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[2]  Valérie Renaudin,et al.  Magnetic, Acceleration Fields and Gyroscope Quaternion (MAGYQ)-Based Attitude Estimation with Smartphone Sensors for Indoor Pedestrian Navigation , 2014, Sensors.

[3]  Injong Rhee,et al.  Towards Mobile Phone Localization without War-Driving , 2010, 2010 Proceedings IEEE INFOCOM.

[4]  Pei Zhang,et al.  Polaris: getting accurate indoor orientations for mobile devices using ubiquitous visual patterns on ceilings , 2012, HotMobile '12.

[5]  Peilin Liu,et al.  An improved indoor localization method using smartphone inertial sensors , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[6]  Jeremy R. Cooperstock,et al.  Smartphone Sensor Reliability for Augmented Reality Applications , 2012, MobiQuitous.

[7]  Bernt Schiele,et al.  Dead reckoning from the pocket - An experimental study , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[8]  Mohamed N. El-Derini,et al.  GAC: Energy-Efficient Hybrid GPS-Accelerometer-Compass GSM Localization , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[9]  Rahim Tafazolli,et al.  Design, Realization, and Evaluation of uDirect-An Approach for Pervasive Observation of User Facing Direction on Mobile Phones , 2014, IEEE Transactions on Mobile Computing.

[10]  Mi Zhang,et al.  Motion primitive-based human activity recognition using a bag-of-features approach , 2012, IHI '12.

[11]  Pei Zhang,et al.  Headio: zero-configured heading acquisition for indoor mobile devices through multimodal context sensing , 2013, UbiComp.

[12]  Mahbub Hassan,et al.  A collaborative approach to heading estimation for smartphone-based PDR indoor localisation , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[13]  Moustafa Youssef,et al.  Dejavu: an accurate energy-efficient outdoor localization system , 2013, SIGSPATIAL/GIS.

[14]  Suman Nath,et al.  Experiences with eNav: a low-power vehicular navigation system , 2015, UbiComp.

[15]  M. Kourogi,et al.  A method of personal positioning based on sensor data fusion of wearable camera and self-contained sensors , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[16]  Michael W. McElhinny,et al.  The Magnetic Field of the Earth: Paleomagnetism, the Core, and the Deep Mantle , 1997 .

[17]  Gerhard Schall Mobile augmented reality for human scale interaction with geospatial models: the benefit for industrial applications , 2013 .

[18]  J. W. Humberston Classical mechanics , 1980, Nature.

[19]  Moustafa Youssef,et al.  Robust and ubiquitous smartphone-based lane detection , 2016, Pervasive Mob. Comput..

[20]  Stéphane Beauregard,et al.  Omnidirectional Pedestrian Navigation for First Responders , 2007, 2007 4th Workshop on Positioning, Navigation and Communication.

[21]  Moustafa Youssef,et al.  UPTIME: Ubiquitous pedestrian tracking using mobile phones , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[22]  Shuzhi Sam Ge,et al.  Autonomous vehicle positioning with GPS in urban canyon environments , 2001, IEEE Trans. Robotics Autom..

[23]  Takeshi Kurata,et al.  Personal positioning based on walking locomotion analysis with self-contained sensors and a wearable camera , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[24]  Moustafa Youssef,et al.  CrowdInside: automatic construction of indoor floorplans , 2012, SIGSPATIAL/GIS.

[25]  V. Gregers Hansen,et al.  Note on Incoherent Binary Sequences , 1968, IEEE Transactions on Aerospace and Electronic Systems.

[26]  Gong Zhang,et al.  GPS/INS Integrated Navigation Based on UKF and Simulated Annealing Optimized SVM , 2013, 2013 IEEE 78th Vehicular Technology Conference (VTC Fall).

[27]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[28]  Moustafa Youssef,et al.  Accurate and efficient map matching for challenging environments , 2014, SIGSPATIAL/GIS.

[29]  Sasu Tarkoma,et al.  Accelerometer-based transportation mode detection on smartphones , 2013, SenSys '13.

[30]  Paul Lukowicz,et al.  Which Way Am I Facing: Inferring Horizontal Device Orientation from an Accelerometer Signal , 2009, 2009 International Symposium on Wearable Computers.

[31]  Moustafa Youssef,et al.  SemanticSLAM: Using Environment Landmarks for Unsupervised Indoor Localization , 2016, IEEE Transactions on Mobile Computing.

[32]  Gerhard Schall,et al.  Mobile Augmented Reality for Human Scale Interaction with Geospatial Models , 2012 .

[33]  I. Bar-Itzhack,et al.  Attitude Determination from Vector Observations: Quaternion Estimation , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[34]  Takeshi Kurata,et al.  A wearable augmented reality system with personal positioning based on walking locomotion analysis , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[35]  William Rowan Hamilton,et al.  Elements of Quaternions , 1969 .

[36]  Feng Zhao,et al.  A reliable and accurate indoor localization method using phone inertial sensors , 2012, UbiComp.

[37]  Valérie Renaudin,et al.  Comparison of misalignment estimation techniques between handheld device and walking directions , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[38]  B. Hofmann-Wellenhof,et al.  Global Positioning System , 1992 .

[39]  He Wang,et al.  I am a smartphone and i can tell my user's walking direction , 2014, MobiSys.

[40]  Moustafa Youssef,et al.  Accurate Real-time Map Matching for Challenging Environments , 2017, IEEE Transactions on Intelligent Transportation Systems.

[41]  Wei Chen,et al.  A novel pedestrian dead reckoning algorithm using wearable EMG sensors to measure walking strides , 2010, 2010 Ubiquitous Positioning Indoor Navigation and Location Based Service.

[42]  Heba Aly,et al.  Map++: A Crowd-sensing System for Automatic Map Semantics Identification , 2014, SECON.

[43]  Rahim Tafazolli,et al.  uDirect: A novel approach for pervasive observation of user direction with mobile phones , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[44]  Moustafa Youssef,et al.  semMatch: road semantics-based accurate map matching for challenging positioning data , 2015, SIGSPATIAL/GIS.

[45]  Moustafa Youssef,et al.  LaneQuest: An accurate and energy-efficient lane detection system , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[46]  Di Wu,et al.  Heading Estimation for Indoor Pedestrian Navigation Using a Smartphone in the Pocket , 2015, Sensors.

[47]  Romit Roy Choudhury,et al.  CompAcc : Using Mobile Phone Compasses and Accelerometers for Localization , 2009 .