Mago: Mode of Transport Inference Using the Hall-Effect Magnetic Sensor and Accelerometer

In this paper, we introduce Mago, a novel system that can infer a person's mode of transport (MOT) using the Hall-effect magnetic sensor and accelerometer present in most smart devices. When a vehicle is moving, the motions of its mechanical components such as the wheels, transmission and the differential distort the earth's magnetic field. The magnetic field is distorted corresponding to the vehicle structure (e.g., bike chain or car transmission system), which manifests itself as a strong signal for sensing a person's transportation modality. We utilize this magnetic signal combined with the accelerometer and design a robust algorithm for the MOT detection. In particular, our system extracts frame-based features from the sensor data and can run in nearly real-time with only a few seconds of delay. We evaluated Mago using over 70 hours of daily commute data from 7 participants and the leave-one-out analysis of our cross-user, cross-device model reports an average accuracy of 94.4% among seven classes (stationary, bus, bike, car, train, light rail and scooter). Besides MOT, our system is able to reliably differentiate the phone's in-car position at an average accuracy of 92.9%. We believe Mago could potentially benefit many contextually-aware applications that require MOT detection such as a digital personal assistant or a life coaching application.

[1]  M. Kraichman Handbook of electromagnetic propagation in conducting media , 1970 .

[2]  Hisatsugu Itoh,et al.  Magnetic Field Sensor and Its Application to Automobiles , 1980 .

[3]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[4]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[5]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[6]  Matthew Chalmers,et al.  Increasing the Awareness of Daily Activity Levels with Pervasive Computing , 2006, 2006 Pervasive Health Conference and Workshops.

[7]  William G. Griswold,et al.  Mobility Detection Using Everyday GSM Traces , 2006, UbiComp.

[8]  J. Lenz,et al.  Magnetic sensors and their applications , 2006, IEEE Sensors Journal.

[9]  Gaetano Borriello,et al.  A Practical Approach to Recognizing Physical Activities , 2006, Pervasive.

[10]  Henry A. Kautz,et al.  Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields , 2007, Int. J. Robotics Res..

[11]  Gregory D. Abowd,et al.  At the Flick of a Switch: Detecting and Classifying Unique Electrical Events on the Residential Power Line (Nominated for the Best Paper Award) , 2007, UbiComp.

[12]  Henry A. Kautz,et al.  Learning and inferring transportation routines , 2004, Artif. Intell..

[13]  David W. McDonald,et al.  Activity sensing in the wild: a field trial of ubifit garden , 2008, CHI.

[14]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[15]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.

[16]  Zhenyu He,et al.  Activity recognition from acceleration data based on discrete consine transform and SVM , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[17]  James A. Landay,et al.  UbiGreen: investigating a mobile tool for tracking and supporting green transportation habits , 2009, CHI.

[18]  Shwetak N. Patel,et al.  ElectriSense: single-point sensing using EMI for electrical event detection and classification in the home , 2010, UbiComp.

[19]  Deborah Estrin,et al.  Using mobile phones to determine transportation modes , 2010, TOSN.

[20]  Jian Ma,et al.  Accelerometer Based Transportation Mode Recognition on Mobile Phones , 2010, 2010 Asia-Pacific Conference on Wearable Computing Systems.

[21]  Zhigang Liu,et al.  The Jigsaw continuous sensing engine for mobile phone applications , 2010, SenSys '10.

[22]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[23]  Xing Xie,et al.  Understanding transportation modes based on GPS data for web applications , 2010, TWEB.

[24]  Philip S. Yu,et al.  Transportation mode detection using mobile phones and GIS information , 2011, GIS.

[25]  Mi Zhang,et al.  A preliminary study of sensing appliance usage for human activity recognition using mobile magnetometer , 2012, UbiComp.

[26]  Sean White,et al.  uTrack: 3D input using two magnetic sensors , 2013, UIST.

[27]  Richard P. Martin,et al.  Sensing vehicle dynamics for determining driver phone use , 2013, MobiSys '13.

[28]  Shwetak N. Patel,et al.  uTouch: sensing touch gestures on unmodified LCDs , 2013, CHI.

[29]  Sasu Tarkoma,et al.  Accelerometer-based transportation mode detection on smartphones , 2013, SenSys '13.

[30]  Xiang-Yang Li,et al.  You're driving and texting: detecting drivers using personal smart phones by leveraging inertial sensors , 2013, MobiCom.

[31]  Chieh-Yih Wan,et al.  Classifying the mode of transportation on mobile phones using GIS information , 2014, UbiComp.

[32]  Shwetak N. Patel,et al.  Implementing technology-based embedded assessment in the home and community life of individuals aging with disabilities: a participatory research and development study , 2014, Disability and rehabilitation. Assistive technology.

[33]  Mo Li,et al.  How Long to Wait? Predicting Bus Arrival Time With Mobile Phone Based Participatory Sensing , 2012, IEEE Transactions on Mobile Computing.

[34]  MagnifiSense: inferring device interaction using wrist-worn passive magneto-inductive sensors , 2015, UbiComp.

[35]  A. Glasmeier,et al.  Thinking about smart cities , 2015 .

[36]  Sonja Meyer,et al.  Battery-Efficient Transportation Mode Detection on Mobile Devices , 2015, 2015 16th IEEE International Conference on Mobile Data Management.

[37]  Eric C. Larson,et al.  DOSE: Detecting user-driven operating states of electronic devices from a single sensing point , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[38]  Wolfgang H. Schulz,et al.  Future role of cost–benefit analysis in intelligent transport system-research , 2015 .

[39]  Gregory Mone,et al.  The new smart cities , 2015, Commun. ACM.

[40]  Richard P. Martin,et al.  Determining Driver Phone Use by Exploiting Smartphone Integrated Sensors , 2016, IEEE Transactions on Mobile Computing.

[41]  Shwetak N. Patel,et al.  Finexus: Tracking Precise Motions of Multiple Fingertips Using Magnetic Sensing , 2016, CHI.

[42]  Algimantas Valinevicius,et al.  Dynamic Vehicle Detection via the Use of Magnetic Field Sensors , 2016, Sensors.

[43]  Fernando Nogueira,et al.  Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning , 2016, J. Mach. Learn. Res..