User context recognition using smartphone sensors and classification models

Context recognition is an indispensable functionality of context-aware applications that deals with automatic determination and inference of contextual information from a set of observations captured by sensors. It enables developing applications that can respond and adapt to user's situations. Thus much attention has been paid to developing innovative context recognition capabilities into context-aware systems. However, some existing studies rely on wearable sensors for context recognition and this practice has limited the incorporation of contexts into practical applications. Additionally, contexts are usually provided as low-level data, which are not suitable for more advanced mobile applications. This article explores and evaluates the use of smartphone's built-in sensors and classification algorithms for context recognition. To realize this goal, labeled sensor data were collected as training and test datasets from volunteers' smartphones while performing daily activities. Time series features were then extracted from the collected data, summarizing user's contexts with 50% overlapping slide windows. Context recognition is achieved by inducing a set of classifiers with the extracted features. Using cross validation, experimental results show that instance-based learners and decision trees are best suitable for smartphone-based context recognition, achieving over 90% recognition accuracy. Nevertheless, using leave-one-subject-out validation, the performance drops to 79%. The results also show that smartphone's orientation and rotation data can be used to recognize user contexts. Furthermore, using data from multiple sensors, our results indicate improvement in context recognition performance between 1.5% and 5%. To demonstrate its applicability, the context recognition system has been incorporated into a mobile application to support context-aware personalized media recommendations.

[1]  Sian Lun Lau,et al.  Movement recognition using the accelerometer in smartphones , 2010, 2010 Future Network & Mobile Summit.

[2]  Y. Kawahara,et al.  Recognizing User Context Using Mobile Handsets with Acceleration Sensors , 2007, 2007 IEEE International Conference on Portable Information Devices.

[3]  Alex Pentland,et al.  Recognizing user context via wearable sensors , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[4]  Toshiaki Uemukai,et al.  A content search system considering the activity and context of a mobile user , 2012, Personal and Ubiquitous Computing.

[5]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[6]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[7]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[8]  Petia Radeva,et al.  Human Activity Recognition from Accelerometer Data Using a Wearable Device , 2011, IbPRIA.

[9]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[10]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[11]  Gregory M. P. O'Hare,et al.  Dynamic sensor event segmentation for real-time activity recognition in a smart home context , 2014, Personal and Ubiquitous Computing.

[12]  Girija Chetty,et al.  Smart Phone Based Data Mining for Human Activity Recognition , 2015 .

[13]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[14]  Abayomi Moradeyo Otebolaku,et al.  Context-Aware User Profiling and Multimedia Content Classification for Smart Devices , 2014, 2014 28th International Conference on Advanced Information Networking and Applications Workshops.

[15]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[16]  Daniel Borrajo,et al.  A dynamic sliding window approach for activity recognition , 2011, UMAP'11.

[17]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[18]  Gary M. Weiss,et al.  Applications of mobile activity recognition , 2012, UbiComp.

[19]  Paul Lukowicz,et al.  Performance metrics for activity recognition , 2011, TIST.

[20]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[21]  Jesús Favela,et al.  Activity Recognition for the Smart Hospital , 2008, IEEE Intelligent Systems.

[22]  Xing Xie,et al.  Learning transportation mode from raw gps data for geographic applications on the web , 2008, WWW.

[23]  Jun Yang,et al.  Toward physical activity diary: motion recognition using simple acceleration features with mobile phones , 2009, IMCE '09.

[24]  Daniel Gatica-Perez,et al.  Smartphone usage in the wild: a large-scale analysis of applications and context , 2011, ICMI '11.

[25]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.

[26]  Norbert Gyorbíró,et al.  An Activity Recognition System For Mobile Phones , 2009, Mob. Networks Appl..

[27]  Charalampos Konstantopoulos,et al.  Mobile recommender systems in tourism , 2014, J. Netw. Comput. Appl..

[28]  Francesco Ricci,et al.  Mobile Recommender Systems , 2010, J. Inf. Technol. Tour..

[29]  Adam Stroud,et al.  Professional Android Sensor Programming , 2012 .

[30]  George Karypis,et al.  Evaluation of Item-Based Top-N Recommendation Algorithms , 2001, CIKM '01.

[31]  Juha Röning,et al.  Recognizing Human Activities User-independently on Smartphones Based on Accelerometer Data , 2012, Int. J. Interact. Multim. Artif. Intell..

[32]  Diane J. Cook,et al.  Simple and Complex Activity Recognition through Smart Phones , 2012, 2012 Eighth International Conference on Intelligent Environments.

[33]  Serena Yeung,et al.  Predicting Mode of Transport from iPhone Accelerometer Data , 2012 .

[34]  Haruo Noma,et al.  Activity recognition of the elderly , 2010, CASEMANS '10.

[35]  Kalaiarasi Sonai Muthu,et al.  Classification Algorithms in Human Activity Recognition using Smartphones , 2012 .

[36]  Zhu Wang,et al.  Opportunistic IoT: Exploring the harmonious interaction between human and the internet of things , 2013, J. Netw. Comput. Appl..

[37]  Heikki Mannila,et al.  Time series segmentation for context recognition in mobile devices , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[38]  Daniel P. Siewiorek,et al.  Activity-Based Computing , 2008, IEEE Pervasive Computing.

[39]  Abayomi Moradeyo Otebolaku,et al.  Context-aware media recommendations for smart devices , 2014, J. Ambient Intell. Humaniz. Comput..

[40]  Ian Witten,et al.  Data Mining , 2000 .

[41]  Zhenyu He,et al.  Activity recognition from acceleration data based on discrete consine transform and SVM , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[42]  Tamás Henk,et al.  Activity Recognition for Personal Time Management , 2009, AmI.

[43]  Ian H. Witten,et al.  Data Mining, Fourth Edition: Practical Machine Learning Tools and Techniques , 2016 .

[44]  Abayomi Moradeyo Otebolaku,et al.  Context representation for context-aware mobile multimedia content recommendation , 2011 .

[45]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[46]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[47]  JOHANNES GEHRKE,et al.  RainForest—A Framework for Fast Decision Tree Construction of Large Datasets , 1998, Data Mining and Knowledge Discovery.

[48]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[49]  Deborah Estrin,et al.  PEIR, the personal environmental impact report, as a platform for participatory sensing systems research , 2009, MobiSys '09.

[50]  Takahiro Hara,et al.  Human activity recognition for a content search system considering situations of smartphone users , 2012, VR.

[51]  Abayomi Moradeyo Otebolaku,et al.  Recognizing High-Level Contexts from Smartphone Built-In Sensors for Mobile Media Content Recommendation , 2013, 2013 IEEE 14th International Conference on Mobile Data Management.