Energy-Efficient Integration of Continuous Context Sensing and Prediction into Smartwatches

As the availability and use of wearables increases, they are becoming a promising platform for context sensing and context analysis. Smartwatches are a particularly interesting platform for this purpose, as they offer salient advantages, such as their proximity to the human body. However, they also have limitations associated with their small form factor, such as processing power and battery life, which makes it difficult to simply transfer smartphone-based context sensing and prediction models to smartwatches. In this paper, we introduce an energy-efficient, generic, integrated framework for continuous context sensing and prediction on smartwatches. Our work extends previous approaches for context sensing and prediction on wrist-mounted wearables that perform predictive analytics outside the device. We offer a generic sensing module and a novel energy-efficient, on-device prediction module that is based on a semantic abstraction approach to convert sensor data into meaningful information objects, similar to human perception of a behavior. Through six evaluations, we analyze the energy efficiency of our framework modules, identify the optimal file structure for data access and demonstrate an increase in accuracy of prediction through our semantic abstraction method. The proposed framework is hardware independent and can serve as a reference model for implementing context sensing and prediction on small wearable devices beyond smartwatches, such as body-mounted cameras.

[1]  Wen-Chih Peng,et al.  On mining mobile apps usage behavior for predicting apps usage in smartphones , 2013, CIKM.

[2]  Jadwiga Indulska,et al.  A survey of context modelling and reasoning techniques , 2010, Pervasive Mob. Comput..

[3]  Saeed Moghaddam,et al.  MobileMiner: mining your frequent patterns on your phone , 2014, UbiComp.

[4]  Robin Le Poidevin,et al.  The Experience and Perception of Time , 2000 .

[5]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[6]  Katarzyna Wac,et al.  UbiqLog: a generic mobile phone-based life-log framework , 2013, Personal and Ubiquitous Computing.

[7]  Gregory D. Abowd,et al.  The context toolkit: aiding the development of context-enabled applications , 1999, CHI '99.

[8]  Wanda Pratt,et al.  Understanding quantified-selfers' practices in collecting and exploring personal data , 2014, CHI.

[9]  Debjyoti Chowdhury,et al.  A Real Time Gesture Recognition with Wrist Mounted Accelerometer , 2015 .

[10]  Pengfei Liu,et al.  Mobile WEKA as Data Mining Tool on Android , 2012 .

[11]  Daniele Puccinelli,et al.  When sensing goes pervasive , 2015, Pervasive Mob. Comput..

[12]  Hari Balakrishnan,et al.  Code in the air: simplifying sensing and coordination tasks on smartphones , 2012, HotMobile '12.

[13]  Ashok K. Agrawala,et al.  SenseMe: a system for continuous, on-device, and multi-dimensional context and activity recognition , 2014, MobiQuitous.

[14]  Chao Huang,et al.  A Survey on Indoor Positioning Technologies , 2011 .

[15]  Enhong Chen,et al.  A habit mining approach for discovering similar mobile users , 2012, WWW.

[16]  Deborah Estrin,et al.  Lifestreams: a modular sense-making toolset for identifying important patterns from everyday life , 2013, SenSys '13.

[17]  Amy Loutfi,et al.  Data Mining for Wearable Sensors in Health Monitoring Systems: A Review of Recent Trends and Challenges , 2013, Sensors.

[18]  JeongGil Ko,et al.  Wireless Sensor Networks for Healthcare , 2010, Proceedings of the IEEE.

[19]  Elaheh Momeni,et al.  Leveraging Social Affect for Identifying Individual Mood , 2015, SEMANTiCS.

[20]  Chelsea Dobbins,et al.  The Big Data Obstacle of Lifelogging , 2014, 2014 28th International Conference on Advanced Information Networking and Applications Workshops.

[21]  Thad Starner,et al.  How Wearables Worked their Way into the Mainstream , 2014, IEEE Pervasive Computing.

[22]  Mani B. Srivastava,et al.  Building principles for a quality of information specification for sensor information , 2009, 2009 12th International Conference on Information Fusion.

[23]  Suman Nath,et al.  ACE: Exploiting Correlation for Energy-Efficient and Continuous Context Sensing , 2012, IEEE Transactions on Mobile Computing.

[24]  Katarzyna Wac,et al.  Getting closer: an empirical investigation of the proximity of user to their smart phones , 2011, UbiComp '11.

[25]  Chelsea Dobbins,et al.  Creating human digital memories with the aid of pervasive mobile devices , 2014, Pervasive Mob. Comput..

[26]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[27]  Kristof Van Laerhoven,et al.  Detecting leisure activities with dense motif discovery , 2012, UbiComp.

[28]  Mika Raento,et al.  ContextPhone: a prototyping platform for context-aware mobile applications , 2005, IEEE Pervasive Computing.

[29]  Hiram Galeana-Zapién,et al.  Mobile Phone Middleware Architecture for Energy and Context Awareness in Location-Based Services , 2014, Sensors.

[30]  Eamonn J. Keogh,et al.  Accelerating Dynamic Time Warping Clustering with a Novel Admissible Pruning Strategy , 2015, KDD.

[31]  Jatinder Pal Singh,et al.  Improving energy efficiency of location sensing on smartphones , 2010, MobiSys '10.

[32]  Apu Kapadia,et al.  Opportunistic sensing: Security challenges for the new paradigm , 2009, 2009 First International Communication Systems and Networks and Workshops.

[33]  Chelsea Dobbins,et al.  Clustering of Physical Activities for Quantified Self and mHealth Applications , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[34]  Archan Misra,et al.  The challenge of continuous mobile context sensing , 2014, 2014 Sixth International Conference on Communication Systems and Networks (COMSNETS).

[35]  Gernot Heiser,et al.  An Analysis of Power Consumption in a Smartphone , 2010, USENIX Annual Technical Conference.

[36]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[37]  Anthony Rowe,et al.  Indoor pseudo-ranging of mobile devices using ultrasonic chirps , 2012, SenSys '12.

[38]  Romit Roy Choudhury,et al.  Tapprints: your finger taps have fingerprints , 2012, MobiSys '12.

[39]  Anthony Rowe,et al.  eWatch: a wearable sensor and notification platform , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[40]  Vagelis Hristidis,et al.  User effort minimization through adaptive diversification , 2014, KDD.

[41]  Pedro José Marrón,et al.  Micro-navigation for urban bus passengers: using the internet of things to improve the public transport experience , 2014 .

[42]  Adam W. Hoover,et al.  A New Method for Measuring Meal Intake in Humans via Automated Wrist Motion Tracking , 2012, Applied Psychophysiology and Biofeedback.

[43]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[44]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[45]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[46]  Ying Wah Teh,et al.  Mining Personal Data Using Smartphones and Wearable Devices: A Survey , 2015, Sensors.

[47]  A Min Tjoa,et al.  Securing Shareable Life-logs , 2010, 2010 IEEE Second International Conference on Social Computing.

[48]  Jaime Lloret,et al.  Mobile Sensing Systems , 2013, Sensors.

[49]  Mirco Musolesi,et al.  Anticipatory Mobile Computing , 2013, ACM Comput. Surv..

[50]  Kristof Van Laerhoven,et al.  Low-power lessons from designing a wearable logger for long-term deployments , 2015, 2015 IEEE Sensors Applications Symposium (SAS).

[51]  Blaine A. Price,et al.  Wearables: has the age of smartwatches finally arrived? , 2015, Commun. ACM.

[52]  Andreas Krause,et al.  SenSay: a context-aware mobile phone , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[53]  Cristian Ungureanu,et al.  Revisiting storage for smartphones , 2012, TOS.

[54]  Kristof Van Laerhoven,et al.  Wear is Your Mobile? Investigating Phone Carrying and Use Habits with a Wearable Device , 2015, Front. ICT.