Towards Health Recommendation Systems: An Approach for Providing Automated Personalized Health Feedback from Mobile Data

Personal data acquisition using smartphones has become robust and achievable in recent times: improvements in user interfaces have made manual inputting more straightforward and intuitive, while advances in sensing technology has made tracking more accurate and less obtrusive. Moreover, algorithmic advances in data mining and machine learning has led to better a interpretation and determination factors indicative of health conditions and outcomes. However, these indicators are still under-utilized when providing feedback to the user or a health worker. Mobile health systems that can exploit such indicators could potentially deliver precision feedback personalized to the user’s condition and also lead to increases in adherence and improve efficacy. In this book chapter, we will provide an overview of the state of the art in mobile health feedback systems and then discuss MyBehavior, an example of a feedback system that utilizes individual data streams and indicators. MyBehavior is the first personalized system that provides health beneficial recommendations based on physical activity and dietary data acquired using smartphones. The system learns common healthy and unhealthy behaviors from activity and dietary logs, and then prioritizes and suggests actions similar to existing behaviors. Such prioritization is done to promote a sense of familiarity to the suggestions and increase the likelihood of adoption. We also formulate a basis framework for future systems similar to MyBehavior and discuss challenges with regard to transference and adaptation.

[1]  B. Spring,et al.  Optimization of remotely delivered intensive lifestyle treatment for obesity using the Multiphase Optimization Strategy: Opt-IN study protocol. , 2014, Contemporary clinical trials.

[2]  Chiranjib Bhattacharyya,et al.  Fréchet Distance Based Approach for Searching Online Handwritten Documents , 2007 .

[3]  Konrad Paul Kording,et al.  Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study , 2015, Journal of medical Internet research.

[4]  Wanda Pratt,et al.  SleepTight: low-burden, self-monitoring technology for capturing and reflecting on sleep behaviors , 2015, UbiComp.

[5]  I. Rosenstock Health Belief Model. , 2000 .

[6]  Krzysztof Z. Gajos,et al.  Platemate: crowdsourcing nutritional analysis from food photographs , 2011, UIST.

[7]  Tanzeem Choudhury,et al.  Automated Personalized Feedback for Physical Activity and Dietary Behavior Change With Mobile Phones: A Randomized Controlled Trial on Adults , 2015, JMIR mHealth and uHealth.

[8]  Sergio Guadarrama,et al.  Im2Calories: Towards an Automated Mobile Vision Food Diary , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Filip Radlinski,et al.  Large-scale validation and analysis of interleaved search evaluation , 2012, TOIS.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[12]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[13]  Paul Dourish,et al.  Where the action is , 2001 .

[14]  Thad Starner,et al.  Using GPS to learn significant locations and predict movement across multiple users , 2003, Personal and Ubiquitous Computing.

[15]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[16]  Shashi Shekhar,et al.  Discovering personal gazetteers: an interactive clustering approach , 2004, GIS '04.

[17]  Ambuj Tewari,et al.  Just-in-Time Adaptive Interventions (JITAIs): An Organizing Framework for Ongoing Health Behavior Support , 2014 .

[18]  Andrew T. Campbell,et al.  Bewell: A smartphone application to monitor, model and promote wellbeing , 2011, PervasiveHealth 2011.

[19]  Tanzeem Choudhury,et al.  Towards circadian computing: "early to bed and early to rise" makes some of us unhealthy and sleep deprived , 2014, UbiComp.

[20]  Inbal Nahum-Shani,et al.  Q-learning: a data analysis method for constructing adaptive interventions. , 2012, Psychological methods.

[21]  H. Robbins Some aspects of the sequential design of experiments , 1952 .

[22]  Amy Voida,et al.  Towards personal stress informatics: comparing minimally invasive techniques for measuring daily stress in the wild , 2014, PervasiveHealth.

[23]  Sumit Basu,et al.  Conversational scene analysis , 2002 .

[24]  David R Bassett,et al.  2011 Compendium of Physical Activities: a second update of codes and MET values. , 2011, Medicine and science in sports and exercise.

[25]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[26]  B. J. Fogg,et al.  A behavior model for persuasive design , 2009, Persuasive '09.

[27]  Maryam Mahdaviani,et al.  Fast and Scalable Training of Semi-Supervised CRFs with Application to Activity Recognition , 2007, NIPS.

[28]  John P. Pollak,et al.  PAM: a photographic affect meter for frequent, in situ measurement of affect , 2011, CHI.

[29]  C. Caspersen,et al.  A survey for assessing physical activity among older adults. , 1993, Medicine and science in sports and exercise.

[30]  Mi Zhang,et al.  MyBehavior: automatic personalized health feedback from user behaviors and preferences using smartphones , 2015, UbiComp.

[31]  Thorsten Joachims,et al.  In Google We Trust: Users' Decisions on Rank, Position, and Relevance , 2007, J. Comput. Mediat. Commun..

[32]  Kristina Höök,et al.  The sensual evaluation instrument: developing an affective evaluation tool , 2006, CHI.

[33]  Sébastien Bubeck,et al.  Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems , 2012, Found. Trends Mach. Learn..

[34]  W. Maixner,et al.  Preventing Chronic Pain: A Human Systems Approach—Results From a Massive Open Online Course , 2015, Global advances in health and medicine.

[35]  Thorsten Joachims,et al.  The K-armed Dueling Bandits Problem , 2012, COLT.

[36]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[37]  Fan Zhang,et al.  PlateClick: Bootstrapping Food Preferences Through an Adaptive Visual Interface , 2015, CIKM.

[38]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[39]  Alex Pentland,et al.  Sensing and modeling human networks , 2004 .

[40]  L. Fabrigar,et al.  Theory of Planned Behavior , 2017 .

[41]  Lama Nachman,et al.  Unobtrusive gait verification for mobile phones , 2014, SEMWEB.

[42]  Parisa Rashidi,et al.  The Behavioral Intervention Technology Model: An Integrated Conceptual and Technological Framework for eHealth and mHealth Interventions , 2014, Journal of medical Internet research.

[43]  David W. McDonald,et al.  Theory-driven design strategies for technologies that support behavior change in everyday life , 2009, CHI.

[44]  P. Lally,et al.  How are habits formed: Modelling habit formation in the real world , 2010 .

[45]  Sean A. Munson,et al.  A framework for self-experimentation in personalized health , 2016, J. Am. Medical Informatics Assoc..

[46]  Rita Kukafka,et al.  Tailored Health Communication , 2005 .

[47]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[48]  David W. McDonald,et al.  Activity sensing in the wild: a field trial of ubifit garden , 2008, CHI.

[49]  David L. Tennenhouse,et al.  Proactive computing , 2000, Commun. ACM.

[50]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[51]  Tanzeem Choudhury,et al.  Passive and In-Situ assessment of mental and physical well-being using mobile sensors , 2011, UbiComp '11.

[52]  Sunny Consolvo,et al.  Lullaby: a capture & access system for understanding the sleep environment , 2012, UbiComp.

[53]  Deborah Estrin,et al.  Small data, where n = me , 2014, Commun. ACM.

[54]  Wei Chu,et al.  A contextual-bandit approach to personalized news article recommendation , 2010, WWW '10.

[55]  Mi Zhang,et al.  An intelligent crowd-worker selection approach for reliable content labeling of food images , 2015, Wireless Health.

[56]  A. Samanta,et al.  Chronic low back pain , 2003, BMJ : British Medical Journal.

[57]  Dean Eckles,et al.  Mobile Persuasion: 20 Perspectives on the Future of Behavior Change , 2007 .

[58]  Cecilia Mascolo,et al.  EmotionSense: a mobile phones based adaptive platform for experimental social psychology research , 2010, UbiComp.