Tutorial for Using Control Systems Engineering to Optimize Adaptive Mobile Health Interventions

Background Adaptive behavioral interventions are individualized interventions that vary support based on a person's evolving needs. Digital technologies enable these adaptive interventions to function at scale. Adaptive interventions show great promise for producing better results compared with static interventions related to health outcomes. Our central thesis is that adaptive interventions are more likely to succeed at helping individuals meet and maintain behavioral targets if its elements can be iteratively improved via data-driven testing (ie, optimization). Control systems engineering is a discipline focused on decision making in systems that change over time and has a wealth of methods that could be useful for optimizing adaptive interventions. Objective The purpose of this paper was to provide an introductory tutorial on when and what to do when using control systems engineering for designing and optimizing adaptive mobile health (mHealth) behavioral interventions. Overview We start with a review of the need for optimization, building on the multiphase optimization strategy (MOST). We then provide an overview of control systems engineering, followed by attributes of problems that are well matched to control engineering. Key steps in the development and optimization of an adaptive intervention from a control engineering perspective are then summarized, with a focus on why, what, and when to do subtasks in each step. Implications Control engineering offers exciting opportunities for optimizing individualization and adaptation elements of adaptive interventions. Arguably, the time is now for control systems engineers and behavioral and health scientists to partner to advance interventions that can be individualized, adaptive, and scalable. This tutorial should aid in creating the bridge between these communities.

[1]  Evanghelos Zafiriou,et al.  Robust process control , 1987 .

[2]  W. Rakowski,et al.  Stages of change and decisional balance for 12 problem behaviors. , 1994, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[3]  Takemi Sugiyama,et al.  International Journal of Behavioral Nutrition and Physical Activity Joint Associations of Multiple Leisure-time Sedentary Behaviours and Physical Activity with Obesity in Australian Adults , 2008 .

[4]  Catrine Tudor-Locke,et al.  A step-defined sedentary lifestyle index: <5000 steps/day. , 2013, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[5]  Kiam Heong Ang,et al.  PID control system analysis and design , 2006, IEEE Control Systems.

[6]  G. Eysenbach The Law of Attrition , 2005, Journal of medical Internet research.

[7]  G. Dunton Ecological Momentary Assessment in Physical Activity Research , 2017, Exercise and sport sciences reviews.

[8]  David T. Neal,et al.  Hale and Hearty Policies , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[9]  B. Ainsworth,et al.  Intra-individual variation and estimates of usual physical activity. , 1999, Annals of epidemiology.

[10]  R Callister,et al.  Social cognitive theory and physical activity: a systematic review and meta‐analysis , 2014, Obesity reviews : an official journal of the International Association for the Study of Obesity.

[11]  R E LaPorte,et al.  Physical Activity and Cancer , 1988, Sports medicine.

[12]  C. Tudor-Locke,et al.  Physical activity is associated with risk factors for chronic disease across adult women's life cycle. , 2008, Journal of the American Dietetic Association.

[13]  A. Bauman,et al.  Too much sitting: a novel and important predictor of chronic disease risk? , 2008, British Journal of Sports Medicine.

[14]  J. Bernhardt,et al.  Behavioral Functionality of Mobile Apps in Health Interventions: A Systematic Review of the Literature , 2015, JMIR mHealth and uHealth.

[15]  S. Murphy,et al.  The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. , 2007, American journal of preventive medicine.

[16]  A. King,et al.  Why and how to improve physical activity promotion: lessons from behavioral science and related fields. , 2009, Preventive medicine.

[17]  H. Kraemer,et al.  Part I: Executive Summary , 2008 .

[18]  Lennart Ljung,et al.  System identification toolbox for use with MATLAB , 1988 .

[19]  A. Bauman,et al.  Can motivational signs prompt increases in incidental physical activity in an Australian health-care facility? , 2002, Health education research.

[20]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[21]  Misha Pavel,et al.  Building new computational models to support health behavior change and maintenance: new opportunities in behavioral research , 2015, Translational behavioral medicine.

[22]  Naresh N. Nandola,et al.  Control Systems Engineering for Optimizing Behavioral mHealth Interventions , 2017, Mobile Health - Sensors, Analytic Methods, and Applications.

[23]  Diana M. Thomas,et al.  Hybrid model predictive control for optimizing gestational weight gain behavioral interventions , 2013, 2013 American Control Conference.

[24]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[25]  P. Tucker,et al.  The effect of season and weather on physical activity: a systematic review. , 2007, Public health.

[26]  Maria E Fernandez,et al.  How we design feasibility studies. , 2009, American journal of preventive medicine.

[27]  Margaret L. Kern,et al.  Predictors of Physical Activity Patterns Across Adulthood: A Growth Curve Analysis , 2010, Personality & social psychology bulletin.

[28]  Daniel E. Rivera,et al.  A decision framework for an adaptive behavioral intervention for physical activity using hybrid model predictive control , 2016, 2016 American Control Conference (ACC).

[29]  Heleen Riper,et al.  The Pace of Technologic Change: Implications for Digital Health Behavior Intervention Research. , 2016, American journal of preventive medicine.

[30]  Steven N. Blair,et al.  Physical activity: health outcomes and importance for public health policy. , 2009, Preventive medicine.

[31]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[32]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..

[33]  Daniel E. Rivera,et al.  Agile science: creating useful products for behavior change in the real world , 2016, Translational behavioral medicine.

[34]  Maria Adler,et al.  Science and human behavior , 2017 .

[35]  P. Klasnja,et al.  Realizing Effective Behavioral Management of Health: The Metamorphosis of Behavioral Science Methods , 2013, IEEE Pulse.

[36]  Anthony Leiserowitz,et al.  Improving Public Engagement With Climate Change , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[37]  K. D'Alonzo,et al.  An Investigation of Habitual and Incidental Physical Activity Among Costa Rican and Costa Rican American Teenage Girls , 2007, Journal of transcultural nursing : official journal of the Transcultural Nursing Society.

[38]  L. Mâsse,et al.  Physical activity in the United States measured by accelerometer. , 2008, Medicine and science in sports and exercise.

[39]  Mahmood Karimi,et al.  On the estimation and control of human body composition , 2017, ArXiv.

[40]  Matthew P. Buman,et al.  Validation of Consumer-Based Hip and Wrist Activity Monitors in Older Adults With Varied Ambulatory Abilities , 2017, The journals of gerontology. Series A, Biological sciences and medical sciences.

[41]  J. Higgins,et al.  Personal financial incentives for changing habitual health-related behaviors: A systematic review and meta-analysis , 2015, Preventive medicine.

[42]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[43]  Xuan Cai,et al.  Control condition design and implementation features in controlled trials: a meta-analysis of trials evaluating psychotherapy for depression , 2014, Translational behavioral medicine.

[44]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[45]  Alex Broadbent,et al.  Causality and causal inference in epidemiology: the need for a pluralistic approach , 2016, International journal of epidemiology.

[46]  Jylana L. Sheats,et al.  Effects of Three Motivationally Targeted Mobile Device Applications on Initial Physical Activity and Sedentary Behavior Change in Midlife and Older Adults: A Randomized Trial , 2016, PloS one.

[47]  Alexander J. Rothman,et al.  Health Behavior Change: Moving from Observation to Intervention. , 2017, Annual review of psychology.

[48]  Catherine L. Jarrett,et al.  Adaptive goal setting and financial incentives: a 2 × 2 factorial randomized controlled trial to increase adults’ physical activity , 2017, BMC Public Health.

[49]  Peter R. Giacobbi,et al.  Exploring Behavioral Markers of Long-Term Physical Activity Maintenance , 2013, Health education & behavior : the official publication of the Society for Public Health Education.

[50]  Shirley M Moore,et al.  Meta-analysis of interventions to increase physical activity among cardiac subjects. , 2009, International journal of cardiology.

[51]  A. Battersby Plans and the Structure of Behavior , 1968 .

[52]  Predrag V. Klasnja,et al.  Toward Usable Evidence: Optimizing Knowledge Accumulation in HCI Research on Health Behavior Change , 2017, CHI.

[53]  William T Riley,et al.  Methodologies for optimizing behavioral interventions: introduction to special section , 2014, Translational behavioral medicine.

[54]  Jylana L. Sheats,et al.  Harnessing Different Motivational Frames via Mobile Phones to Promote Daily Physical Activity and Reduce Sedentary Behavior in Aging Adults , 2013, PloS one.

[55]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[56]  Daniel E. Rivera,et al.  A system identification approach for improving behavioral interventions based on Social Cognitive Theory , 2015, 2015 American Control Conference (ACC).

[57]  J. Chase Interventions to Increase Physical Activity Among Older Adults: A Meta-Analysis. , 2015, The Gerontologist.

[58]  Susan A. Murphy,et al.  Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research , 2014, Translational behavioral medicine.

[59]  N. Owen,et al.  Maintenance of physical activity and dietary change following a telephone-delivered intervention. , 2010, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[60]  Daniel E Rivera,et al.  Control systems engineering for optimizing a prenatal weight gain intervention to regulate infant birth weight. , 2014, American journal of public health.

[61]  B. Ainsworth,et al.  The International Prevalence Study on Physical Activity: results from 20 countries , 2009, The international journal of behavioral nutrition and physical activity.

[62]  D. Warburton,et al.  Health benefits of physical activity: the evidence , 2006, Canadian Medical Association Journal.

[63]  C. Matthews Physical activity in the United States measured by accelerometer: comment. , 2008, Medicine and science in sports and exercise.

[64]  Hyunjin Lee,et al.  Constrained minimum crest factor multisine signals for "Plant-Friendly" identification of highly interactive systems , 2003 .

[65]  Elizabeth Murray,et al.  Evaluating Digital Health Interventions: Key Questions and Approaches. , 2016, American journal of preventive medicine.

[66]  Matthew P Buman,et al.  Exercise advice by humans versus computers: maintenance effects at 18 months. , 2014, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[67]  Constantino M. Lagoa,et al.  On the mathematical modeling of the effect of treatment on human physical activity , 2016, 2016 IEEE Conference on Control Applications (CCA).

[68]  S. Murphy,et al.  A "SMART" design for building individualized treatment sequences. , 2012, Annual review of clinical psychology.

[69]  R. M. Elliott The Century psychology series , 1959 .

[70]  J. O'Loughlin,et al.  Influence of weather conditions and season on physical activity in adolescents. , 2009, Annals of epidemiology.

[71]  Daniel E. Rivera,et al.  An identification test monitoring procedure for MIMO systems based on statistical uncertainty estimation , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[72]  W. Nilsen,et al.  Health behavior models in the age of mobile interventions: are our theories up to the task? , 2011, Translational behavioral medicine.

[73]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[74]  Lennart Ljung,et al.  Experiments with Identification of Continuous Time Models , 2009 .

[75]  M. Speechley,et al.  Physical activity levels of older community-dwelling adults are influenced by summer weather variables. , 2009, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[76]  Daniel E. Rivera,et al.  Semi-physical identification and state estimation of energy intake for interventions to manage gestational weight gain , 2016, 2016 American Control Conference (ACC).

[77]  Pieter Jan Stappers,et al.  DesignX: Complex Sociotechnical Systems , 2016 .

[78]  Carsten Thomsen,et al.  The Effects of Free-Living Interval-Walking Training on Glycemic Control, Body Composition, and Physical Fitness in Type 2 Diabetic Patients , 2013, Diabetes Care.

[79]  Brianna S Fjeldsoe,et al.  Systematic review of maintenance of behavior change following physical activity and dietary interventions. , 2011, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[80]  Amy P Abernethy,et al.  Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise , 2013, Clinical and Translational Medicine.

[81]  Inbal Nahum-Shani,et al.  Experimental Designs for Research on Adaptive Interventions: Singly and Sequentially Randomized Trials , 2018 .

[82]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[83]  Frank Bentley,et al.  Mobile User Research: A Practical Guide , 2017, Synthesis Lectures on Mobile and Pervasive Computing.

[84]  A. Ward,et al.  Promoting Public Health in the Context of the “Obesity Epidemic” , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[85]  C. Carver,et al.  Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. , 1982, Psychological bulletin.

[86]  César A. Martín,et al.  Development of a dynamic computational model of social cognitive theory , 2016, Translational behavioral medicine.

[87]  S. Joe Qin,et al.  A survey of industrial model predictive control technology , 2003 .

[88]  Sayali S. Phatak,et al.  Adaptive step goals and rewards: a longitudinal growth model of daily steps for a smartphone-based walking intervention , 2018, Journal of Behavioral Medicine.

[89]  P. Pirolli,et al.  Implementation Intention and Reminder Effects on Behavior Change in a Mobile Health System: A Predictive Cognitive Model , 2017, Journal of medical Internet research.

[90]  Daniel E. Rivera,et al.  A control engineering approach for optimizing physical activity behavioral interventions , 2016, 2016 IEEE Ecuador Technical Chapters Meeting (ETCM).

[91]  Daniel R. Masys,et al.  News from the NIH: potential contributions of the behavioral and social sciences to the precision medicine initiative , 2015, Translational behavioral medicine.

[92]  David R Bassett,et al.  Sources of variance in daily physical activity levels as measured by an accelerometer. , 2002, Medicine and science in sports and exercise.

[93]  M. Hirvensalo,et al.  Life-course perspective for physical activity and sports participation , 2011, European Review of Aging and Physical Activity.

[94]  David R. Mehr,et al.  Interventions to increase physical activity among healthy adults: meta-analysis of outcomes. , 2011, American journal of public health.

[95]  M. Pavel,et al.  Advancing Models and Theories for Digital Behavior Change Interventions. , 2016, American journal of preventive medicine.

[96]  John M. Swales,et al.  Consilience: The Unity of Knowledge , 1999 .

[97]  L. John,et al.  Financial incentives for exercise adherence in adults: systematic review and meta-analysis. , 2013, American journal of preventive medicine.

[98]  Melissa Riddle News from the NIH: using an experimental medicine approach to facilitate translational research , 2015, Translational behavioral medicine.

[99]  P. Briss,et al.  Prevention of chronic disease in the 21st century: elimination of the leading preventable causes of premature death and disability in the USA , 2014, The Lancet.

[100]  John J Dziak,et al.  Factorial experiments: efficient tools for evaluation of intervention components. , 2014, American journal of preventive medicine.

[101]  G. Miller,et al.  Science Perspectives on Psychological the Smartphone Psychology Manifesto on Behalf Of: Association for Psychological Science the Smartphone Psychology Manifesto Previous Research Using Mobile Electronic Devices What Smartphones Can Do Now and Will Be Able to Do in the near Future , 2022 .

[102]  Daniel E. Rivera,et al.  A dynamical systems model of Social Cognitive Theory , 2014, 2014 American Control Conference.

[103]  Lennart Ljung,et al.  Modeling Of Dynamic Systems , 1994 .

[104]  M. Adams,et al.  An Adaptive Physical Activity Intervention for Overweight Adults: A Randomized Controlled Trial , 2013, PloS one.

[105]  Harri Vainio,et al.  Weight control and physical activity in cancer prevention , 2002, Obesity reviews : an official journal of the International Association for the Study of Obesity.

[106]  M. Buman,et al.  The CHOICE study: a "taste-test" of utilitarian vs. leisure walking among older adults. , 2012, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[107]  Inbal Nahum-Shani,et al.  Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. , 2015, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[108]  J. Prochaska,et al.  Stages and processes of self-change of smoking: toward an integrative model of change. , 1983, Journal of consulting and clinical psychology.

[109]  James M. Rehg,et al.  Modeling Opportunities in mHealth Cyber-Physical Systems , 2017, Mobile Health - Sensors, Analytic Methods, and Applications.

[110]  Hyunjin Lee,et al.  Constrained multisine input signals for plant-friendly identification of chemical process systems , 2009 .

[111]  E. A. Locke,et al.  Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. , 2002, The American psychologist.

[112]  M. Reeves,et al.  Seasonal variation in adult leisure-time physical activity. , 2003, Medicine and science in sports and exercise.

[113]  Megan E. Piper,et al.  Evaluating individual intervention components: making decisions based on the results of a factorial screening experiment , 2014, Translational behavioral medicine.

[114]  Diana M. Thomas,et al.  A dynamical systems model for improving gestational weight gain behavioral interventions , 2012, 2012 American Control Conference (ACC).

[115]  Nicole R Morgan,et al.  Changes in Eating and Physical Activity Behaviors Across Seven Semesters of College , 2013, Health education & behavior : the official publication of the Society for Public Health Education.

[116]  Roger Holder,et al.  The effect of walking on risk factors for cardiovascular disease: an updated systematic review and meta-analysis of randomised control trials. , 2015, Preventive medicine.

[117]  Daniel E. Rivera,et al.  System identification of Just Walk: A behavioral mHealth intervention for promoting physical activity , 2017, 2017 American Control Conference (ACC).

[118]  Max Mulder,et al.  The Closed-Loop Dynamics of Cognitive Work , 2013 .

[119]  Ilse de Bourdeaudhuij,et al.  How many steps/day are enough? For older adults and special populations , 2011, The international journal of behavioral nutrition and physical activity.

[120]  Yun Li,et al.  PID control system analysis, design, and technology , 2005, IEEE Transactions on Control Systems Technology.

[121]  Babatunde A. Ogunnaike,et al.  Process Dynamics, Modeling, and Control , 1994 .

[122]  A. Woll,et al.  Tracking physical activity in different settings from late childhood to early adulthood in Germany: the MoMo longitudinal study , 2015, BMC Public Health.

[123]  Lennart Ljung,et al.  Tools for semiphysical modelling , 1995 .

[124]  K. Åström Automatic Control — The Hidden Technology , 1999 .

[125]  L. Collins Optimization of Behavioral, Biobehavioral, and Biomedical Interventions: The Multiphase Optimization Strategy (Most) , 2018 .

[126]  T. Murayi,et al.  Monthly estimates of leisure-time physical inactivity--United States, 1994. , 1997, MMWR. Morbidity and mortality weekly report.

[127]  Ambuj Tewari,et al.  Microrandomized trials: An experimental design for developing just-in-time adaptive interventions. , 2015, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[128]  Predrag V. Klasnja,et al.  Modeling individual differences: A case study of the application of system identification for personalizing a physical activity intervention , 2018, J. Biomed. Informatics.

[129]  Mahmood Karimi,et al.  Human Body Composition Estimation and Model-Free Control Design for Weight Management , 2014 .

[130]  Keith R. Godfrey,et al.  Perturbation signals for system identification , 1993 .

[131]  Inbal Nahum-Shani,et al.  Optimization of behavioral dynamic treatment regimens based on the sequential, multiple assignment, randomized trial (SMART) , 2014, Clinical trials.

[132]  Ambuj Tewari,et al.  Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support , 2017, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[133]  Lauren A. Grieco,et al.  Validation of Physical Activity Tracking via Android Smartphones Compared to ActiGraph Accelerometer: Laboratory-Based and Free-Living Validation Studies , 2015, JMIR mHealth and uHealth.

[134]  Susan A Murphy,et al.  Developing multicomponent interventions using fractional factorial designs , 2009, Statistics in medicine.