Hybrid model predictive control for sequential decision policies in adaptive behavioral interventions

Control engineering offers a systematic and efficient method to optimize the effectiveness of individually tailored treatment and prevention policies known as adaptive or “just-in-time” behavioral interventions. The nature of these interventions requires assigning dosages at categorical levels, which has been addressed in prior work using Mixed Logical Dynamical (MLD)-based hybrid model predictive control (HMPC) schemes. However, certain requirements of adaptive behavioral interventions that involve sequential decision making have not been comprehensively explored in the literature. This paper presents an extension of the traditional MLD framework for HMPC by representing the requirements of sequential decision policies as mixed-integer linear constraints. This is accomplished with user-specified dosage sequence tables, manipulation of one input at a time, and a switching time strategy for assigning dosages at time intervals less frequent than the measurement sampling interval. A model developed for a gestational weight gain (GWG) intervention is used to illustrate the generation of these sequential decision policies and their effectiveness for implementing adaptive behavioral interventions involving multiple components.

[1]  Susan A. Murphy,et al.  A Conceptual Framework for Adaptive Preventive Interventions , 2004, Prevention Science.

[2]  D. Rivera,et al.  Using engineering control principles to inform the design of adaptive interventions: a conceptual introduction. , 2007, Drug and alcohol dependence.

[3]  M. Morari,et al.  Move blocking strategies in receding horizon control , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[4]  Misha Pavel,et al.  Mobile Health: Revolutionizing Healthcare Through Transdisciplinary Research , 2013, Computer.

[5]  Daniel E. Rivera,et al.  An Improved Formulation of Hybrid Model Predictive Control With Application to Production-Inventory Systems , 2013, IEEE Transactions on Control Systems Technology.

[6]  Andreas Beyerlein,et al.  Optimal gestational weight gain ranges for the avoidance of adverse birth weight outcomes: a novel approach. , 2009, The American journal of clinical nutrition.

[7]  Ann L. Yaktine,et al.  Weight Gain During Pregnancy , 2009 .

[8]  Diana M. Thomas,et al.  Hybrid model predictive control for optimizing gestational weight gain behavioral interventions , 2013, 2013 American Control Conference.

[9]  Daniel E. Davison,et al.  A control-theory reward-based approach to behavior modification in the presence of social-norm pressure and conformity pressure , 2012, 2012 American Control Conference (ACC).

[10]  Diana M. Thomas,et al.  A dynamical systems model for improving gestational weight gain behavioral interventions , 2012, 2012 American Control Conference (ACC).

[11]  Daniel E. Rivera,et al.  A control engineering approach for designing an optimized treatment plan for fibromyalgia , 2011, Proceedings of the 2011 American Control Conference.

[12]  Susan A Murphy,et al.  Customizing treatment to the patient: adaptive treatment strategies. , 2007, Drug and alcohol dependence.

[13]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[14]  Peter R. Giacobbi,et al.  Exploring Behavioral Markers of Long-Term Physical Activity Maintenance , 2013, Health education & behavior : the official publication of the Society for Public Health Education.