Sparse and constrained stochastic predictive control for networked systems

This article presents a novel class of control policies for networked control of Lyapunov-stable linear systems with bounded inputs. The control channel is assumed to have i.i.d. Bernoulli packet dropouts and the system is assumed to be affected by additive stochastic noise. Our proposed class of policies is affine in the past dropouts and saturated values of the past disturbances. We further consider a regularization term in a quadratic performance index to promote sparsity in control. We demonstrate how to augment the underlying optimization problem with a constant negative drift constraint to ensure mean-square boundedness of the closed-loop states, yielding a convex quadratic program to be solved periodically online. The states of the closed-loop plant under the receding horizon implementation of the proposed class of policies are mean square bounded for any positive bound on the control and any non-zero probability of successful transmission.

[1]  E. Gilbert Capacity of a burst-noise channel , 1960 .

[2]  James A. Primbs,et al.  Stochastic Receding Horizon Control of Constrained Linear Systems With State and Control Multiplicative Noise , 2007, IEEE Transactions on Automatic Control.

[3]  John Lygeros,et al.  Stochastic receding horizon control with output feedback and bounded controls , 2012, Autom..

[4]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[5]  M. K. Ghosh,et al.  Discrete-time controlled Markov processes with average cost criterion: a survey , 1993 .

[6]  J. Löfberg,et al.  Approximations of closed-loop minimax MPC , 2003, CDC.

[7]  Daniel E. Quevedo,et al.  Maximum Hands-Off Control: A Paradigm of Control Effort Minimization , 2014, IEEE Transactions on Automatic Control.

[8]  Manuel Mazo,et al.  System Architectures, Protocols and Algorithms for Aperiodic Wireless Control Systems , 2014, IEEE Transactions on Industrial Informatics.

[9]  R. Bhatia Positive Definite Matrices , 2007 .

[10]  Daniel E. Quevedo,et al.  Sparse Packetized Predictive Control for Networked Control Over Erasure Channels , 2013, IEEE Transactions on Automatic Control.

[11]  Richard D. Braatz,et al.  Stochastic model predictive control with joint chance constraints , 2015, Int. J. Control.

[12]  Julien Mairal,et al.  Convex optimization with sparsity-inducing norms , 2011 .

[13]  Manfred Morari,et al.  Stochastic Model Predictive Control for Building Climate Control , 2014, IEEE Transactions on Control Systems Technology.

[14]  Daniel E. Quevedo,et al.  Stability of Sequence-Based Control With Random Delays and Dropouts , 2014, IEEE Transactions on Automatic Control.

[15]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[16]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[17]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[18]  John Lygeros,et al.  Chance-constrained LQG with bounded control policies , 2013, 52nd IEEE Conference on Decision and Control.

[19]  Takeki Ogitsu,et al.  State Observation and Communication for Cloud Vehicle Control , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[20]  Milan Korda,et al.  Nonquadratic stochastic model predictive control: A tractable approach , 2012, Autom..

[21]  Daniel E. Quevedo,et al.  Stable Stochastic Predictive Control Under Control Channel Erasures , 2016 .

[22]  Kim-Chuan Toh,et al.  On the Implementation and Usage of SDPT3 – A Matlab Software Package for Semidefinite-Quadratic-Linear Programming, Version 4.0 , 2012 .

[23]  John Lygeros,et al.  On Stability and Performance of Stochastic Predictive Control Techniques , 2013, IEEE Transactions on Automatic Control.

[24]  Debasish Chatterjee,et al.  Event triggered green control for discrete time dynamical systems , 2015, 2015 European Control Conference (ECC).

[25]  Ali Saberi,et al.  Internal and External Stabilization of Linear Systems with Constraints , 2012 .

[26]  N. Surti Prologue , 2012, Journal of pharmacy & bioallied sciences.

[27]  Daniel E. Quevedo,et al.  State Estimation Over Sensor Networks With Correlated Wireless Fading Channels , 2013, IEEE Transactions on Automatic Control.

[28]  John Lygeros,et al.  On mean square boundedness of stochastic linear systems with bounded controls , 2012, Syst. Control. Lett..

[29]  John Lygeros,et al.  Stochastic Receding Horizon Control With Bounded Control Inputs: A Vector Space Approach , 2009, IEEE Transactions on Automatic Control.

[30]  Daniel E. Quevedo,et al.  Stabilizing Stochastic Predictive Control Under Bernoulli Dropouts , 2016, IEEE Transactions on Automatic Control.

[31]  Elana Guslitser UNCERTAINTY- IMMUNIZED SOLUTIONS IN LINEAR PROGRAMMING , 2002 .

[32]  Debasish Chatterjee,et al.  Resource efficient stochastic predictive control under packet dropouts , 2017 .

[33]  W. P. M. H. Heemels,et al.  Output-based event-triggered control with Guaranteed ℒ∞-gain and improved event-triggering , 2010, 49th IEEE Conference on Decision and Control (CDC).

[34]  Daniel E. Quevedo,et al.  Packetized MPC with dynamic scheduling constraints and bounded packet dropouts , 2014, Autom..

[35]  Richard D. Braatz,et al.  Stochastic model predictive control with joint chance constraints , 2015, Int. J. Control.

[36]  Francesco Borrelli,et al.  Bilinear Model Predictive Control of a HVAC System Using Sequential Quadratic Programming , 2011 .

[37]  A. Ben-Tal,et al.  Adjustable robust solutions of uncertain linear programs , 2004, Math. Program..

[38]  John Lygeros,et al.  On stochastic receding horizon control with bounded control inputs , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[39]  Daniel E. Quevedo,et al.  Stable stochastic predictive controller under unreliable up-link , 2016, 2016 European Control Conference (ECC).

[40]  W. P. M. H. Heemels,et al.  Output-Based Event-Triggered Control With Guaranteed ${\cal L}_{\infty}$-Gain and Improved and Decentralized Event-Triggering , 2012, IEEE Transactions on Automatic Control.

[41]  Daniel E. Quevedo,et al.  Stochastic Stability of Event-Triggered Anytime Control , 2013, IEEE Transactions on Automatic Control.

[42]  Farrokh Janabi-Sharifi,et al.  Theory and applications of HVAC control systems – A review of model predictive control (MPC) , 2014 .

[43]  Antonio Pedro Aguiar,et al.  Optimization based control for target estimation and tracking via highly observable trajectories , 2015 .

[44]  Tamer Basar,et al.  Sparsity based feedback design: A new paradigm in opportunistic sensing , 2011, Proceedings of the 2011 American Control Conference.

[45]  Eduardo Sontag,et al.  Global stabilization of linear discrete-time systems with bounded feedback , 1997 .

[46]  Ilya Kolmanovsky,et al.  H∞ Filtering for Cloud-Aided Semi-active Suspension with Delayed Road Information , 2015 .

[47]  John Lygeros,et al.  Mean-square boundedness of stochastic networked control systems with bounded control inputs , 2010, 49th IEEE Conference on Decision and Control (CDC).

[48]  Yi Yang,et al.  Sequential Convex Approximations to Joint Chance Constrained Programs: A Monte Carlo Approach , 2011, Oper. Res..

[49]  Karl Henrik Johansson,et al.  Randomized Model Predictive Control for HVAC Systems , 2013, BuildSys@SenSys.

[50]  Stefan Streif,et al.  Stability for receding-horizon stochastic model predictive control , 2014, 2015 American Control Conference (ACC).

[51]  Jim Kurose,et al.  Computer Networking: A Top-Down Approach , 1999 .

[52]  O. Bosgra,et al.  A conic reformulation of Model Predictive Control including bounded and stochastic disturbances under state and input constraints , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[53]  Prabhat Kumar Mishra,et al.  Dropout feedback parametrized policies for stochastic predictive controller , 2016 .

[54]  Eric C. Kerrigan,et al.  Optimization over state feedback policies for robust control with constraints , 2006, Autom..

[55]  Ella M. Atkins,et al.  Cloud aided semi-active suspension control , 2014, 2014 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS).

[56]  Daniel E. Quevedo,et al.  Robust stability of packetized predictive control of nonlinear systems with disturbances and Markovian packet losses , 2012, Autom..

[57]  Arkadi Nemirovski,et al.  On Safe Tractable Approximations of Chance-Constrained Linear Matrix Inequalities , 2009, Math. Oper. Res..

[58]  Roger J.-B. Wets,et al.  On decision rules in stochastic programming , 1974, Math. Program..

[59]  Y. Bar-Shalom,et al.  Dual effect, certainty equivalence, and separation in stochastic control , 1974 .

[60]  Rolf Findeisen,et al.  Distributed control of interconnected systems with lossy communication networks , 2013 .

[61]  Daniel E. Quevedo,et al.  A Stochastic Model Predictive Controller for Systems with Unreliable Communications , 2015 .

[62]  John Lygeros,et al.  Convexity and convex approximations of discrete-time stochastic control problems with constraints , 2011, Autom..