Stochastic predictive control under intermittent observations and unreliable actions

We propose a provably stabilizing and tractable approach for control of constrained linear systems under intermittent observations and unreliable transmissions of control commands. A smart sensor equipped with a Kalman filter is employed for the estimation of the states from incomplete and corrupt measurements, and an estimator at the controller side optimally feeds the intermittently received sensor data to the controller. The remote controller iteratively solves constrained stochastic optimal control problems and transmits the control commands according to a carefully designed transmission protocol through an unreliable channel. We present a (globally) recursively feasible quadratic program, which is solved online to yield a stabilizing controller for Lyapunov stable linear time invariant systems under any positive bound on control values and any non-zero transmission probabilities of Bernoulli channels.

[1]  Rolf Findeisen,et al.  Compensating network delays and information loss by predictive control methods , 2009, 2009 European Control Conference (ECC).

[2]  Lihua Xie,et al.  Optimal linear estimation for systems with multiple packet dropouts , 2008, Autom..

[3]  H. M. Newman.  Integrating building automation and control products using the BACnet protocol , 1996 .

[4]  E. Gilbert.  Capacity of a burst-noise channel , 1960 .

[5]  James A. Primbs,et al.  Stochastic Receding Horizon Control of Constrained Linear Systems With State and Control Multiplicative Noise , 2007, IEEE Transactions on Automatic Control.

[6]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[7]  A. V. Balakrishnan,et al.  Kalman Filtering Theory , 1984 .

[8]  J. Lygeros,et al.  Stochastic MPC with Imperfect State Information and Bounded Controls , 2010 .

[9]  Daniel E. Quevedo,et al.  Input-to-State Stability of Packetized Predictive Control Over Unreliable Networks Affected by Packet-Dropouts , 2011, IEEE Transactions on Automatic Control.

[10]  D. Limón,et al.  Application to a drinking water network of robust periodic MPC , 2016 .

[11]  Alberto Bemporad,et al.  GPU-Accelerated Stochastic Predictive Control of Drinking Water Networks , 2016, IEEE Transactions on Control Systems Technology.

[12]  Francesco Bullo,et al.  On Kalman Filtering for Detectable Systems With Intermittent Observations , 2009, IEEE Transactions on Automatic Control.

[13]  John Lygeros,et al.  Stochastic receding horizon control with output feedback and bounded controls , 2012, Autom..

[14]  John Lygeros,et al.  On mean square boundedness of stochastic linear systems with bounded controls , 2012, Syst. Control. Lett..

[15]  Richard M. Murray,et al.  Data Transmission Over Networks for Estimation and Control , 2009, IEEE Transactions on Automatic Control.

[16]  Daniel E. Quevedo,et al.  Stabilizing Stochastic Predictive Control Under Bernoulli Dropouts , 2016, IEEE Transactions on Automatic Control.

[17]  Joel A. Paulson,et al.  Stochastic model predictive control - how does it work? , 2017, Comput. Chem. Eng..

[18]  Thomas Parisini,et al.  Networked Predictive Control of Uncertain Constrained Nonlinear Systems: Recursive Feasibility and Input-to-State Stability Analysis , 2011, IEEE Transactions on Automatic Control.

[19]  S. Shirmohammadi,et al.  Evaluating decorators for haptic collaboration over Internet , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing.

[20]  Debasish Chatterjee,et al.  Resource efficient stochastic predictive control under packet dropouts , 2017 .

[21]  Richard M. Murray,et al.  Optimal LQG control across packet-dropping links , 2007, Syst. Control. Lett..

[22]  Peter J Seiler,et al.  Analysis of communication losses in vehicle control problems , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[23]  John Lygeros,et al.  Attaining Mean Square Boundedness of a Marginally Stable Stochastic Linear System With a Bounded Control Input , 2009, IEEE Transactions on Automatic Control.

[24]  Gaurav S. Sukhatme,et al.  Haptic Collaboration over the Internet , 2000 .

[25]  Ling Shi,et al.  Power Control of an Energy Harvesting Sensor for Remote State Estimation , 2017, IEEE Transactions on Automatic Control.

[26]  John Lygeros,et al.  On stochastic receding horizon control with bounded control inputs , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[27]  Alberto Bemporad,et al.  Predictive Control for Linear and Hybrid Systems , 2017 .

[28]  Richard D. Braatz,et al.  Stochastic model predictive control with joint chance constraints , 2015, Int. J. Control.

[29]  Daniel E. Quevedo,et al.  Output Feedback Stable Stochastic Predictive Control With Hard Control Constraints , 2017, IEEE Control Systems Letters.

[30]  Daniel E. Quevedo,et al.  Robust stability of packetized predictive control of nonlinear systems with disturbances and Markovian packet losses , 2012, Autom..

[31]  Daniel E. Quevedo,et al.  Multiple descriptions for packetized predictive control , 2016, EURASIP J. Adv. Signal Process..

[32]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[33]  Sheng Chen,et al.  Stability of Networked Control Systems With Polytopic Uncertainty and Buffer Constraint , 2010, IEEE Transactions on Automatic Control.

[34]  Jim Kurose,et al.  Computer Networking: A Top-Down Approach , 1999 .

[35]  Ling Shi,et al.  Kalman Filtering Over a Packet-Dropping Network: A Probabilistic Perspective , 2010, IEEE Transactions on Automatic Control.

[36]  Daniel E. Quevedo,et al.  Sparse and constrained stochastic predictive control for networked systems , 2017, Autom..

[37]  John Lygeros,et al.  Stochastic Receding Horizon Control With Bounded Control Inputs: A Vector Space Approach , 2009, IEEE Transactions on Automatic Control.

[38]  A. Mesbah,et al.  Stochastic Model Predictive Control: An Overview and Perspectives for Future Research , 2016, IEEE Control Systems.

[39]  John Lygeros,et al.  Stable Networked Control Systems With Bounded Control Authority , 2012, IEEE Transactions on Automatic Control.

[40]  Robert R. Bitmead,et al.  Stochastic output-feedback model predictive control , 2018, Autom..

[41]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[42]  Daniel E. Quevedo,et al.  State Estimation Over Sensor Networks With Correlated Wireless Fading Channels , 2013, IEEE Transactions on Automatic Control.

[43]  R. Pemantle,et al.  Moment conditions for a sequence with negative drift to be uniformly bounded in Lr , 1999, math/0404093.

[44]  Richard M. Murray,et al.  State estimation over packet dropping networks using multiple description coding , 2006, Autom..

[45]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[46]  John Lygeros,et al.  Chance-constrained LQG with bounded control policies , 2013, 52nd IEEE Conference on Decision and Control.

[47]  Kaoru Sezaki,et al.  The evaluation of delay jitter for haptics collaboration over the Internet , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[48]  Soummya Kar,et al.  Kalman Filtering With Intermittent Observations: Weak Convergence to a Stationary Distribution , 2009, IEEE Transactions on Automatic Control.

[49]  Wen-an Zhang,et al.  Moving Horizon Estimation for Networked Systems With Quantized Measurements and Packet Dropouts , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[50]  Jürgen Pannek,et al.  A prediction based control scheme for networked systems with delays and packet dropouts , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[51]  Kim-Chuan Toh,et al.  On the Implementation and Usage of SDPT3 – A Matlab Software Package for Semidefinite-Quadratic-Linear Programming, Version 4.0 , 2012 .

[52]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[53]  Eduardo Sontag,et al.  Global stabilization of linear discrete-time systems with bounded feedback , 1997 .

[54]  John Lygeros,et al.  Mean-square boundedness of stochastic networked control systems with bounded control inputs , 2010, 49th IEEE Conference on Decision and Control (CDC).

[55]  Robert R. Bitmead,et al.  Escape time formulation of state estimation and stabilization with quantized intermittent communication , 2015, Autom..

[56]  O. Bosgra,et al.  A full solution to the constrained stochastic closed-loop MPC problem via state and innovations feedback and its receding horizon implementation , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).