Optimal Local and Remote Controllers With Unreliable Uplink Channels

We consider a networked control system consisting of a remote controller and a collection of linear plants, each associated with a local controller. Each local controller directly observes the state of its colocated plant and can inform the remote controller of the plant's state through an unreliable uplink channel. We assume that the downlink channels from the remote controller to local controllers are perfect. The objective of the local controllers and the remote controller is to cooperatively minimize a quadratic performance cost. We provide a dynamic program for this decentralized control problem using the common information approach. Although our problem is not a partially nested problem, we obtain explicit optimal strategies for all controllers. In the optimal strategies, all controllers compute common estimates of the states of the plants based on the common information obtained from the communication network. The remote controller's action is linear in the common state estimates, and the action of each local controller is linear in both the actual state of its colocated plant and the common state estimates. We illustrate our results with numerical experiments using randomly generated models.

[1]  K. Poolla,et al.  Optimal Linear LQG Control Over Lossy Networks Without Packet Acknowledgment , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[2]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[3]  O. Kallenberg Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[4]  Mo-Yuen Chow,et al.  Networked Control System: Overview and Research Trends , 2010, IEEE Transactions on Industrial Electronics.

[5]  Dimitri P. Bertsekas,et al.  Stochastic optimal control : the discrete time case , 2007 .

[6]  Sanjay Lall,et al.  A dynamic programming algorithm for decentralized Markov decision processes with a broadcast structure , 2010, 49th IEEE Conference on Decision and Control (CDC).

[7]  Tamer Basar,et al.  Optimal Strategies for Communication and Remote Estimation With an Energy Harvesting Sensor , 2012, IEEE Transactions on Automatic Control.

[8]  Subhrakanti Dey,et al.  Optimal Energy Allocation for Kalman Filtering Over Packet Dropping Links With Imperfect Acknowledgments and Energy Harvesting Constraints , 2014, IEEE Transactions on Automatic Control.

[9]  Nuno C. Martins,et al.  Optimal memoryless control in Gaussian noise: A simple counterexample , 2011, Autom..

[10]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.

[11]  Ashutosh Nayyar,et al.  Structural results for partially nested LQG systems over graphs , 2015, 2015 American Control Conference (ACC).

[12]  Subhrakanti Dey,et al.  Optimal sensor transmission energy allocation for linear control over a packet dropping link with energy harvesting , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[13]  Seyed Mohammad Asghari,et al.  Dynamic Teams and Decentralized Control Problems With Substitutable Actions , 2016, IEEE Transactions on Automatic Control.

[14]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[15]  Richard M. Murray,et al.  Data Transmission Over Networks for Estimation and Control , 2009, IEEE Transactions on Automatic Control.

[16]  Tamer Basar,et al.  Optimal control of LTI systems over unreliable communication links , 2006, Autom..

[17]  Karl Henrik Johansson,et al.  Separated Design of Encoder and Controller for Networked Linear Quadratic Optimal Control , 2016, SIAM J. Control. Optim..

[18]  Pablo A. Parrilo,et al.  ℋ2-optimal decentralized control over posets: A state space solution for state-feedback , 2010, 49th IEEE Conference on Decision and Control (CDC).

[19]  Pablo A. Parrilo,et al.  $ {\cal H}_{2}$-Optimal Decentralized Control Over Posets: A State-Space Solution for State-Feedback , 2010, IEEE Transactions on Automatic Control.

[20]  Wei Zhang,et al.  Stability of networked control systems , 2001 .

[21]  Peter J Seiler,et al.  Coordinated Control of Unmanned Aerial Vehicles , 2001 .

[22]  Y. Ho,et al.  Team decision theory and information structures in optimal control problems--Part II , 1972 .

[23]  John N. Tsitsiklis,et al.  A survey of computational complexity results in systems and control , 2000, Autom..

[24]  Vijay Gupta,et al.  On estimation across analog erasure links with and without acknowledgements , 2010, Proceedings of the 2010 American Control Conference.

[25]  Xuemin Shen,et al.  Connected Vehicles: Solutions and Challenges , 2014, IEEE Internet of Things Journal.

[26]  Ashutosh Nayyar,et al.  Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach , 2012, IEEE Transactions on Automatic Control.

[27]  Ashutosh Nayyar,et al.  Structural results and explicit solution for two-player LQG systems on a finite time horizon , 2013, 52nd IEEE Conference on Decision and Control.

[28]  Sanjay Lall,et al.  Synthesis for optimal two-player decentralized control over TCP erasure channels with state feedback , 2011, IEEE Conference on Decision and Control and European Control Conference.

[29]  Ashutosh Nayyar,et al.  Sufficient Statistics for Linear Control Strategies in Decentralized Systems With Partial History Sharing , 2015, IEEE Transactions on Automatic Control.

[30]  Emanuele Garone,et al.  LQG control over lossy TCP-like networks with probabilistic packet acknowledgements , 2010 .

[31]  Aditya Mahajan,et al.  Optimal Decentralized Control of Coupled Subsystems With Control Sharing , 2011, IEEE Transactions on Automatic Control.

[32]  Yi Ouyang,et al.  Optimal local and remote controllers with unreliable communication , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[33]  R. Horowitz,et al.  Control design of an automated highway system , 2000, Proceedings of the IEEE.

[34]  Srdjan S. Stankovic,et al.  Decentralized overlapping control of a platoon of vehicles , 2000, IEEE Trans. Control. Syst. Technol..

[35]  John Doyle,et al.  On the structure of state-feedback LQG controllers for distributed systems with communication delays , 2011, IEEE Conference on Decision and Control and European Control Conference.

[36]  Sanjay Lall,et al.  Optimal Control of Two-Player Systems With Output Feedback , 2013, IEEE Transactions on Automatic Control.

[37]  Seyed Mohammad Asghari,et al.  Decentralized control problems with substitutable actions , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[38]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[39]  R. Radner,et al.  Team Decision Problems , 1962 .

[40]  Nuno C. Martins,et al.  Remote State Estimation With Communication Costs for First-Order LTI Systems , 2011, IEEE Transactions on Automatic Control.

[41]  Richard M. Murray,et al.  Optimal LQG control across packet-dropping links , 2007, Syst. Control. Lett..

[42]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[43]  Sanjay Lall,et al.  A Characterization of Convex Problems in Decentralized Control$^ast$ , 2005, IEEE Transactions on Automatic Control.

[44]  N. Elia,et al.  Limitations of linear remote control over packet drop networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[45]  Tamer Basar,et al.  Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints , 2013 .

[46]  Swaroop Darbha,et al.  Direct adaptive longitudinal control of vehicle platoons , 2001, IEEE Trans. Veh. Technol..

[47]  John S. Baras,et al.  Optimal Output Feedback Control Using Two Remote Sensors Over Erasure Channels , 2009, IEEE Transactions on Automatic Control.

[48]  Serdar Yüksel,et al.  Stochastic Nestedness and the Belief Sharing Information Pattern , 2009, IEEE Transactions on Automatic Control.

[49]  Sanjay Lall,et al.  An explicit solution for optimal two-player decentralized control over TCP erasure channels with state feedback , 2011, Proceedings of the 2011 American Control Conference.

[50]  S. Sastry,et al.  Optimal control with unreliable communication: the TCP case , 2005, Proceedings of the 2005, American Control Conference, 2005..

[51]  Sandra Hirche,et al.  On the Optimality of Certainty Equivalence for Event-Triggered Control Systems , 2013, IEEE Transactions on Automatic Control.

[52]  Laurent Lessard Decentralized LQG control of systems with a broadcast architecture , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).