Joint Cross-Layer Optimization in Real-Time Networked Control Systems

Networked control system (NCS) refers to a set of control loops that are closed over a communication network. In this article, the joint operation of control and networking for NCS is investigated wherein the network serves the sensor-to-controller communication links for multiple stochastic linear time-invariant (LTI) subsystems. The sensors sample packets based on the observed plant state, which they send over a shared multihop network. The network has limited communication resources, which need to be assigned to competing links to support proper control loop operation. In this setup, we formulate an optimization problem to minimize the weighted-sum linear-quadratic-Gaussian cost of all loops, taking into account the admissible sampling, control, congestion control (CC), and scheduling policies. Under some mild assumptions on the sampling frequencies of the control loops and the communication network, we find the joint optimal solution to be given by a certainty equivalence control with a threshold-based sampling policy, as well as a back-pressure-type scheduler with a simple pass-through CC. The interface between network and control loops is identified to be the buffer state of the sensor node, which can be interpreted as network price for sampling a packet from the control perspective. We validate our theoretical claims by simulating NCSs comprised of multiple LTI stochastic control loops communicating over a two-hop cellular network.

[1]  G. Boggia,et al.  Toward wireless Networked Control Systems: An experimental study on real-time communications in 802.11 WLANs , 2008, 2008 IEEE International Workshop on Factory Communication Systems.

[2]  Shivendra S. Panwar,et al.  CSMAC: A New Centralized Scheduling-Based MAC Protocol for Wireless LAN , 2009, 2009 IEEE Wireless Communications and Networking Conference.

[3]  John M. Cioffi,et al.  Weighted Sum-Rate Maximization Using Weighted MMSE for MIMO-BC Beamforming Design , 2008, 2009 IEEE International Conference on Communications.

[4]  Pablo Pavón Mariño,et al.  Optimization of Computer Networks: Modeling and Algorithms: A Hands-On Approach , 2016 .

[5]  A. Goldsmith,et al.  Wireless network design for distributed control , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[6]  Tamer Basar,et al.  Optimal control with limited control actions and lossy transmissions , 2008, 2008 47th IEEE Conference on Decision and Control.

[7]  Lei Shu,et al.  Efficient Medium Access Control for Cyber–Physical Systems With Heterogeneous Networks , 2015, IEEE Systems Journal.

[8]  Alejandro Ribeiro,et al.  Control Aware Radio Resource Allocation in Low Latency Wireless Control Systems , 2018, IEEE Internet of Things Journal.

[9]  Ling Shi,et al.  Event-Based Sensor Data Scheduling: Trade-Off Between Communication Rate and Estimation Quality , 2013, IEEE Transactions on Automatic Control.

[10]  Sandra Hirche,et al.  Robust event-based data scheduling for resource constrained Networked Control Systems , 2015, 2015 American Control Conference (ACC).

[11]  Alejandro Ribeiro,et al.  Control-Aware Random Access Communication , 2016, 2016 ACM/IEEE 7th International Conference on Cyber-Physical Systems (ICCPS).

[12]  Sandra Hirche,et al.  Optimal design of decentralized event-triggered controllers for large-scale systems with contention-based communication , 2011, IEEE Conference on Decision and Control and European Control Conference.

[13]  Oghenekome Oteri,et al.  Optimal resource allocation in uplink SC-FDMA systems , 2009, IEEE Transactions on Wireless Communications.

[14]  A. Robert Calderbank,et al.  Layering as Optimization Decomposition: A Mathematical Theory of Network Architectures , 2007, Proceedings of the IEEE.

[15]  Chenyang Lu,et al.  Wireless Routing and Control: A Cyber-Physical Case Study , 2016, 2016 ACM/IEEE 7th International Conference on Cyber-Physical Systems (ICCPS).

[16]  Sandra Hirche,et al.  On the Optimality of Certainty Equivalence for Event-Triggered Control Systems , 2013, IEEE Transactions on Automatic Control.

[17]  Wei Zhang,et al.  Scheduling and feedback co-design for networked control systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[18]  Wei Zhang,et al.  Stability of networked control systems , 2001 .

[19]  Wolfgang Kellerer,et al.  Adaptive Decentralized MAC for Event-Triggered Networked Control Systems , 2016, HSCC.

[20]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[21]  John S. Baras,et al.  Adaptive Sampling for Linear State Estimation , 2009, SIAM J. Control. Optim..

[22]  Hong Ye,et al.  Scheduling of networked control systems , 2001 .

[23]  Sandra Hirche,et al.  Price-Based Adaptive Scheduling in Multi-Loop Control Systems With Resource Constraints , 2014, IEEE Transactions on Automatic Control.

[24]  R. Srikant,et al.  Maximizing Sum Rate and Minimizing MSE on Multiuser Downlink: Optimality, Fast Algorithms and Equivalence via Max-min SINR , 2011, IEEE Transactions on Signal Processing.

[25]  Daniel E. Quevedo,et al.  Energy Efficient State Estimation With Wireless Sensors Through the Use of Predictive Power Control and Coding , 2010, IEEE Transactions on Signal Processing.

[26]  Onésimo Hernández-Lerma,et al.  The Scalarization Approach to Multiobjective Markov Control Problems: Why Does It Work? , 2004 .

[27]  Roy D. Yates,et al.  Status updates through queues , 2012, 2012 46th Annual Conference on Information Sciences and Systems (CISS).

[28]  Leandros Tassiulas,et al.  Resource Allocation and Cross-Layer Control in Wireless Networks , 2006, Found. Trends Netw..

[29]  Stephen P. Boyd,et al.  Joint optimization of communication rates and linear systems , 2003, IEEE Trans. Autom. Control..

[30]  Peter F. Al-Hokayem Stability Analysis of Networked Control Systems , 2003 .

[31]  Giuseppe Caire,et al.  An iterative water-filling algorithm for maximum weighted sum-rate of Gaussian MIMO-BC , 2006, IEEE Journal on Selected Areas in Communications.

[32]  Sandra Hirche,et al.  Decentralized event-based scheduling for shared-resource Networked Control Systems , 2015, 2015 European Control Conference (ECC).

[33]  Sandra Hirche,et al.  An Optimal LQG Controller for Stochastic Event-triggered Scheduling over a Lossy Communication Network , 2018 .

[34]  Tamer Basar,et al.  Optimal Strategies for Communication and Remote Estimation With an Energy Harvesting Sensor , 2012, IEEE Transactions on Automatic Control.

[35]  Gerhard Wunder,et al.  Predictive Network Control and Throughput Sub-Optimality of Max Weight , 2018, 2018 European Conference on Networks and Communications (EuCNC).

[36]  JhaRakesh Kumar,et al.  Device-to-Device Communication in Cellular Networks , 2016 .

[37]  John S. Baras,et al.  Optimal LQG Control Under Delay-Dependent Costly Information , 2018, IEEE Control Systems Letters.

[38]  R. Srikant,et al.  A tutorial on cross-layer optimization in wireless networks , 2006, IEEE Journal on Selected Areas in Communications.

[39]  Upendra Dave,et al.  Applied Probability and Queues , 1987 .

[40]  Sandra Hirche,et al.  On LQG joint optimal scheduling and control under communication constraints , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[41]  Sandra Hirche,et al.  Structural characterization of optimal event-based controllers for linear stochastic systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[42]  Brian L. Evans,et al.  Optimal Downlink OFDMA Resource Allocation with Linear Complexity to Maximize Ergodic Rates , 2008, IEEE Transactions on Wireless Communications.

[43]  Nuno C. Martins,et al.  Remote State Estimation With Communication Costs for First-Order LTI Systems , 2011, IEEE Transactions on Automatic Control.

[44]  Nathan van de Wouw,et al.  Networked control systems with communication constraints: Tradeoffs between transmission intervals and delays , 2009, 2009 European Control Conference (ECC).

[45]  Karl Henrik Johansson,et al.  Design of State-Based Schedulers for a Network of Control Loops , 2012, IEEE Transactions on Automatic Control.