Optimizing controller location in networked control systems with packet drops

In networked control, there is locational freedom in choosing the node at which to locate the controller, so as to mitigate the effects of packet losses in the network. What is the optimal location for the placement of the control logic? Second, what is the optimal control law in that position? The difficulty in answering these two questions is that analysis of optimality in networked control systems subject to random packet drops suffers from Witsenhausen's 'non-classical information pattern'. Thus, the general problem is considered intractable. We make headway on this problem by using a "Long Packet Assumption", LPA, which allows packets to be arbitrarily long. This is not intended for implementation, but only to develop a lower bound on the cost. In particular, under this assumption the optimal controller location can be shown to be collocated with the actuator. For this position, under the LPA, we can also calculate the optimal cost, which is then a lower bound on the optimal cost for the original problem for all locations. Despite the apparent strength of the LPA, we have found that this lower bound is often close to currently realizable upper bounds. This establishes the near optimality of currently implementable controllers in such instances. Using the lower bound on cost we obtain a necessary condition for stabilizability over all controller locations. This condition matches known sufficient conditions for some special cases, thus establishing a necessary and sufficient condition for location optimized stabilizability of networked control systems with packet loss.

[1]  Girish Baliga,et al.  A middleware framework for networked control systems , 2005 .

[2]  Tamer Basar,et al.  Optimal control of LTI systems over unreliable communication links , 2006, Autom..

[3]  J.P. Hespanha,et al.  Estimation under uncontrolled and controlled communications in Networked Control Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[4]  T. Katayama On the matrix Riccati equation for linear systems with random gain , 1976 .

[5]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[6]  Linda Bushnell,et al.  Stability analysis of networked control systems , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[7]  Y. Ho,et al.  Team decision theory and information structures in optimal control problems--Part II , 1972 .

[8]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[9]  Y. Tipsuwan,et al.  Network-based control systems: a tutorial , 2001, IECON'01. 27th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.37243).

[10]  G. Baliga,et al.  Middleware and Abstractions in the Convergence of Control with Communication and Computation , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[11]  Donald L. Snyder,et al.  How to track a swarm of fireflies by observing their flashes (Corresp.) , 1975, IEEE Trans. Inf. Theory.

[12]  B. Azimi-Sadjadi,et al.  Stability of networked control systems in the presence of packet losses , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[13]  Umit Ozguner,et al.  Closed-loop control of systems over a communication network with queues , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[14]  Tamer Basar,et al.  Optimal control of dynamical systems over unreliable communication links , 2004 .

[15]  Panos J. Antsaklis,et al.  Special Issue on Technology of Networked Control Systems , 2007 .

[16]  J. Tsitsiklis,et al.  Intractable problems in control theory , 1986 .

[17]  Panganamala Ramana Kumar,et al.  Control over Networks of Unreliable Links: Controller Location and Performance Bounds , 2007, 2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops.

[18]  S. Sastry,et al.  Optimal control with unreliable communication: the TCP case , 2005, Proceedings of the 2005, American Control Conference, 2005..

[19]  G. Baliga,et al.  A Middleware for Control over Networks , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[20]  Lui Sha,et al.  Service Continuity in Networked Control Using Etherware , 2004, IEEE Distributed Syst. Online.

[21]  Babak Hassibi,et al.  On LQG control across a stochastic packet-dropping link , 2005, Proceedings of the 2005, American Control Conference, 2005..

[22]  Yu-Chi Ho,et al.  Correction to "Team decision theory and information structures in optimal control problems," Parts I and II , 1972 .

[23]  Johan Nilsson,et al.  Stochastic Analysis and Control of Real-Time Systems with Random Time Delays , 1996 .

[24]  A. Goldsmith,et al.  Kalman filtering with partial observation losses , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[25]  G. Baliga,et al.  Issues in the convergence of control with communication and computing: proliferation, architecture, design, services, and middleware , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[26]  Richard M. Murray,et al.  Optimal LQG control across packet-dropping links , 2007, Syst. Control. Lett..

[27]  Peter J Seiler,et al.  Analysis of communication losses in vehicle control problems , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[28]  Lui Sha,et al.  Etherware: domainware for wireless control networks , 2004, Seventh IEEE International Symposium onObject-Oriented Real-Time Distributed Computing, 2004. Proceedings..

[29]  I. Rhodes,et al.  Estimation and control performance for space-time point-process observations , 1977 .

[30]  Bonaventure Intercontinental,et al.  ON DECISION AND CONTROL , 1985 .

[31]  Peter E. Caines,et al.  Stochastic optimal control under Poisson-distributed observations , 2000, IEEE Trans. Autom. Control..

[32]  Panganamala Ramana Kumar,et al.  Sending the most recent observation is not optimal in networked control: Linear temporal coding and towards the design of a control specific transport protocol , 2007, 2007 46th IEEE Conference on Decision and Control.

[33]  J.P. Hespanha,et al.  Optimal communication logics in networked control systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).