Analysis of signaling in a finite stochastic system motivated by decentralized control

Analysis and control of large-scale systems such as interconnected power, biological, communication and traffic networks are limited by the extensive instrumentation required for data gathering, processing and transfer. In this paper, we study the signaling property for decentralized control of finite-state stochastic systems under the Observer-Controller Specialization. The problem is divided into three components: What to send? How to send? and How to control with the received signal?' Solutions are provided to these three problems using concepts and results of control and system theory. An academic example illustrates the approach.

[1]  H. Witsenhausen.  On Information Structures, Feedback and Causality , 1971 .

[2]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[3]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[4]  Todd P. Coleman,et al.  A stochastic control viewpoint on ‘Posterior Matching’-style feedback communication schemes , 2009, 2009 IEEE International Symposium on Information Theory.

[5]  J. Liu,et al.  Decentralized control over analog erasure links , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[6]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[7]  Anant Sahai,et al.  Is Witsenhausen's counterexample a relevant toy? , 2010, 49th IEEE Conference on Decision and Control (CDC).

[8]  Sekhar Tatikonda,et al.  The Capacity of Channels With Feedback , 2006, IEEE Transactions on Information Theory.

[9]  J. Walrand,et al.  On delayed sharing patterns , 1978 .

[10]  Christoforos N. Hadjicostis,et al.  Optimal encoder and control strategies in stochastic control subject to rate constraints for channels with memory and feedback , 2011, IEEE Conference on Decision and Control and European Control Conference.

[11]  S. Mitter,et al.  Information and control: Witsenhausen revisited , 1999 .

[12]  Y. Ho,et al.  Team decision theory and information structures in optimal control problems: Part II , 1971, CDC 1971.

[13]  Tamer Basar,et al.  Optimal Signaling Policies for Decentralized Multicontroller Stabilizability Over Communication Channels , 2007, IEEE Transactions on Automatic Control.

[14]  Ashutosh Nayyar,et al.  Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach , 2012, IEEE Transactions on Automatic Control.

[15]  Shunsuke Ihara,et al.  Information theory - for continuous systems , 1993 .

[16]  N.C. Martins.  Witsenhausen's Counter Example Holds in the Presence of Side Information , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[17]  M. Athans,et al.  A finite-state, finite-memory minimum principle , 1975, 1975 IEEE Conference on Decision and Control including the 14th Symposium on Adaptive Processes.

[18]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[19]  Yu-Chi Ho.  Team decision theory and information structures , 1980, Proceedings of the IEEE.

[20]  Hiroaki Kobayashi,et al.  Controllability under decentralized information structure , 1978 .

[21]  Pulkit Grover,et al.  Actions can speak more clearly than words , 2010 .