Informative windowed forecasting of continuous-time linear systems for mutual information-based sensor planning

This paper presents an expression of mutual information that defines the information gain in planning of sensing resources, when the goal is to reduce the forecast uncertainty of some quantities of interest and the system dynamics is described as a continuous-time linear system. The method extends the smoother approach in Choi and How (2010b) to handle a more general notion of the verification entity-continuous sequence of variables over some finite time window in the future. The expression of mutual information for this windowed forecasting case is derived and quantified, taking advantage of an underlying conditional independence structure and utilizing a two-filter formula for fixed-interval smoothing with correlated noises. Two numerical examples on (a) a two-state linear system with time-varying one-way coupling dynamics, and (b) idealized weather forecasting with moving verification paths demonstrate the validity of the proposed quantification methodology.

[1]  Han-Lim Choi,et al.  Efficient Targeting of Sensor Networks for Large-Scale Systems , 2011, IEEE Transactions on Control Systems Technology.

[2]  N. Cressie.  The origins of kriging , 1990 .

[3]  Anil V. Rao,et al.  GPOPS-II , 2014, ACM Trans. Math. Softw..

[4]  T. Duncan.  ON THE CALCULATION OF MUTUAL INFORMATION , 1970 .

[5]  Ben Grocholsky,et al.  Information-Theoretic Control of Multiple Sensor Platforms , 2002 .

[6]  Cyrill Stachniss,et al.  Information-theoretic compression of pose graphs for laser-based SLAM , 2012, Int. J. Robotics Res..

[7]  Claire J. Tomlin,et al.  Mobile Sensor Network Control Using Mutual Information Methods and Particle Filters , 2010, IEEE Transactions on Automatic Control.

[8]  Jacob Ziv,et al.  Mutual information of the white Gaussian channel with and without feedback , 1971, IEEE Trans. Inf. Theory.

[9]  Arthur E. Bryson,et al.  Linear smoothing using measurements containing correlated noise with an application to inertial navigation , 1968 .

[10]  Han-Lim Choi,et al.  Analysis of mutual information for informative forecasting using mobile sensors , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[11]  A. Willsky,et al.  On the fixed-interval smoothing problem † , 1981 .

[12]  Thomas M. Cover,et al.  Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) , 2006 .

[13]  Philippe Faure,et al.  A new method to estimate the Kolmogorov entropy from recurrence plots: its application to neuronal signals , 1998 .

[14]  Shohei Fujita,et al.  Optimal Linear Fixed-Interval Smoothing for Colored Noise , 1970, Inf. Control..

[15]  D. Fraser,et al.  The optimum linear smoother as a combination of two optimum linear filters , 1969 .

[16]  M. Grigoriu.  Stochastic Calculus: Applications in Science and Engineering , 2002 .

[17]  Y. Termonia,et al.  Kolmogorov entropy from a time series , 1984 .

[18]  Richard S. Bucy,et al.  Optimal filtering for correlated noise , 1967 .

[19]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[20]  Han-Lim Choi,et al.  A multi-UAV targeting algorithm for ensemble forecast improvement , 2007 .

[21]  Andrew E. B. Lim,et al.  Sensor scheduling in continuous time , 2001, Autom..

[22]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[23]  Nigel J. Newton.  Dual Kalman--Bucy Filters and Interactive Entropy Production , 2006, SIAM J. Control. Optim..

[24]  Han-Lim Choi,et al.  Continuous trajectory planning of mobile sensors for informative forecasting , 2010, Autom..

[25]  Su-Jin Lee,et al.  A Potential-Game Approach for Information-Maximizing Cooperative Planning of Sensor Networks , 2014, IEEE Transactions on Control Systems Technology.

[26]  Han-Lim Choi,et al.  An outer-approximation approach for information-maximizing sensor selection , 2012, Optimization Letters.

[27]  D. C. Fraser,et al.  A new technique for the optimal smoothing of data , 1968 .

[28]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[29]  John W. Fisher,et al.  Approximate Dynamic Programming for Communication-Constrained Sensor Network Management , 2007, IEEE Transactions on Signal Processing.

[30]  Tryphon T. Georgiou,et al.  Distances and Riemannian Metrics for Spectral Density Functions , 2007, IEEE Transactions on Signal Processing.

[31]  Moshe Zakai,et al.  On mutual information, likelihood ratios, and estimation error for the additive Gaussian channel , 2004, IEEE Transactions on Information Theory.

[32]  Nigel J. Newton,et al.  Information and Entropy Flow in the Kalman–Bucy Filter , 2005 .

[33]  A. Bryson,et al.  Linear filtering for time-varying systems using measurements containing colored noise , 1965 .

[34]  Han-Lim Choi,et al.  Coordinated Targeting of Mobile Sensor Networks for Ensemble Forecast Improvement , 2011, IEEE Sensors Journal.

[35]  Nigel J. Newton.  Dual Nonlinear Filters and Entropy Production , 2007, SIAM J. Control. Optim..

[36]  Mac Schwager,et al.  Distributed robotic sensor networks: An information-theoretic approach , 2012, Int. J. Robotics Res..

[37]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[38]  Edward N. Lorenz,et al.  Designing Chaotic Models , 2005 .