Sensor placement for optimal Kalman filtering: Fundamental limits, submodularity, and algorithms

In this paper, we focus on sensor placement in linear dynamic estimation, where the objective is to place a small number of sensors in a system of interdependent states so to design an estimator with a desired estimation performance. In particular, we consider a linear time-variant system that is corrupted with process and measurement noise, and study how the selection of its sensors affects the estimation error of the corresponding Kalman filter over a finite observation interval. Our contributions are threefold: First, we prove that the minimum mean square error of the Kalman filter decreases only linearly as the number of sensors increases. That is, adding extra sensors so to reduce this estimation error is ineffective, a fundamental design limit. Similarly, we prove that the number of sensors grows linearly with the system's size for fixed minimum mean square error and number of output measurements over an observation interval; this is another fundamental limit, especially for systems where the system's size is large. Second, we prove that the log det of the error covariance of the Kalman filter, which captures the volume of the corresponding confidence ellipsoid, with respect to the system's initial condition and process noise is a supermodular and non-increasing set function in the choice of the sensor set. Therefore, it exhibits the diminishing returns property. Third, we provide an efficient approximation algorithm that selects a small number sensors so to optimize the Kalman filter with respect to this estimation error -the worst-case performance guarantees of this algorithm are provided as well.

[1]  Shreyas Sundaram,et al.  Sensor selection for optimal filtering of linear dynamical systems: Complexity and approximation , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[2]  Zhi-Quan Luo,et al.  An ADMM algorithm for optimal sensor and actuator selection , 2014, 53rd IEEE Conference on Decision and Control.

[3]  Francesco Bullo,et al.  Controllability Metrics, Limitations and Algorithms for Complex Networks , 2013, IEEE Transactions on Control of Network Systems.

[4]  Bruno Sinopoli,et al.  A Relaxation Approach to Dynamic Sensor Selection in Large-Scale Wireless Networks , 2008, 2008 The 28th International Conference on Distributed Computing Systems Workshops.

[5]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[6]  Abhimanyu Das,et al.  Sensor Selection for Minimizing Worst-Case Prediction Error , 2008, 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008).

[7]  George J. Pappas,et al.  Information acquisition with sensing robots: Algorithms and error bounds , 2013, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Santosh S. Venkatesh,et al.  The Theory of Probability: ELEMENTS , 2012 .

[9]  Radha Poovendran,et al.  On leader selection for performance and controllability in multi-agent systems , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[10]  Alexander Olshevsky,et al.  Eigenvalue clustering, control energy, and logarithmic capacity , 2015, Syst. Control. Lett..

[11]  S. Pequito,et al.  On the Exact Solution of the Minimal Controllability Problem , 2015 .

[12]  John Lygeros,et al.  On Submodularity and Controllability in Complex Dynamical Networks , 2014, IEEE Transactions on Control of Network Systems.

[13]  Henrik Madsen,et al.  Estimation of continuous-time models for the heat dynamics of a building , 1995 .

[14]  Dinesh Verma,et al.  A survey of sensor selection schemes in wireless sensor networks , 2007, SPIE Defense + Commercial Sensing.

[15]  Stephen P. Boyd,et al.  Sensor Selection via Convex Optimization , 2009, IEEE Transactions on Signal Processing.

[16]  Frauke Oldewurtel,et al.  Stochastic model predictive control for energy efficient building climate control , 2011 .

[17]  Fu Lin,et al.  Design of Optimal Sparse Feedback Gains via the Alternating Direction Method of Multipliers , 2011, IEEE Transactions on Automatic Control.

[18]  R. Bellman Dynamic programming. , 1957, Science.

[19]  D. Bernstein Matrix Mathematics: Theory, Facts, and Formulas , 2009 .

[20]  David Sturzenegger,et al.  Model predictive building climate control - steps towards practice , 2014 .

[21]  K. Loparo,et al.  Inequalities for the trace of matrix product , 1994, IEEE Trans. Autom. Control..

[22]  Ted K. Ralphs,et al.  Integer and Combinatorial Optimization , 2013 .

[23]  Basel Alomair,et al.  Minimizing Convergence Error in Multi-Agent Systems Via Leader Selection: A Supermodular Optimization Approach , 2013, IEEE Transactions on Automatic Control.

[24]  George J. Pappas,et al.  Minimal reachability problems , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[25]  George J. Pappas,et al.  Minimal actuator placement with optimal control constraints , 2015, 2015 American Control Conference (ACC).

[26]  James Weimer,et al.  Large-scale multiple-source detection using wireless sensor networks , 2010 .

[27]  Arnold Reusken,et al.  Approximation of the Determinant of Large Sparse Symmetric Positive Definite Matrices , 2000, SIAM J. Matrix Anal. Appl..

[28]  Venkat Chandrasekaran,et al.  Regularization for Design , 2014, IEEE Transactions on Automatic Control.

[29]  Jorge Cortés,et al.  Gramian-Based Reachability Metrics for Bilinear Networks , 2015, IEEE Transactions on Control of Network Systems.

[30]  Haris Vikalo,et al.  Greedy sensor selection: Leveraging submodularity , 2010, 49th IEEE Conference on Decision and Control (CDC).

[31]  Fazlollah Soleymani,et al.  An iterative method for computing the approximate inverse of a square matrix and the Moore-Penrose inverse of a non-square matrix , 2013, Appl. Math. Comput..

[32]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988, Wiley interscience series in discrete mathematics and optimization.

[33]  Laurence A. Wolsey,et al.  An analysis of the greedy algorithm for the submodular set covering problem , 1982, Comb..

[34]  Radha Poovendran,et al.  A Supermodular Optimization Framework for Leader Selection Under Link Noise in Linear Multi-Agent Systems , 2012, IEEE Transactions on Automatic Control.

[35]  Michel Minoux,et al.  Accelerated greedy algorithms for maximizing submodular set functions , 1978 .

[36]  Weiguo Li,et al.  A family of iterative methods for computing the approximate inverse of a square matrix and inner inverse of a non-square matrix , 2010, Appl. Math. Comput..

[37]  Chi-Tsong Chen,et al.  Linear System Theory and Design , 1995 .

[38]  Mohamed-Ali Belabbas,et al.  Geometric methods for optimal sensor design , 2015, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[39]  Stephen L. Smith,et al.  Submodularity and greedy algorithms in sensor scheduling for linear dynamical systems , 2015, Autom..

[40]  Francesco Bullo,et al.  Controllability Metrics, Limitations and Algorithms for Complex Networks , 2014, IEEE Trans. Control. Netw. Syst..

[41]  Santosh S. Venkatesh The Theory of Probability by Santosh S. Venkatesh , 2012 .

[42]  Hua Li,et al.  Sensor Placement by Maximal Projection on Minimum Eigenspace for Linear Inverse Problems , 2015, IEEE Transactions on Signal Processing.

[43]  Wei Zhang,et al.  On efficient sensor scheduling for linear dynamical systems , 2010, ACC 2010.

[44]  Alfred O. Hero,et al.  Sensor Management: Past, Present, and Future , 2011, IEEE Sensors Journal.

[45]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[46]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[47]  Ulrich Münz,et al.  Sensor and Actuator Placement for Linear Systems Based on $H_{2}$ and $H_{\infty}$ Optimization , 2014, IEEE Transactions on Automatic Control.

[48]  Alexander Olshevsky,et al.  Minimal Controllability Problems , 2013, IEEE Transactions on Control of Network Systems.

[49]  Richard M. Murray,et al.  On a stochastic sensor selection algorithm with applications in sensor scheduling and sensor coverage , 2006, Autom..

[50]  J. Slotine,et al.  Spectrum of controlling and observing complex networks , 2015, Nature Physics.

[51]  Laurence A. Wolsey,et al.  Best Algorithms for Approximating the Maximum of a Submodular Set Function , 1978, Math. Oper. Res..

[52]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[53]  Santosh S. Venkatesh,et al.  The Theory of Probability: Explorations and Applications , 2012 .

[54]  Soummya Kar,et al.  A Framework for Structural Input/Output and Control Configuration Selection in Large-Scale Systems , 2013, IEEE Transactions on Automatic Control.

[55]  Andreas Krause,et al.  Efficient Informative Sensing using Multiple Robots , 2014, J. Artif. Intell. Res..

[56]  Claire J. Tomlin,et al.  On efficient sensor scheduling for linear dynamical systems , 2010, Proceedings of the 2010 American Control Conference.

[57]  Don Coppersmith,et al.  Matrix multiplication via arithmetic progressions , 1987, STOC.

[58]  George J. Pappas,et al.  Minimal Actuator Placement With Bounds on Control Effort , 2014, IEEE Transactions on Control of Network Systems.