A Distributional Framework for Moving-Horizon Estimation: Stability and Privacy Guarantees

This work employs a distributional, unifying framework for the analysis and design of moving-horizon estimation filters with stability and differential-privacy properties. We begin with an investigation of the classical notion of strong local observability of nonlinear systems and its relationship to optimization-based state estimation. We then present a general moving-horizon estimation framework for strongly locally observable systems, as an iterative minimization scheme in the space of probability measures. This framework allows for the minimization of the estimation cost with respect to different metrics. In particular, we consider two variants, which we name $W_2$-MHE and KL-MHE, where the minimization scheme uses the 2-Wasserstein distance and the KL-divergence, respectively. The $W_2$-MHE yields a gradient-based estimator whereas the KL-MHE yields a particle filter, for which we investigate asymptotic stability and robustness properties. Stability results for these moving-horizon estimators are derived in the distributional setting, against the backdrop of the classical notion of strong local observability which, to the best of our knowledge, differentiates it from other previous works. We then propose a mechanism to encode differential privacy of the data generated by the estimator, based on an entropic regularization of the MHE objective functional. In particular, we find sufficient bounds on the regularization parameter to achieve the desired level of differential privacy. Numerical simulations demonstrate the performance of these estimators.

[1]  Angelo Alessandri,et al.  Moving-horizon estimation for discrete-time linear and nonlinear systems using the gradient and Newton methods , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[2]  Alison L Gibbs,et al.  On Choosing and Bounding Probability Metrics , 2002, math/0209021.

[3]  Christos Dimitrakakis,et al.  Robust and Private Bayesian Inference , 2013, ALT.

[4]  Yizhen Wang,et al.  Pufferfish Privacy Mechanisms for Correlated Data , 2016, SIGMOD Conference.

[5]  Benjamin I. P. Rubinstein,et al.  Bayesian Differential Privacy through Posterior Sampling , 2013 .

[6]  John Tsinias,et al.  Observability and State Estimation for a Class of Nonlinear Systems , 2019, IEEE Transactions on Automatic Control.

[7]  David Angeli,et al.  Nonlinear norm-observability notions and stability of switched systems , 2005, IEEE Transactions on Automatic Control.

[8]  Israel Zang,et al.  On functions whose local minima are global , 1975 .

[9]  Angelo Alessandri,et al.  Fast Moving Horizon State Estimation for Discrete-Time Systems Using Single and Multi Iteration Descent Methods , 2017, IEEE Transactions on Automatic Control.

[10]  Wuhua Hu Robust Stability of Optimization-based State Estimation , 2017 .

[11]  C. Chang,et al.  On observability and unbiased estimation of nonlinear systems , 1982 .

[12]  Prateek Mittal,et al.  Dependence Makes You Vulnberable: Differential Privacy Under Dependent Tuples , 2016, NDSS.

[13]  Henrik Sandberg,et al.  Optimal state estimation with measurements corrupted by Laplace noise , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[14]  Gabriel Peyré,et al.  Entropic Approximation of Wasserstein Gradient Flows , 2015, SIAM J. Imaging Sci..

[15]  Matthias Albrecht Müller Nonlinear moving horizon estimation in the presence of bounded disturbances , 2017, Autom..

[16]  F. Santambrogio {Euclidean, metric, and Wasserstein} gradient flows: an overview , 2016, 1609.03890.

[17]  A. Jazwinski Limited memory optimal filtering , 1968 .

[18]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[19]  Moritz Diehl,et al.  Convergence Guarantees for Moving Horizon Estimation Based on the Real-Time Iteration Scheme , 2014, IEEE Transactions on Automatic Control.

[20]  L. Ambrosio,et al.  Gradient Flows: In Metric Spaces and in the Space of Probability Measures , 2005 .

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  H. Nijmeijer Observability of autonomous discrete time non-linear systems: a geometric approach , 1982 .

[23]  George J. Pappas,et al.  Differentially Private Filtering , 2012, IEEE Transactions on Automatic Control.

[24]  Larry A. Wasserman,et al.  Differential privacy for functions and functional data , 2012, J. Mach. Learn. Res..

[25]  A. Kirsch An Introduction to the Mathematical Theory of Inverse Problems , 1996, Applied Mathematical Sciences.

[26]  George J. Pappas,et al.  Differential privacy in control and network systems , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[27]  Moritz Diehl,et al.  Robust Stability of Moving Horizon Estimation Under Bounded Disturbances , 2016, IEEE Transactions on Automatic Control.

[28]  Jorge Cortés,et al.  Differentially Private Distributed Convex Optimization via Functional Perturbation , 2015, IEEE Transactions on Control of Network Systems.

[29]  Aaron Roth,et al.  The Algorithmic Foundations of Differential Privacy , 2014, Found. Trends Theor. Comput. Sci..

[30]  Giorgio Battistelli,et al.  Moving-horizon state estimation for nonlinear discrete-time systems: New stability results and approximation schemes , 2008, Autom..

[31]  David Q. Mayne,et al.  Constrained state estimation for nonlinear discrete-time systems: stability and moving horizon approximations , 2003, IEEE Trans. Autom. Control..

[32]  Shigeru Hanba,et al.  Further Results on the Uniform Observability of Discrete-Time Nonlinear Systems , 2010, IEEE Transactions on Automatic Control.

[33]  Domenico D'Alessandro,et al.  Observability and Forward–Backward Observability of Discrete-Time Nonlinear Systems , 2002, Math. Control. Signals Syst..