SVD-Based Kalman Filter Derivative Computation

Recursive adaptive filtering methods are often used for solving the problem of simultaneous state and parameters estimation arising in many areas of research. The gradient-based schemes for adaptive Kalman filtering (KF) require the corresponding filter sensitivity computations. The standard approach is based on the direct differentiation of the KF equations. The shortcoming of this strategy is a numerical instability of the conventional KF (and its derivatives) with respect to roundoff errors. For decades, special attention has been paid in the KF community for designing efficient filter implementations that improve robustness of the estimator against roundoff. The most popular and beneficial techniques are found in the class of square root (SR) or ${UDU}^T$ factorization-based (UD-based) methods. They imply the Cholesky decomposition of the corresponding error covariance matrix. Another important matrix factorization method is the singular value decomposition (SVD) and, hence, further encouraging KF algorithms might be found under this approach. Meanwhile, the filter sensitivity computation heavily relies on the use of matrix differential calculus. Previous works on the robust KF derivative computation have produced the SR- and UD-based methodologies. Alternatively, in this paper, we design the SVD-based approach. The solution is expressed in terms of the SVD-based KF covariance quantities and their derivatives (with respect to unknown system parameters). The results of numerical experiments illustrate that although the newly developed SVD-based method is algebraically equivalent to the conventional approach and the previously derived SR- and UD-based strategies, it outperforms the mentioned techniques for estimation accuracy in ill-conditioned situations.

[1]  Xiaoqin Zhang,et al.  SVD based Kalman particle filter for robust visual tracking , 2008, 2008 19th International Conference on Pattern Recognition.

[2]  Gene H. Golub,et al.  Matrix computations , 1983 .

[3]  Guy Mélard,et al.  Computation of the Fisher information matrix for time series models , 1995 .

[4]  G.J. Bierman,et al.  Maximum Likelihood Estimation Using Square Root Information Filters , 1989, 1989 American Control Conference.

[5]  Guy Melard,et al.  Corrections to "Construction of the exact Fisher information matrix of Gaussian time series models by means of matrix differential rules" , 2000 .

[6]  E. Tyrtyshnikov A brief introduction to numerical analysis , 1997 .

[7]  Ali H. Sayed,et al.  Extended Chandrasekhar recursions , 1994, IEEE Trans. Autom. Control..

[8]  António Pacheco,et al.  Kalman Filter Sensitivity Evaluation With Orthogonal and J-Orthogonal Transformations , 2013, IEEE Transactions on Automatic Control.

[9]  M. V. Kulikova,et al.  Improved Discrete-Time Kalman Filtering within Singular Value Decomposition , 2016, ArXiv.

[10]  Maria V. Kulikova,et al.  State Sensitivity Evaluation Within UD Based Array Covariance Filters , 2013, IEEE Transactions on Automatic Control.

[11]  Raman K. Mehra,et al.  Optimal input signals for parameter estimation in dynamic systems--Survey and new results , 1974 .

[12]  Thomas Kailath,et al.  New square-root algorithms for Kalman filtering , 1995, IEEE Trans. Autom. Control..

[13]  M. V. Kulikova,et al.  A unified square-root approach for the score and Fisher information matrix computation in linear dynamic systems , 2016, Math. Comput. Simul..

[14]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[15]  Ondrej Straka,et al.  Aspects and comparison of matrix decompositions in unscented Kalman filter , 2013, 2013 American Control Conference.

[16]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[17]  A. Bryson,et al.  Discrete square root filtering: A survey of current techniques , 1971 .

[18]  R. Mehra,et al.  Computational aspects of maximum likelihood estimation and reduction in sensitivity function calculations , 1974 .

[19]  M. Gevers,et al.  Stable adaptive observers for nonlinear time-varying systems , 1987 .

[20]  Fred C. Schweppe,et al.  Evaluation of likelihood functions for Gaussian signals , 1965, IEEE Trans. Inf. Theory.

[21]  M. V. Kulikova,et al.  Likelihood Gradient Evaluation Using Square-Root Covariance Filters , 2009, IEEE Transactions on Automatic Control.

[22]  Peter A. Zadrozny Analytic Derivatives for Estimation of Linear Dynamic Models , 1988 .

[23]  Raman K. Mehra,et al.  Approaches to adaptive filtering , 1970 .

[24]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[25]  P. Dooren,et al.  Numerical aspects of different Kalman filter implementations , 1986 .

[26]  Stefan Mittnik,et al.  Kalman-filtering methods for computing information matrices for time-invariant, periodic, and generally time-varying VARMA models and samples , 1994 .

[27]  Qiuzhao Zhang,et al.  Singular Value Decomposition-based Robust Cubature Kalman Filtering for an Integrated GPS/SINS Navigation System , 2015 .

[28]  N. Higham Analysis of the Cholesky Decomposition of a Semi-definite Matrix , 1990 .

[29]  Maria V. Kulikova,et al.  Constructing numerically stable Kalman filter-based algorithms for gradient-based adaptive filtering , 2013 .

[30]  H. Neudecker Some Theorems on Matrix Differentiation with Special Reference to Kronecker Matrix Products , 1969 .

[31]  Heinz Neudecker,et al.  A direct derivation of the exact Fisher information matrix of Gaussian vector state space models , 2000 .

[32]  H. Round-Off Error Propagation in Four Generally Applicable , Recursive , Least-Squares-Estimation Schemes , .

[33]  Pierre Manneback,et al.  Kalman filter algorithm based on singular value decomposition , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.