Improved Discrete-Time Kalman Filtering within Singular Value Decomposition

The paper is concerned with the hidden dynamic state estimation in linear discrete-time stochastic systems in presence of Gaussian noises. The associated with the state-space model estimator is known as the Kalman filter (KF). One of the shortcomings of this recursive algorithm is its numerical instability with respect to roundoff errors. Since the appearance of the KF in 1960s, much effort has been made to design numerically stable filter implementations. The most popular and beneficial techniques are found in the class of square-root (SR) methods and imply the Cholesky decomposition of the corresponding error covariance matrix. Another important matrix factorization method is the singular value decomposition (SVD) and, hence, further encouraging KF implementations might be found under this approach. Motivated by previous studies in the nonlinear SVD-based filtering realm, we aim at exploring the SVD-based strategy for linear filtering problem examined in this paper. The analysis presented here exposes that the previously proposed SVD-based KF variant is still sensitive to roundoff errors and poorly treats ill-conditioned situations, although the SVD-based strategy is inherently more stable than the conventional KF approach. In this paper we explain how it can be further improved for enhancing the numerical robustness against roundoff errors. We design some new SVD-based KF implementations, provide their detailed derivations, and discuss the numerical stability and computational complexity issues. All new SVD-based KF variants are derived here in the covariance form. A set of numerical experiments are performed for comparative study.

[1]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[2]  P. Dooren,et al.  Numerical aspects of different Kalman filter implementations , 1986 .

[3]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[4]  M. S. Grewal,et al.  Application of Kalman filtering to the calibration and alignment of inertial navigation systems , 1991 .

[5]  Gerald J. Bierman,et al.  Numerical comparison of kalman filter algorithms: Orbit determination case study , 1977, Autom..

[6]  Å. Björck Solving linear least squares problems by Gram-Schmidt orthogonalization , 1967 .

[7]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[8]  E. Tyrtyshnikov A brief introduction to numerical analysis , 1997 .

[9]  H. Round-Off Error Propagation in Four Generally Applicable , Recursive , Least-Squares-Estimation Schemes , .

[10]  Ondrej Straka,et al.  Aspects and comparison of matrix decompositions in unscented Kalman filter , 2013, 2013 American Control Conference.

[11]  Maria V. Kulikova,et al.  SVD-Based Kalman Filter Derivative Computation , 2017, IEEE Transactions on Automatic Control.

[12]  Pierre Manneback,et al.  Kalman filter algorithm based on singular value decomposition , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[13]  Jan Korbel,et al.  Modeling Financial Time Series , 2013 .

[14]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[15]  Å. Björck Numerical Methods in Matrix Computations , 2014 .

[16]  A. Bryson,et al.  Discrete square root filtering: A survey of current techniques , 1971 .

[17]  Carlo Tomasi,et al.  Singular Value Decomposition , 2021, Encyclopedia of Social Network Analysis and Mining.

[18]  Mohinder S. Grewal,et al.  Kalman Filter Implementation With Improved Numerical Properties , 2010, IEEE Transactions on Automatic Control.

[19]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[20]  Thomas Kailath,et al.  New square-root algorithms for Kalman filtering , 1995, IEEE Trans. Autom. Control..

[21]  Mohinder S. Grewal,et al.  Global Positioning Systems, Inertial Navigation, and Integration , 2000 .

[22]  Fred C. Schweppe,et al.  Evaluation of likelihood functions for Gaussian signals , 1965, IEEE Trans. Inf. Theory.

[23]  Eldon C. Hall Journey to the Moon: The History of the Apollo Guidance Computer , 1996 .

[24]  Thomas Kailath,et al.  An extended inverse QR adaptive filtering algorithm , 1994, Signal Process..

[25]  S. Mcreynolds,et al.  Extension of square-root filtering to include process noise , 1969 .

[26]  M. Morf,et al.  Square-root algorithms for least-squares estimation , 1975 .

[27]  Robert J. Elliott,et al.  Discrete-Time Nonlinear Filtering Algorithms Using Gauss–Hermite Quadrature , 2007, Proceedings of the IEEE.

[28]  Robert C. Langford,et al.  Statistical Filtering of Space Navigation Measurements , 1964 .

[29]  Xiaoqin Zhang,et al.  SVD based Kalman particle filter for robust visual tracking , 2008, 2008 19th International Conference on Pattern Recognition.

[30]  Gene H. Golub,et al.  Matrix computations , 1983 .

[31]  N. Higham Analysis of the Cholesky Decomposition of a Semi-definite Matrix , 1990 .

[32]  Ali H. Sayed,et al.  Extended Chandrasekhar recursions , 1994, IEEE Trans. Autom. Control..

[33]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice Using MATLAB , 2001 .

[34]  Mohinder S Grewal,et al.  Applications of Kalman Filtering in Aerospace 1960 to the Present [Historical Perspectives] , 2010, IEEE Control Systems.

[35]  Henrique Marra Menegaz,et al.  A Systematization of the Unscented Kalman Filter Theory , 2015, IEEE Transactions on Automatic Control.

[36]  M. V. Kulikova,et al.  Square-root Kalman-like filters for estimation of stiff continuous-time stochastic systems with ill-conditioned measurements , 2017 .

[37]  Jussi Tolvi,et al.  Modeling Financial Time Series with S‐Plus , 2003 .