The Proper Computation of the Matrix Pseudoinverse and its Impact in MVRO Filtering

There have been two new algorithms of fairly recent origin offered for the calculation of the matrix pseudoinverse. Unfortunately, nonpathological counterexamples can be constructed, as offered herein, that demonstrate the questionable nature of these two algorithms; however, a resolution is offered here to help prevent possible uncritical propagation of the questionable algorithms. As a rigorous alternative, a well-established technique (endorsed by numerical analysts) is reviewed for calculating the correct matrix pseudoinverse using a computer. Additionally, this technique possesses existent independently verified/validated and assessible software code for a convenient implementation. However, historical loose ends in calculating the associated condition number are singled out here as cause for concern and as a topic for future resolution and refinement. Finally, as the primary motivation for considering these issues, an application example is offered from estimation theory in the implementation and analysis of a minimum variance reduced-order (MVRO) filter having proper performance that critically hinges on the correct computation of the matrix pseudoinverse. While examples of applying MVRO to navigation applications were provided almost a decade ago, a clear indication of the somewhat restrictive conditions of applicability were wanting and so are elucidated here since there appears to be a resurgence of interest in this analytic technique. Another contribution is in providing a tally of the drawbacks to be incurred in using MVRO as well as its previously publicized benefits.

[1]  T. Kerr Three important matrix inequalities currently impacting control and estimation applications , 1978 .

[2]  Raman K. Mehra Digital simulation of multidimensional Gauss-Markov random processes , 1969 .

[3]  Charles E. Hutchinson,et al.  The Kalman Filter Applied to Aerospace and Electronic Systems , 1984, IEEE Transactions on Aerospace and Electronic Systems.

[4]  C. Hutchinson,et al.  Minimum variance reduced state filters , 1972, IEEE Conference on Decision and Control.

[5]  Eduardo Sontag On generalized inverses of polynomial and other matrices , 1980 .

[6]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[7]  V. Vandelinde,et al.  On the steady-state error of the fading memory filter , 1976 .

[8]  C. Hutchinson,et al.  Applications of Mininum Variance Reduced-State Estimators , 1975, IEEE Transactions on Aerospace and Electronic Systems.

[9]  Donald Catlin,et al.  State Estimation and Divergence Analysis , 1984, IEEE Transactions on Aerospace and Electronic Systems.

[10]  Thomas H. Kerr,et al.  MODELING AND EVALUATING AN EMPIRICAL INS DIFFERENCE MONITORING PROCEDURE USED TO SEQUENCE SSBN NAVAID FIXES , 1981 .

[11]  R. Carroll,et al.  Comments on "On the application of matrix generalized inverses to the design of observer for time-varying and time-invariant linear systems" , 1984 .

[12]  Edward M. Duiven Suboptimal Linear Filtering , 1974 .

[13]  R. Mohler,et al.  Nonlinear observability and mixed-coordinate bearing-only signal processing , 1984, The 23rd IEEE Conference on Decision and Control.

[14]  R. Byers A LINPACK-style condition estimator for the equation AX-XB^{T} = C , 1984 .

[15]  Thomas H. Kerr False alarm and correct detection probabilities over a time interval for restricted classes of failure detection algorithms , 1982, IEEE Trans. Inf. Theory.

[16]  C. Radhakrishna Rao,et al.  Generalized inverse of linear transformations: a geometric approach , 1985 .

[17]  Sherry Hammel,et al.  Observability Requirements for Three-Dimensional Tracking via Angle Measurements , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[18]  Tony F. Chan,et al.  Algorithm 581: An Improved Algorithm for Computing the Singular Value Decomposition [F1] , 1982, TOMS.

[19]  Thomas H. Kerr Statistical analysis of a two-ellipsoid overlap test for real-time failure detection , 1980 .

[20]  Cornelius T. Leondes,et al.  A note on the extended kalman filter , 1981, Autom..

[21]  A. Doma Generalized Inverses of Matrices and Its Applications. , 1983 .

[22]  M. Aoki,et al.  Estimation of the state vector of a linear stochastic system with a constrained estimator , 1967, IEEE Transactions on Automatic Control.

[23]  A. Willsky,et al.  A generalized likelihood ratio approach to the detection and estimation of jumps in linear systems , 1976 .

[24]  Thomas H. Kerr Failure Detection Aids for Human Operator Decisions in a Precision Inertial Navigation System Comple , 1976 .

[25]  Wolfgang J. Runggaldier,et al.  An approximation for the nonlinear filtering problem, with error bound † , 1985 .

[26]  Thomas H. Kerr Poseidon Improvement Studies: Real-Time Failure Detection in the SINS/ESGM , 1974 .

[27]  Thomas H. Kerr,et al.  A Stable Decentralized Filtering Implementation for JTIDS RelNav , 1980 .

[28]  Jack J. Dongarra,et al.  Matrix Eigensystem Routines — EISPACK Guide Extension , 1977, Lecture Notes in Computer Science.

[29]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[30]  Sati Mazumdar,et al.  Correspondence between a Linear Restriction and a Generalized Inverse in Linear Model Analysis , 1980 .

[31]  E. Blum Numerical analysis and computation theory and practice , 1972 .

[32]  G. Stewart On the Perturbation of Pseudo-Inverses, Projections and Linear Least Squares Problems , 1977 .

[33]  Robert B. Asher,et al.  Bias, variance, and estimation error in reduced order filters , 1976, Autom..

[34]  A. Laub,et al.  The singular value decomposition: Its computation and some applications , 1980 .

[35]  Violet B. Haas,et al.  Reduced order state estimation for linear systems with exact measurements , 1983, Autom..

[36]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[37]  T. Kerr Real-time failure detection: A nonlinear optimization problem that yields a two-ellipsoid overlap test , 1977 .

[38]  Craig S. Sims,et al.  Optimal and suboptimal results in full- and reduced-order linear filtering , 1978 .

[39]  A. Willsky,et al.  On the fixed-interval smoothing problem † , 1981 .

[40]  G. Bierman Comments on "An analytic solution for an algebraic matrix Riccati equation" , 1975 .

[41]  Thomas H. Kerr,et al.  Advances in the Techniques and Technology in the Application of Nonlinear Filters and Kalman Filters , 1981 .

[42]  Thomas H. Kerr Integrated Navigation Concept Study , 1984 .

[43]  P. Bélanger,et al.  Computational experience with the solution of the matrix Lyapunov equation , 1976 .

[44]  Dennis S. Bernstein,et al.  The Optimal Projection Equations for Reduced-Order State Estimation , 1985, 1985 American Control Conference.

[45]  D. Bernstein,et al.  The optimal projection equations for reduced-order state estimation , 1985 .

[46]  Brian D. O. Anderson,et al.  A note on bounds on solutions of the Riccati equation , 1972 .

[47]  A. Willsky,et al.  A generalized likelihood ratio approach to state estimation in linear systems subjects to abrupt changes , 1974, CDC 1974.

[48]  D. F. Liang,et al.  Low Cost Integrated Marine Navigation System , 1983 .

[49]  J. H. Wilkinson,et al.  AN ESTIMATE FOR THE CONDITION NUMBER OF A MATRIX , 1979 .

[50]  G. Bierman Power series evaluation of transition and covariance matrices , 1972 .

[51]  C. Sanders,et al.  Specific structures for large-scale state estimation algorithms having information exchange , 1978 .

[52]  R. E. Kalman,et al.  A user's manual for the Automatic Synthesis Program /program C/ , 1966 .

[53]  F. Schweppe,et al.  GRADIENT MATRICES AND MATRIX CALCULATIONS , 1965 .

[54]  Thomas Kerr,et al.  Decentralized Filtering and Redundancy Management/Failure Detection for Multisensor Integrated Navigation Systems , 1985 .

[55]  An invalid norm appearing in control and estimation , 1978 .

[56]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[57]  Tony F. Chan,et al.  An Improved Algorithm for Computing the Singular Value Decomposition , 1982, TOMS.

[58]  D. Luenberger An introduction to observers , 1971 .

[59]  S. F. Schmidt,et al.  The Kalman filter - Its recognition and development for aerospace applications , 1981 .

[60]  A comment on the use of spectral radius of a matrix , 1981 .