Generalized Inverses, Ridge Regression, Biased Linear Estimation, and Nonlinear Estimation

A principal objective of this paper is to discuss a class of biased linear estimators employing generalized inverses. A second objective is to establish a unifying perspective. The paper exhibits theoretical properties shared by generalized inverse estimators, ridge estimators, and corresponding nonlinear estimation procedures. From this perspective it becomes clear why all these methods work so well in practical estimation from nonorthogonal data.

[1]  M. Kendall.  A course in multivariate analysis , 1958 .

[2]  T. Greville.  The Pseudoinverse of a Rectangular or Singular Matrix and Its Application to the Solution of Systems of Linear Equations , 1959 .

[3]  T. Greville,et al.  Some Applications of the Pseudoinverse of a Matrix , 1960 .

[4]  H. Hartley.  The Modified Gauss-Newton Method for the Fitting of Non-Linear Regression Functions by Least Squares , 1961 .

[5]  D. Marquardt,et al.  Least squares analysis of electron paramagnetic resonance spectra , 1961 .

[6]  C. Radhakrishna Rao,et al.  A Note on a Generalized Inverse of a Matrix with Applications to Problems in Mathematical Statistics , 1962 .

[7]  Arthur E. Hoerl,et al.  Application of ridge analysis to regression problems , 1962 .

[8]  A. Balakrishnant.  An Operator Theoretic Formulation of a Class of Control Problems and a Steepest Descent Method of Solution , 1963 .

[9]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[10]  John S. Chipman,et al.  On Least Squares with Insufficient Observations , 1964 .

[11]  A. J. Goldman,et al.  Weak generalized inverses and minimum variance linear unbiased estimation , 1964 .

[12]  Charles M. Price,et al.  The Matrix Pseudoinverse and Minimal Variance Estimates , 1964 .

[13]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[14]  T. O. Lewis,et al.  A Generalization of the Gauss-Markov Theorem , 1966 .

[15]  Duane A. Meeter,et al.  On a Theorem Used in Nonlinear Least Squares , 1966 .

[16]  H. Rutishauser.  Once again: The least square problem , 1968 .

[17]  A. E. Hoerl,et al.  Ridge Regression: Applications to Nonorthogonal Problems , 1970 .