Regression with strongly correlated data

This paper discusses linear regression of strongly correlated data that arises, for example, in magnetohydrodynamic equilibrium reconstructions. We have proved that, generically, the covariance matrix of the estimated regression parameters for fixed sample size goes to zero as the correlations become unity. That is, in this limit the estimated parameters are known with perfect accuracy. Simple examples are shown to illustrate this effect and the nature of the exceptional cases in which the covariance of the estimate does not go to zero.

[1]  R. L. Winkler.  Combining Probability Distributions from Dependent Information Sources , 1981 .

[2]  D. S. Sivia.  Some Thoughts on Correlated Noise , 2004 .

[3]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[4]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[5]  Michael L. Stein,et al.  Fixed-Domain Asymptotics for Spatial Periodograms , 1995 .

[6]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[7]  W. J. Studden,et al.  Design and analysis of computer experiments when the output is highly correlated over the input space , 2002 .

[8]  Patrick Talou,et al.  Probabilistic Interpretation of Peelle's Pertinent Puzzle and its Resolution , 2005 .

[9]  Ronald Christensen.  Plane Answers to Complex Questions , 1987 .

[10]  P. A. P. Moran,et al.  An introduction to probability theory , 1968 .

[11]  Robert L. Winkler,et al.  Limits for the Precision and Value of Information from Dependent Sources , 1985, Oper. Res..

[12]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[13]  Irene A. Stegun,et al.  Handbook of Mathematical Functions. , 1966 .

[14]  John M. Finn,et al.  MHD equilibrium reconstruction in the presence of correlated data , 2006 .

[15]  Equilibrium reconstruction in the Madison Symmetric Torus reversed field pinch , 2004 .

[16]  L. L. Lao,et al.  Separation of β̄p and ℓi in tokamaks of non-circular cross-section , 1985 .

[17]  L. Lao,et al.  Reconstruction of current profile parameters and plasma shapes in tokamaks , 1985 .

[18]  David C. Schmittlein,et al.  How Many Forecasters Do You Really Have? Mahalanobis Provides the Intuition for the Surprising Clemen and Winkler Result , 1991, Oper. Res..

[19]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[20]  G. D'Agostini,et al.  On the use of the covariance matrix to fit correlated data , 1994 .

[21]  R. Christensen,et al.  Advanced Linear Modeling , 2002, Springer Texts in Statistics.