That BLUP is a Good Thing: The Estimation of Random Effects

In animal breeding, Best Linear Unbiased Prediction, or BLUP, is a technique for estimating genetic merits. In general, it is a method of estimating random effects. It can be used to derive the Kalman filter, the method of Kriging used for ore reserve estimation, credibility theory used to work out insurance premiums, and Hoadley's quality measurement plan used to estimate a quality index. It can be used for removing noise from images and for small-area estimation. This paper presents the theory of BLUP, some examples of its applica- tion and its relevance to the foundations of statistics. Understanding of procedures for estimating random effects should help people to understand some complicated and controversial issues about fixed and random effects models and also help to bridge the apparent gulf between the Bayesian and Classical schools of thought.

[1]  K. Pearson.  Mathematical Contributions to the Theory of Evolution. III. Regression, Heredity, and Panmixia , 1896 .

[2]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[3]  Frank S. Freeman,et al.  Interpretation of educational measurements , 1928 .

[4]  H. F. Smith,et al.  A DISCRIMINANT FUNCTION FOR PLANT SELECTION , 1936 .

[5]  L. N. Hazel.  The Genetic Basis for Constructing Selection Indexes. , 1943, Genetics.

[6]  C. Stein.  A Two-Sample Test for a Linear Hypothesis Whose Power is Independent of the Variance , 1945 .

[7]  C. Eisenhart.  The assumptions underlying the analysis of variance. , 1947, Biometrics.

[8]  W. Edwards Deming,et al.  Some Theory of Sampling , 1950 .

[9]  W. Edwards Deming.  Some theory of sampling , 1951 .

[10]  G. H. Jowett,et al.  The Accuracy of Systematic Sampling from Conveyor Belts , 1952 .

[11]  A. Robertson.  Prediction Equations in Quantitative Genetics , 1955 .

[12]  C. Stein.  Inadmissibility of the Usual Estimator for the Mean of a Multivariate Normal Distribution , 1956 .

[13]  S. R. Searle,et al.  The estimation of environmental and genetic trends from records subject to culling. , 1959 .

[14]  Acheson J. Duncan,et al.  Bulk Sampling: Problems and Lines of Attack , 1962 .

[15]  A. Goldberger.  Best Linear Unbiased Prediction in the Generalized Linear Regression Model , 1962 .

[16]  G. C. Tiao,et al.  Bayesian Estimation of Means for the Random Effect Model , 1968 .

[17]  H. N. Turner,et al.  Quantitative Genetics in Sheep Breeding , 1969 .

[18]  Optimality of unbiased predictors , 1969 .

[19]  H. Sorenson.  Least-squares estimation: from Gauss to Kalman , 1970, IEEE Spectrum.

[20]  H. D. Patterson,et al.  Recovery of inter-block information when block sizes are unequal , 1971 .

[21]  S. R. Searle.  Linear Models , 1971 .

[22]  C. R. Henderson.  SIRE EVALUATION AND GENETIC TRENDS , 1973 .

[23]  Robin Thompson,et al.  The estimation of variance and covariance components with an application when records are subject to culling , 1973 .

[24]  D. Harville.  Bayesian inference for variance components using only error contrasts , 1974 .

[25]  C. R. Henderson,et al.  Best linear unbiased estimation and prediction under a selection model. , 1975, Biometrics.

[26]  C. R. Henderson.  A simple method for computing the inverse of a numerator relationship matrix used in prediction of breeding values , 1976 .

[27]  David A. Harville,et al.  Extension of the Gauss-Markov Theorem to Include the Estimation of Random Effects , 1976 .

[28]  L. Dempfle.  Comparison of several sire evaluation methods in dairy cattle breeding , 1977, Annales de génétique et de sélection animale.

[29]  B. Efron,et al.  Stein's Paradox in Statistics , 1977 .

[30]  R. Fay,et al.  Estimates of Income for Small Places: An Application of James-Stein Procedures to Census Data , 1979 .

[31]  C. Radhakrishna Rao,et al.  Estimation of Variance Components. , 1979 .

[32]  David A. Harville,et al.  Best Linear Recursive Estimation for Mixed Linear Models , 1981 .

[33]  Raghu N. Kackar,et al.  Unbiasedness of two-stage estimation and prediction procedures for mixed linear models , 1981 .

[34]  S. R. Searle,et al.  On Deriving the Inverse of a Sum of Matrices , 1981 .

[35]  C. Morris.  Parametric Empirical Bayes Inference: Theory and Applications , 1983 .

[36]  Nozer D. Singpurwalla,et al.  Understanding the Kalman Filter , 1983 .

[37]  O. Barndorff-Nielsen.  On a formula for the distribution of the maximum likelihood estimator , 1983 .

[38]  R. N. Kackar,et al.  Approximations for Standard Errors of Estimators of Fixed and Random Effects in Mixed Linear Models , 1984 .

[39]  C. R. Henderson.  Applications of linear models in animal breeding , 1984 .

[40]  Some bayesian solutions for problems of adaptive estimation in linear dynamic systems , 1985 .

[41]  David A. Harville,et al.  Decomposition of Prediction Error , 1985 .

[42]  A. Khuri,et al.  Variance Components Analysis: A Selective Literature Survey , 1985 .

[43]  Rachel M. Harter,et al.  The multivariate components of variance model for small area estimation , 1986 .

[44]  William H. Fellner,et al.  Robust Estimation of Variance Components , 1986 .

[45]  G. Robinson.  Group Effects and Computing Strategies for Models for Estimating Breeding Values , 1986 .

[46]  Robin Thompson,et al.  Estimation of genetic parameters. , 2005 .

[47]  G. Robinson,et al.  Approximations for Prediction Error Variances , 1987 .

[48]  Dorothy L. Robinson,et al.  Estimation and Use of Variance Components , 1987 .

[49]  Rachel M. Harter,et al.  An Error-Components Model for Prediction of County Crop Areas Using Survey and Satellite Data , 1988 .

[50]  J. Berger,et al.  A Bayesian Approach to Ranking and Selection of Related Means with Alternatives to Analysis-of-Variance Methodology , 1988 .

[51]  Daniel R. Jeske,et al.  Prediction-interval procedures and (fixed-effects) confidence-interval procedures for mixed linear models , 1988 .

[53]  D. Harville,et al.  BLUP (Best Linear Unbiased Prediction) and Beyond , 1990 .