Empirical Bayes estimates for a two-way cross-classified model

We develop an empirical Bayes procedure for estimating the cell means in an unbalanced, two-way additive model with fixed effects. We employ a hierarchical model, which reflects exchangeability of the effects within treatment and within block but not necessarily between them, as suggested before by Lindley and Smith [J. R. Stat. Soc., B 34 (1972) 1–41]. The hyperparameters of this hierarchical model, instead of considered fixed, are to be substituted with data-dependent values in such a way that the point risk of the empirical Bayes estimator is small. Our method chooses the hyperparameters by minimizing an unbiased risk estimate and is shown to be asymptotically optimal for the estimation problem defined above, under suitable conditions. The usual empirical Best Linear Unbiased Predictor (BLUP) is shown to be substantially different from the proposed method in the unbalanced case and, therefore, performs suboptimally. Our estimator is implemented through a computationally tractable algorithm that is scalable to work under large designs. The case of missing cell observations is treated as well.

[1]  L. Brown,et al.  Empirical Bayes estimates for a two-way cross-classified model , 2018, The Annals of Statistics.

[2]  S. Kou,et al.  Optimal shrinkage estimation in heteroscedastic hierarchical linear models , 2015, 1503.06262.

[3]  Zhiqiang Tan,et al.  Steinized empirical bayes estimation for heteroscedastic data , 2016 .

[4]  Murat A. Erdogdu,et al.  Flexible results for quadratic forms with applications to variance components estimation , 2015, 1509.04388.

[5]  Ludwig Fahrmeir,et al.  Regression: Models, Methods and Applications , 2013 .

[6]  Emmanuel J. Candès,et al.  Unbiased Risk Estimates for Singular Value Thresholding and Spectral Estimators , 2012, IEEE Transactions on Signal Processing.

[7]  Lee H. Dicker,et al.  Optimal equivariant prediction for high-dimensional linear models with arbitrary predictor covariance , 2013 .

[8]  Lawrence D. Brown,et al.  SURE Estimates for a Heteroscedastic Hierarchical Model , 2012, Journal of the American Statistical Association.

[9]  J. S. Rao,et al.  Best Predictive Small Area Estimation , 2011 .

[10]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[11]  A. Gelman Analysis of variance: Why it is more important than ever? , 2005, math/0504499.

[12]  I. Johnstone,et al.  Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences , 2004, math/0410088.

[13]  Mark Von Tress,et al.  Generalized, Linear, and Mixed Models , 2003, Technometrics.

[14]  Harvey Goldstein,et al.  Multilevel modelling of medical data , 2002, Statistics in medicine.

[15]  Susanna Zaccarin,et al.  Multilevel analysis in social research: An application of a cross-classified model , 2002 .

[16]  I. Johnstone,et al.  Wavelet Shrinkage: Asymptopia? , 1995 .

[17]  H. Goldstein,et al.  Efficient Analysis of Mixed Hierarchical and Cross-Classified Random Structures Using a Multilevel Model , 1994 .

[18]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[19]  P. Sen,et al.  Sequential Shrinkage Estimation , 1987 .

[20]  Ker-Chau Li,et al.  Asymptotic optimality of CL and generalized cross-validation in ridge regression with application to spline smoothing , 1986 .

[21]  Barbara Entwisle,et al.  Contextual analysis through the multilevel linear model. , 1983 .

[22]  Samuel D. Oman,et al.  Shrinking Towards Subspaces in Multiple Linear Regression , 1982 .

[23]  Norman R. Draper,et al.  Ridge Regression and James-Stein Estimation: Review and Comments , 1979 .

[24]  D. Harville Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems , 1977 .

[25]  J. Rolph Choosing shrinkage estimators for regression problems , 1976 .

[26]  B. Efron,et al.  Stein's Estimation Rule and Its Competitors- An Empirical Bayes Approach , 1973 .

[27]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[28]  B. Efron,et al.  Empirical Bayes on vector observations: An extension of Stein's method , 1972 .

[29]  Stanley L. Sclove,et al.  Improved Estimators for Coefficients in Linear Regression , 1968 .

[30]  C. Stein Confidence Sets for the Mean of a Multivariate Normal Distribution , 1962 .