Minimax Hierarchical Empirical Bayes Estimation in Multivariate Regression

The multivariate normal regression model, in which a vector y of responses is to be predicted by a vector x of explanatory variables, is considered. A hierarchical framework is used to express prior information on both x and y. An empirical Bayes estimator is developed which shrinks the maximum likelihood estimator of the matrix of regression coefficients across rows and columns to nontrivial subspaces which reflect both types of prior information. The estimator is shown to be minimax and is applied to a set of chemometrics data for which it reduces the cross-validated predicted mean squared error of the maximum likelihood estimator by 38%.

[1]  L. R. Haff.  An identity for the Wishart distribution with applications , 1979 .

[2]  Yoshihiko Konno.  On estimation of a matrix of normal means with unknown covariance matrix , 1991 .

[3]  S. Oman.  Random calibration with many measurements: an application of Stein estimation , 1991 .

[4]  J. Zidek.  Deriving Unbiased Risk Estimators of Multinormal Mean and Regression Coefficient Estimators Using Zonal Polynomials , 1978 .

[5]  Shrinkage estimation in the two-way multivariate normal model , 1996 .

[6]  Stanley L. Sclove,et al.  Improved Estimators for Coefficients in Linear Regression , 1968 .

[7]  B. Efron,et al.  Empirical Bayes on vector observations: An extension of Stein's method , 1972 .

[8]  L. R. Haff.  ESTIMATION OF THE INVERSE COVARIANCE MATRIX: RANDOM MIXTURES OF THE INVERSE WISHART MATRIX AND THE IDENTITY , 1979 .

[9]  B. Skagerberg,et al.  Multivariate data analysis applied to low-density polyethylene reactors , 1992 .

[10]  Takeaki Kariya,et al.  Minimax estimators in the normal MANOVA model , 1989 .

[11]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[12]  B. Efron,et al.  Multivariate Empirical Bayes and Estimation of Covariance Matrices , 1976 .

[13]  Tormod Naes,et al.  Detecting and adjusting for non‐linearities in calibration of near‐infrared data using principal components , 1993 .

[14]  J. Zidek,et al.  Adaptive Multivariate Ridge Regression , 1980 .

[15]  J. Friedman,et al.  Predicting Multivariate Responses in Multiple Linear Regression , 1997 .

[16]  B. Efron,et al.  Stein's Estimation Rule and Its Competitors- An Empirical Bayes Approach , 1973 .

[17]  E. George,et al.  Multiple-shrinkage principal component regression , 1996 .

[18]  Robert C. Blattberg,et al.  Shrinkage Estimation of Price and Promotional Elasticities: Seemingly Unrelated Equations , 1991 .

[19]  A. Baranchik,et al.  A Family of Minimax Estimators of the Mean of a Multivariate Normal Distribution , 1970 .

[20]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics (Revised Edition) , 1999 .