Flexible distributions for triple-goal estimates in two-stage hierarchical models

Performance evaluations often aim to achieve goals such as obtaining estimates of unit-specific means, ranks, and the distribution of unit-specific parameters. The Bayesian approach provides a powerful way to structure models for achieving these goals. While no single estimate can be optimal for achieving all three inferential goals, the communication and credibility of results will be enhanced by reporting a single estimate that performs well for all three. Triple goal estimates [Shen and Louis, 1998. Triple-goal estimates in two-stage hierarchical models. J. Roy. Statist. Soc. Ser. B 60, 455-471] have this performance and are appealing for performance evaluations. Because triple-goal estimates rely more heavily on the entire distribution than do posterior means, they are more sensitive to misspecification of the population distribution and we present various strategies to robustify triple-goal estimates by using nonparametric distributions. We evaluate performance based on the correctness and efficiency of the robustified estimates under several scenarios and compare empirical Bayes and fully Bayesian approaches to model the population distribution. We find that when data are quite informative, conclusions are robust to model misspecification. However, with less information in the data, conclusions can be quite sensitive to the choice of population distribution. Generally, use of a nonparametric distribution pays very little in efficiency when a parametric population distribution is valid, but successfully protects against model misspecification.

[1]  J. Hodges.  Some algebra and geometry for hierarchical models, applied to diagnostics , 1998 .

[2]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[3]  T. Louis,et al.  A constrained empirical Bayes estimator for incidence rates in areas with small populations. , 1994, Statistics in medicine.

[4]  Eric R. Ziecel.  Aspects of Uncertainty , 1995 .

[5]  S. MacEachern,et al.  Estimating mixture of dirichlet process models , 1998 .

[6]  C. Morris,et al.  Hierarchical Poisson Regression Modeling , 1997 .

[7]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[8]  P. Müller,et al.  Bayesian curve fitting using multivariate normal mixtures , 1996 .

[9]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[10]  Wei Pan,et al.  Methods for Estimating and Interpreting Provider-Specific Standardized Mortality Ratios , 2003, Health Services and Outcomes Research Methodology.

[11]  C. Morris.  Parametric Empirical Bayes Inference: Theory and Applications , 1983 .

[12]  Wei Shen,et al.  Empirical Bayes Estimation via the Smoothing by Roughening Approach , 1999 .

[13]  T. Louis.  Estimating a population of parameter values using Bayes and empirical Bayes methods , 1984 .

[14]  E. Lesaffre,et al.  Disease mapping and risk assessment for public health. , 1999 .

[15]  A. Gelman.  Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[16]  Thomas A Louis,et al.  Uncertainty in Rank Estimation: Implications for Value-Added Modeling Accountability Systems , 2002, Journal of educational and behavioral statistics : a quarterly publication sponsored by the American Educational Research Association and the American Statistical Association.

[17]  M. Ghosh.  Constrained Bayes Estimation with Applications , 1992 .

[18]  L. Wasserman,et al.  Bayesian analysis of outlier problems using the Gibbs sampler , 1991 .

[19]  M. Escobar.  Estimating Normal Means with a Dirichlet Process Prior , 1994 .

[20]  Mark McClellan,et al.  The Quality of Health Care Providers , 1999 .

[21]  T. Louis,et al.  Empirical Bayes methods for stabilizing incidence rates before mapping. , 1994, Epidemiology.

[22]  J. Gill.  Hierarchical Linear Models , 2005 .

[23]  A. Gelman,et al.  All maps of parameter estimates are misleading. , 1999, Statistics in medicine.

[24]  N. Laird.  Nonparametric Maximum Likelihood Estimation of a Mixing Distribution , 1978 .

[25]  Michael A. West,et al.  Hierarchical priors and mixture models, with applications in regression and density estimation , 2006 .

[26]  Thomas A. Louis,et al.  Empirical Bayes Ranking Methods , 1989 .

[27]  David Lindley,et al.  Aspects of uncertainty : a tribute to D.V. Lindley , 1995 .

[28]  Harvey Goldstein,et al.  League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance , 1996 .

[29]  Sharon-Lise T. Normand,et al.  Analytic Methods for Constructing Cross-Sectional Profiles of Health Care Providers , 2000, Health Services and Outcomes Research Methodology.

[30]  T. Louis,et al.  Triple‐goal estimates in two‐stage hierarchical models , 1998 .

[31]  W Shen,et al.  Triple-goal estimates for disease mapping. , 2000, Statistics in medicine.

[32]  T. Louis,et al.  Smoothing the non-parametric estimate of a prior distribution by roughening: A computational study , 1991 .

[33]  C. Antoniak.  Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .