Simultaneous estimation based on empirical likelihood and general maximum likelihood estimation

One typical problem in simultaneous estimation of mean values is estimating means of normal distributions, however when normality or any other distribution is not specified, more robust estimation procedures are demanded. A new estimation procedure is proposed based on empirical likelihood which does not request any specific distributional assumption. The new idea is based on incorporating empirical likelihood with general maximum likelihood estimation. One well-known nonparametric estimator, the linear empirical Bayes estimator, can be interpreted as an estimator based on empirical likelihood under some framework and it is shown that the proposed procedure can improve the linear empirical Bayes estimator. Numerical studies are presented to compare the proposed estimator with some existing estimators. The proposed estimator is applied to the problem of estimating mean values corresponding to high valued observations. Simulations and real data example of gene expression are provided.

[1]  Lawrence D. Brown,et al.  SURE Estimates for a Heteroscedastic Hierarchical Model , 2012, Journal of the American Statistical Association.

[2]  H. Robbins.  Some Thoughts on Empirical Bayes Estimation , 1983 .

[3]  A. Owen.  Empirical likelihood ratio confidence intervals for a single functional , 1988 .

[4]  Art B. Owen,et al.  Empirical Likelihood for Linear Models , 1991 .

[5]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[6]  Wenhua Jiang,et al.  General maximum likelihood empirical Bayes estimation of normal means , 2009, 0908.1709.

[7]  Junyong Park,et al.  Application of Non Parametric Empirical Bayes Estimation to High Dimensional Classification , 2009, J. Mach. Learn. Res..

[8]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[9]  N. Laird.  Nonparametric Maximum Likelihood Estimation of a Mixing Distribution , 1978 .

[10]  Xiaotong Shen,et al.  Empirical Likelihood , 2002 .

[11]  Chiara Sabatti,et al.  Empirical Bayes Estimation of a Sparse Vector of Gene Expression Changes , 2005, Statistical applications in genetics and molecular biology.

[12]  I. Johnstone,et al.  Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences , 2004, math/0410088.

[13]  Shrinkage estimator in normal mean vector estimation based on conditional maximum likelihood estimators , 2014 .

[14]  R. Koenker,et al.  Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules , 2014 .

[15]  H. Robbins.  Linear empirical Bayes estimation of means and variances. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[16]  B. Efron.  Empirical Bayes Estimates for Large-Scale Prediction Problems , 2009, Journal of the American Statistical Association.

[17]  Anna Clara Monti.  Empirical likelihood confidence regions in time series models , 1997 .

[18]  Lawrence D. Brown,et al.  The Poisson Compound Decision Problem Revisited , 2010, 1006.4582.

[19]  A. Owen.  Empirical Likelihood Ratio Confidence Regions , 1990 .

[20]  Lawrence D. Brown,et al.  NONPARAMETRIC EMPIRICAL BAYES AND COMPOUND DECISION APPROACHES TO ESTIMATION OF A HIGH-DIMENSIONAL VECTOR OF NORMAL MEANS , 2009, 0908.1712.

[21]  Junyong Park.  Nonparametric empirical Bayes estimator in simultaneous estimation of Poisson means with application to mass spectrometry data , 2012 .

[22]  P. Rusmevichientong,et al.  Efficient Empirical Bayes prediction under check loss using Asymptotic Risk Estimates , 2015, 1511.00028.

[23]  Zhuang Ma,et al.  Group-Linear Empirical Bayes Estimates for a Heteroscedastic Normal Mean , 2015, 1503.08503.

[24]  Gerhard Winkler.  Maximum Likelihood Estimators , 1995 .

[25]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[26]  Cun-Hui Zhang.  Estimation of sums of random variables: Examples and information bounds , 2005, math/0602214.

[27]  Y. Ritov,et al.  Estimating the Mean of High Valued Observations in High Dimensions , 2008 .

[28]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[29]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[30]  L. Brown,et al.  Empirical Bayes Estimates for a 2-Way Cross-Classified Additive Model , 2016, 1605.08466.

[31]  John D. Storey,et al.  Empirical Bayes Analysis of a Microarray Experiment , 2001 .