ISSUES AND STRATEGIES IN THE SELECTION OF COMPOSITE LIKELIHOODS

The composite likelihood method has been proposed and systematically discussed by Besag (1974), Lindsay (1988), and Cox and Reid (2004). This method has received increasing interest in both theoretical and applied aspects. Compared to the traditional likelihood method, the composite likelihood method may be less statistically efficient, but it can be designed so as to be significantly faster to com- pute and it can be more robust to model misspecification. Although there are a number of ways to formulate a composite likelihood to balance the trade-off between the efficiency and computational price, there does not seem to exist a universal rule for constructing a combination of composite likelihoods that is both computation- ally convenient and statistically appealing. In this article we present some thoughts on the composite likelihood, drawing on basic knowledge about likelihood and es- timating functions. A new efficiency result based on the Hoeffding decomposition of U -statistics is given. A recommendation is given to consider the construction of surrogate density functions as a way to better bridge the gap between likelihood methods and composite likelihood methods.

[1]  Peter McCullagh,et al.  Quasi‐Likelihood Functions , 2006 .

[2]  H. Joe.  Multivariate models and dependence concepts , 1998 .

[3]  G Molenberghs,et al.  Random-effects models for multivariate repeated measures , 2007, Statistical methods in medical research.

[4]  R. Waagepetersen,et al.  Bayesian Prediction of Spatial Count Data Using Generalized Linear Mixed Models , 2002, Biometrics.

[5]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[6]  Geert Verbeke,et al.  Pairwise Fitting of Mixed Models for the Joint Modeling of Multivariate Longitudinal Profiles , 2006, Biometrics.

[7]  Gregory R. Grant,et al.  Statistical Methods in Bioinformatics , 2001 .

[8]  P. Diggle,et al.  Model‐based geostatistics , 2007 .

[9]  D. Cox.  The Analysis of Multivariate Binary Data , 1972 .

[10]  C. Geyer,et al.  Constrained Monte Carlo Maximum Likelihood for Dependent Data , 1992 .

[11]  C. Varin.  On composite marginal likelihoods , 2008 .

[12]  N. Hjort,et al.  Topics in Spatial Statistics , 1992 .

[13]  Alan J. Lee,et al.  U-Statistics: Theory and Practice , 1990 .

[14]  W. Hoeffding.  A Class of Statistics with Asymptotically Normal Distribution , 1948 .

[15]  A. Kuk.  A Hybrid Pairwise Likelihood Method , 2007 .

[16]  Nils Lid Hjort,et al.  ML, PL, QL in Markov Chain Models , 2008 .

[17]  K. Liang,et al.  Asymptotic Properties of Maximum Likelihood Estimators and Likelihood Ratio Tests under Nonstandard Conditions , 1987 .

[18]  D. Louis,et al.  A pseudolikelihood approach for simultaneous analysis of array comparative genomic hybridizations. , 2005, Biostatistics.

[19]  J. Durbin.  Estimation of Parameters in Time‐Series Regression Models , 1960 .

[20]  R. W. Wedderburn.  Quasi-likelihood functions, generalized linear models, and the Gauss-Newton method , 1974 .

[21]  Fabrice Larribe,et al.  ON COMPOSITE LIKELIHOODS IN STATISTICAL GENETICS , 2011 .

[22]  K. Roeder,et al.  Disequilibrium mapping: composite likelihood for pairwise disequilibrium. , 1996, Genomics.

[23]  R. Tibshirani,et al.  Generalized Additive Models , 1991 .

[24]  N. Reid,et al.  AN OVERVIEW OF COMPOSITE LIKELIHOOD METHODS , 2011 .

[25]  H. Joe,et al.  Composite likelihood estimation in multivariate data analysis , 2005 .

[26]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[27]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[28]  C. Heyde,et al.  Multiple roots in general estimating equations , 1998 .

[29]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[30]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[31]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[32]  Carlo Gaetan,et al.  Composite likelihood methods for space-time data , 2006 .

[33]  D. Cox,et al.  A note on pseudolikelihood constructed from marginal densities , 2004 .

[34]  P. Donnelly,et al.  Approximate likelihood methods for estimating local recombination rates , 2002 .

[35]  Guy Lebanon,et al.  Statistical and Computational Tradeoffs in Stochastic Composite Likelihood , 2009, AISTATS.

[36]  V. P. Godambe.  An Optimum Property of Regular Maximum Likelihood Estimation , 1960 .

[37]  David J. Nott,et al.  A pairwise likelihood approach to analyzing correlated binary data , 2000 .

[38]  H. Omre,et al.  Topics in spatial statistics. Discussion and comments , 1994 .

[39]  David J. Nott,et al.  Pairwise likelihood methods for inference in image models , 1999 .

[40]  S. Lele,et al.  A Composite Likelihood Approach to Binary Spatial Data , 1998 .