Maximization by Parts in Likelihood Inference

This article presents and examines a new algorithm for solving a score equation for the maximum likelihood estimate in certain problems of practical interest. The method circumvents the need to compute second-order derivatives of the full likelihood function. It exploits the structure of certain models that yield a natural decomposition of a very complicated likelihood function. In this decomposition, the first part is a log-likelihood from a simply analyzed model, and the second part is used to update estimates from the first part. Convergence properties of this iterative (fixed-point) algorithm are examined, and asymptotics are derived for estimators obtained using only a finite number of iterations. Illustrative examples considered in the article include multivariate Gaussian copula models, nonnormal random-effects models, generalized linear mixed models, and state-space models. Properties of the algorithm and of estimators are evaluated in simulation studies on a bivariate copula model and a nonnormal linear random-effects model.

[1]  S. Zeger,et al.  Longitudinal data analysis using generalized linear models , 1986 .

[2]  C. Geyer,et al.  Constrained Monte Carlo Maximum Likelihood for Dependent Data , 1992 .

[3]  T A Louis,et al.  Random effects models with non-parametric priors. , 1992, Statistics in medicine.

[4]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[5]  Adrian F. M. Smith,et al.  Bayesian Analysis of Linear and Non‐Linear Population Models by Using the Gibbs Sampler , 1994 .

[6]  J. Nelder,et al.  Hierarchical Generalized Linear Models , 1996 .

[7]  J. Durbin,et al.  Monte Carlo maximum likelihood estimation for non-Gaussian state space models , 1997 .

[8]  G. Verbeke,et al.  The effect of misspecifying the random-effects distribution in linear mixed models for longitudinal data , 1997 .

[9]  Jeffrey R. Russell,et al.  Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data , 1998 .

[10]  Satishs Iyengar,et al.  Multivariate Models and Dependence Concepts , 1998 .

[11]  P. X. Song,et al.  Multivariate Dispersion Models Generated From Gaussian Copula , 2000 .

[12]  M Davidian,et al.  Linear Mixed Models with Flexible Distributions of Random Effects for Longitudinal Data , 2001, Biometrics.

[13]  Ying Nian Wu,et al.  Efficient Algorithms for Robust Estimation in Linear Mixed-Effects Models Using the Multivariate t Distribution , 2001 .

[14]  Jiming Jiang,et al.  Robust estimation in generalised linear mixed models , 2001 .

[15]  A. Kuk,et al.  Robust estimation in generalized linear mixed models , 2002 .

[16]  Jiming Jiang.  Empirical method of moments and its applications , 2003 .

[17]  Luc Bauwens,et al.  The Stochastic Conditional Duration Model: A Latent Factor Model for the Analysis of Financial Durations , 2004 .

[18]  L. Bauwens,et al.  The stochastic conditional duration model: a latent variable model for the analysis of financial durations , 2004 .

[19]  Donald Hedeker,et al.  Longitudinal Data Analysis , 2006 .

[20]  J. Nelder,et al.  Double hierarchical generalized linear models (with discussion) , 2006 .

[21]  Jiming Jiang,et al.  Mixed model prediction and small area estimation , 2006 .

[22]  Gelfand,et al.  AD-A 254 769 BAYESIAN ANALYSIS OF LINEAR AND NONLINEAR POPULATION MODELS USING THE GIBBS SAMPLER , 2022 .