PROFILE-KERNEL LIKELIHOOD INFERENCE WITH DIVERGING NUMBER OF PARAMETERS.

The generalized varying coefficient partially linear model with growing number of predictors arises in many contemporary scientific endeavor. In this paper we set foot on both theoretical and practical sides of profile likelihood estimation and inference. When the number of parameters grows with sample size, the existence and asymptotic normality of the profile likelihood estimator are established under some regularity conditions. Profile likelihood ratio inference for the growing number of parameters is proposed and Wilk's phenomenon is demonstrated. A new algorithm, called the accelerated profile-kernel algorithm, for computing profile-kernel estimator is proposed and investigated. Simulation studies show that the resulting estimates are as efficient as the fully iterative profile-kernel estimates. For moderate sample sizes, our proposed procedure saves much computational time over the fully iterative profile-kernel one and gives stabler estimates. A set of real data is analyzed using our proposed algorithm.

[1]  P. Robinson,et al.  The stochastic difference between econometric statistics , 1988 .

[2]  T. Severini,et al.  Quasi-Likelihood Estimation in Semiparametric Models , 1994 .

[3]  Jianqing Fan,et al.  Efficient Estimation and Inferences for Varying-Coefficient Models , 2000 .

[4]  R. Carroll,et al.  A Note on the Efficiency of Sandwich Covariance Matrix Estimation , 2001 .

[5]  Qi Li,et al.  Semiparametric Smooth Coefficient Models , 2002 .

[6]  Adonis Yatchew,et al.  An elementary estimator of the partial linear model , 1997 .

[7]  A. A. Weiss,et al.  Semiparametric estimates of the relation between weather and electricity sales , 1986 .

[8]  Jianqing Fan,et al.  Generalized likelihood ratio statistics and Wilks phenomenon , 2001 .

[9]  W. Wong,et al.  Profile Likelihood and Conditionally Parametric Models , 1992 .

[10]  Raymond J. Carroll,et al.  Backfitting versus profiling in general criterion functions , 2007 .

[11]  P. J. Huber.  Robust Regression: Asymptotics, Conjectures and Monte Carlo , 1973 .

[12]  Fan Jianqing,et al.  Variable bandwidth and one-step local M-estimator , 2000 .

[13]  Jianqing Fan,et al.  Nonconcave penalized likelihood with a diverging number of parameters , 2004, math/0406466.

[14]  P. Bickel.  One-Step Huber Estimates in the Linear Model , 1975 .

[15]  Qi Li,et al.  Efficient estimation of a semiparametric partially linear varying coefficient model , 2005, math/0504510.

[16]  S. Portnoy.  Asymptotic Behavior of Likelihood Methods for Exponential Families when the Number of Parameters Tends to Infinity , 1988 .

[17]  R. Carroll,et al.  Semiparametric estimation in general repeated measures problems , 2006 .

[18]  R. Carroll,et al.  Profile‐kernel versus backfitting in the partially linear models for longitudinal/clustered data , 2004 .

[19]  Wolfgang Härdle,et al.  Partially Linear Models , 2000 .

[20]  Susan A. Murphy,et al.  Rejoinder to discussion of ``On Profile Likelihood''. , 2000 .

[21]  P. McCullagh,et al.  Generalized Linear Models, 2nd Edn. , 1990 .

[22]  Gregory Piatetsky-Shapiro,et al.  High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality , 2000 .

[23]  Yingcun Xia,et al.  Efficient estimation for semivarying‐coefficient models , 2004 .

[24]  Susan A. Murphy,et al.  Testing for a Time Dependent Coefficient in Cox's Regression Model , 1993 .

[25]  Stanley R. Johnson,et al.  Varying Coefficient Models , 1984 .

[26]  A. V. D. Vaart,et al.  Asymptotic Statistics: U -Statistics , 1998 .

[27]  J. H. Schuenemeyer,et al.  Generalized Linear Models (2nd ed.) , 1992 .

[28]  B. Silverman,et al.  Weak and strong uniform consistency of kernel regression estimates , 1982 .

[29]  P. Speckman.  Kernel smoothing in partial linear models , 1988 .

[30]  D. Pollard.  Asymptotics for Least Absolute Deviation Regression Estimators , 1991, Econometric Theory.

[31]  Jianqing Fan,et al.  Profile likelihood inferences on semiparametric varying-coefficient partially linear models , 2005 .

[32]  P. Tam,et al.  Normalization and analysis of cDNA microarrays using within-array replications applied to neuroblastoma cell response to a cytokine. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[33]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[34]  Jianqing Fan,et al.  Semilinear High-Dimensional Model for Normalization of Microarray Data , 2005 .

[35]  S. Christian Albright,et al.  Data Analysis and Decision Making with Microsoft Excel , 1999 .

[36]  Michael B. Marcus,et al.  Central limit theorems for C(S)-valued random variables , 1975 .

[37]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[38]  Jianqing Fan,et al.  Generalized Partially Linear Single-Index Models , 1997 .

[39]  Xin-Yuan Song,et al.  Local Polynomial Fitting in Semivarying Coefficient Model , 2002 .

[40]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[41]  Runze Li,et al.  Variable Selection in Semiparametric Regression Modeling. , 2008, Annals of statistics.

[42]  Runze Li,et al.  Statistical Challenges with High Dimensionality: Feature Selection in Knowledge Discovery , 2006, math/0602133.