Nonparametric Mixture of Regression Models

Motivated by an analysis of U.S. house price index (HPI) data, we propose nonparametric finite mixture of regression models. We study the identifiability issue of the proposed models, and develop an estimation procedure by employing kernel regression. We further systematically study the sampling properties of the proposed estimators, and establish their asymptotic normality. A modified EM algorithm is proposed to carry out the estimation procedure. We show that our algorithm preserves the ascent property of the EM algorithm in an asymptotic sense. Monte Carlo simulations are conducted to examine the finite sample performance of the proposed estimation procedure. An empirical analysis of the U.S. HPI data is illustrated for the proposed methodology.

[1]  Peter E. Rossi,et al.  Bayesian Statistics and Marketing: Rossi/Bayesian Statistics and Marketing , 2006 .

[2]  S. Frühwirth-Schnatter.  Markov chain Monte Carlo Estimation of Classical and Dynamic Switching and Mixture Models , 2001 .

[3]  Pengfei Li,et al.  Testing the Order of a Finite Mixture , 2010 .

[4]  W. Yao,et al.  Mixture of Regression Models With Varying Mixing Proportions: A Semiparametric Approach , 2012 .

[5]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[6]  S. Goldfeld,et al.  A Markov model for switching regressions , 1973 .

[7]  J. Kalbfleisch,et al.  A modified likelihood ratio test for homogeneity in finite mixture models , 2001 .

[8]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[9]  B. Leroux.  Consistent estimation of a mixing distribution , 1992 .

[10]  Jianqing Fan,et al.  Efficient Estimation of Conditional Variance Functions in Stochastic Regression , 1998 .

[11]  R. Hathaway.  A Constrained Formulation of Maximum-Likelihood Estimation for Normal Mixture Distributions , 1985 .

[12]  B. Lindsay,et al.  Bayesian Mixture Labeling by Highest Posterior Density , 2009 .

[13]  Jianqing Fan.  Local Linear Regression Smoothers and Their Minimax Efficiencies , 1993 .

[14]  M. Stephens.  Dealing with label switching in mixture models , 2000 .

[15]  B. Lindsay.  Mixture models : theory, geometry, and applications , 1995 .

[16]  P. Green,et al.  Hidden Markov Models and Disease Mapping , 2002 .

[17]  M. Wand,et al.  An Effective Bandwidth Selector for Local Least Squares Regression , 1995 .

[18]  M. Puterman,et al.  Mixed Poisson regression models with covariate dependent rates. , 1996, Biometrics.

[19]  Jianqing Fan,et al.  Variable Bandwidth and Local Linear Regression Smoothers , 1992 .

[20]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[21]  Jianqing Fan,et al.  Generalized likelihood ratio statistics and Wilks phenomenon , 2001 .

[22]  W. Yao,et al.  A note on the identifiability of nonparametric and semiparametric mixtures of GLMs , 2014 .

[23]  Peter E. Rossi,et al.  Bayesian Statistics and Marketing , 2005 .

[24]  C. Robert,et al.  Estimating Mixtures of Regressions , 2003 .

[25]  Jianqing Fan,et al.  Local polynomial kernel regression for generalized linear models and quasi-likelihood functions , 1995 .

[26]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[27]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[28]  Jianqing Fan,et al.  On automatic boundary corrections , 1997 .

[29]  Christian Hennig,et al.  Identifiablity of Models for Clusterwise Linear Regression , 2000, J. Classif..

[30]  Ming-Yen Cheng,et al.  A bandwidth selector for local linear density estimators , 1997 .

[31]  Z. D. Feng,et al.  Using Bootstrap Likelihood Ratio in Finite Mixture Models , 1994 .

[32]  Wayne S. DeSarbo,et al.  A Latent Class Binomial Logit Methodology for the Analysis of Paired Comparison Choice Data: An Application Reinvestigating the Determinants of Perceived Risk , 1993 .

[33]  G. Claeskens,et al.  Local polynomial estimation in multiparameter likelihood models , 1997 .

[34]  R. Tibshirani,et al.  Local Likelihood Estimation , 1987 .

[35]  B. Silverman,et al.  Weak and strong uniform consistency of kernel regression estimates , 1982 .