Markov switching Dirichlet process mixture regression

Markov switching models can be used to study heterogeneous populations that are observed over time. This paper explores modeling the group characteristics nonparametrically, under both homogeneous and nonhomogeneous Markov switching for group probabilities. The model formulation involves a finite mixture of conditionally independent Dirichlet process mixtures, with a Markov chain defining the mixing distribution. The proposed methodology focuses on settings where the number of subpopulations is small and can be assumed to be known, and flexible modeling is required for group regressions. We develop Dirichlet process mixture prior probability models for the joint distribution of individual group responses and covariates. The implied conditional distribution of the response given the covariates is then used for inference. The modeling framework allows for both non-linearities in the resulting regression functions and non-standard shapes in the response distributions. We design a simulation-based model fitting method for full posterior inference. Furthermore, we propose a general approach for inclusion of external covariates dependent on the Markov chain but conditionally independent from the response. The methodology is applied to a problem from fisheries research involving analysis of stock-recruitment data under shifts in the ecosystem state.

[1]  Fernando A. Quintana,et al.  Nonparametric Bayesian data analysis , 2004 .

[2]  C. Robert,et al.  Estimating Mixtures of Regressions , 2003 .

[3]  J. Sethuraman A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[4]  D. Cayan,et al.  Climate-Ocean Variability and Ecosystem Response in the Northeast Pacific , 1998, Science.

[5]  C. Robert,et al.  Bayesian estimation of hidden Markov chains: a stochastic implementation , 1993 .

[6]  Steven R. Hare,et al.  Empirical evidence for North Pacific regime shifts in 1977 and 1989 , 2000 .

[7]  Roderick Murray-Smith,et al.  Hierarchical Gaussian process mixtures for regression , 2005, Stat. Comput..

[8]  P. Müller,et al.  Bayesian curve fitting using multivariate normal mixtures , 1996 .

[9]  Lancelot F. James,et al.  Gibbs Sampling Methods for Stick-Breaking Priors , 2001 .

[10]  C. Robert,et al.  Bayesian estimation of switching ARMA models , 1999, Journal of Econometrics.

[11]  A. Kottas,et al.  A Bayesian Nonparametric Approach to Inference for Quantile Regression , 2010 .

[12]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[13]  D. Blackwell,et al.  Ferguson Distributions Via Polya Urn Schemes , 1973 .

[14]  S. Chib Calculating posterior distributions and modal estimates in Markov mixture models , 1996 .

[15]  L. Mark Berliner,et al.  Markov switching time series models with application to a daily runoff series , 1999 .

[16]  Marc Mangel,et al.  Bayesian nonparametric analysis of stock- recruitment relationships , 2005 .

[17]  James D. Hamilton A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[18]  Robert J. Connor,et al.  Concepts of Independence for Proportions with a Generalization of the Dirichlet Distribution , 1969 .

[19]  R. McCulloch,et al.  STATISTICAL ANALYSIS OF ECONOMIC TIME SERIES VIA MARKOV SWITCHING MODELS , 1994 .

[20]  C. Antoniak Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .

[21]  R. Shumway,et al.  Dynamic linear models with switching , 1991 .

[22]  James P. Hughes,et al.  A class of stochastic models for relating synoptic atmospheric patterns to regional hydrologic phenomena , 1994 .

[23]  Franklin B. Schwing,et al.  Corrigendum: An ecosystem-based hypothesis for climatic effects on surplus production in California sardine (Sardinops sagax) and environmentally dependent surplus production models , 2009 .

[24]  L. Jacobson,et al.  Regimes and stock-recruitment relationships in Japanese sardine (Sardinops melanostictus), 1951-1995 , 1998 .

[25]  H. Ishwaran,et al.  Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models , 2000 .

[26]  S. Goldfeld,et al.  A Markov model for switching regressions , 1973 .

[27]  Radford M. Neal Markov Chain Sampling Methods for Dirichlet Process Mixture Models , 2000 .

[28]  Terrance J. Quinn,et al.  Quantitative Fish Dynamics , 1999 .