An MCMC computational approach for a continuous time state-dependent regime switching diffusion process

ABSTRACT State-dependent regime switching diffusion processes or hybrid switching diffusion (HSD) processes are hard to simulate with classical methods which leads us to adopt a Markov chain Monte Carlo (MCMC) Bayesian approach very convenient to estimate complicated models such as the HSD one. In the HSD, the diffusion component is dependent on the switching discrete hidden regimes and the transition rates of the regime switching are dependent on the diffusion observations. Since in reality phenomena are only observed in discrete times, data imputation is called for to create more observations so as to have good approximations for the density of the diffusion process. Three categories of entities will be computed in a Bayesian context: The latent imputed observations, the regime switching states, and the parameters of the models. The latent imputed data is updated at random time intervals in block using a Metropolis Hastings algorithm. The switching states are computed by an adaptation of a forward filtering backward smoothing algorithm to the HSD model. The parameters are estimated after prior specifications and conditional posterior densities formulation using Gibbs sampler or Metropolis Hastings algorithm.

[1]  El Houcine Hibbah,et al.  Bayesian Estimation of Multivariate Autoregressive Hidden Markov Model with Application to Breast Cancer Biomarker Modeling , 2017 .

[2]  John M. Olin Calculating posterior distributions and modal estimates in Markov mixture models , 1996 .

[3]  Xuerong Mao,et al.  Population dynamical behavior of Lotka-Volterra system under regime switching , 2009, J. Comput. Appl. Math..

[4]  Henrik Rasmussen,et al.  National Centre of Competence in Research Financial Valuation and Risk Management Working Paper No . 107 An Option Pricing Formula for the GARCH Diffusion Model , 2004 .

[5]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[6]  James E. Dunn,et al.  Analysis of Radio Telemetry Data in Studies of Home Range , 1977 .

[7]  Marleen de Bruijne,et al.  Factors influencing the decline in lung density in a Danish lung cancer screening cohort , 2012, European Respiratory Journal.

[8]  R. Chou Volatility persistence and stock valuations: Some empirical evidence using garch , 1988 .

[9]  Yacine Ait-Sahalia Testing Continuous-Time Models of the Spot Interest Rate , 1995 .

[10]  Daniel B. Nelson ARCH models as diffusion approximations , 1990 .

[11]  Shigeyoshi Ogawa Monte carlo simulation of nonlinear diffusion processes , 1992 .

[12]  R. Chou,et al.  ARCH modeling in finance: A review of the theory and empirical evidence , 1992 .

[13]  George Tauchen Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes: Comment , 2002 .

[14]  A. Parton,et al.  Bayesian Inference for Multistate ‘Step and Turn’ Animal Movement in Continuous Time , 2017, 1701.05736.

[15]  Sébastien Ourselin,et al.  A simulation system for biomarker evolution in neurodegenerative disease , 2015, Medical Image Anal..

[16]  A. Gallant,et al.  Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes , 2002 .

[17]  Estimating single factor jump diffusion interest rate models , 2011 .

[18]  S. Berman A bivariate markov process with diffusion and discrete components , 1994 .

[19]  J. Fox,et al.  Bayesian inference for an illness-death model for stroke with cognition as a latent time-dependent risk factor , 2015, Statistical methods in medical research.

[20]  N. Shephard,et al.  Likelihood INference for Discretely Observed Non-linear Diffusions , 2001 .

[21]  H. Pham,et al.  Regime-switching stochastic volatility model: estimation and calibration to VIX options , 2017 .

[22]  Yee Whye Teh,et al.  Fast MCMC sampling for Markov jump processes and extensions , 2012, J. Mach. Learn. Res..

[23]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .

[24]  G. Roberts,et al.  On inference for partially observed nonlinear diffusion models using the Metropolis–Hastings algorithm , 2001 .

[25]  Edmund J Crampin,et al.  MCMC estimation of Markov models for ion channels. , 2011, Biophysical journal.

[26]  Paul G. Blackwell,et al.  Exact Bayesian inference for animal movement in continuous time , 2016 .

[27]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[28]  Siddhartha Chib,et al.  Accept–reject Metropolis–Hastings sampling and marginal likelihood estimation , 2005 .

[29]  E. Tjørve,et al.  The use of Gompertz models in growth analyses, and new Gompertz-model approach: An addition to the Unified-Richards family , 2017, PloS one.

[30]  S Richardson,et al.  Modeling Markers of Disease Progression by a Hidden Markov Process: Application to Characterizing CD4 Cell Decline , 2000, Biometrics.

[31]  M. K. Ghosh,et al.  Optimal control of switching diffusions with application to flexible manufacturing systems , 1993 .

[32]  Christiane Fuchs,et al.  Inference for Diffusion Processes , 2013 .

[33]  E. Tsionas,et al.  Bayesian Implications of Ridge Regression and Zellner's g Prior , 2016 .

[34]  S. Chib Calculating posterior distributions and modal estimates in Markov mixture models , 1996 .

[35]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[36]  Paul G. Blackwell,et al.  Random diffusion models for animal movement , 1997 .

[37]  Junsheng Ma A bayesian approach to longitudinal categorical data in a continuous time markov chain model , 2013 .

[38]  Darren J. Wilkinson,et al.  Bayesian inference for nonlinear multivariate diffusion models observed with error , 2008, Comput. Stat. Data Anal..

[39]  Rafał Weron,et al.  Efficient estimation of Markov regime-switching models: An application to electricity spot prices , 2012 .

[41]  Christiane Fuchs,et al.  Inference for Diffusion Processes: With Applications in Life Sciences , 2013 .

[42]  Paul G. Blackwell,et al.  Bayesian inference for Markov processes with diffusion and discrete components , 2003 .

[43]  Y. Tse,et al.  Estimation of Hyperbolic Diffusion using MCMC Method , 2002 .

[44]  Gernot A. Fink,et al.  Markov Models for Pattern Recognition , 2014, Advances in Computer Vision and Pattern Recognition.

[45]  George Yin,et al.  Properties of solutions of stochastic differential equations with continuous-state-dependent switching , 2010 .

[46]  R. Stockley Biomarkers in chronic obstructive pulmonary disease: confusing or useful? , 2014, International journal of chronic obstructive pulmonary disease.

[47]  Henk A. P. Blom,et al.  Monte Carlo simulation of rare events in hybrid systems , 2004 .

[48]  Bjørn Eraker MCMC Analysis of Diffusion Models With Application to Finance , 2001 .