Goodness-of-fit testing for the marginal distribution of regime-switching models with an application to electricity spot prices

This paper complements a recently published study (Janczura and Weron in AStA-Adv Stat Anal 96(3):385–407, 2012) on efficient estimation of Markov regime-switching models. Here, we propose a new goodness-of-fit testing scheme for the marginal distribution of such models. We consider models with an observable (like threshold autoregressions) as well as a latent state process (like Markov regime-switching). The test is based on the Kolmogorov–Smirnov supremum-distance statistic and the concept of the weighted empirical distribution function. The motivation for this research comes from a recent stream of literature in energy economics concerning electricity spot price models. While the existence of distinct regimes in such data is generally unquestionable (due to the supply stack structure), the actual goodness-of-fit of the models requires statistical validation. We illustrate the proposed scheme by testing whether commonly used Markov regime-switching models fit deseasonalized electricity prices from the NEPOOL (US) day-ahead market.

[1]  R. Maiboroda A Test for the Homogeneity of Mixtures with Varying Concentrations , 2000 .

[2]  Thomas Lux,et al.  Forecasting volatility under fractality, regime-switching, long memory and student-t innovations , 2010, Comput. Stat. Data Anal..

[3]  W. Härdle,et al.  Statistical Tools for Finance and Insurance (2nd edition) , 2011 .

[4]  Derek W. Bunn,et al.  Fundamental and Behavioural Drivers of Electricity Price Volatility , 2010 .

[5]  D. Talay,et al.  The law of the Euler scheme for stochastic differential equations , 1996 .

[6]  Joanna Janczura,et al.  An empirical comparison of alternate regime-switching models or electricity spot prices , 2010 .

[7]  Rafał Weron,et al.  Modeling and forecasting electricity loads: A comparison , 2005 .

[8]  F. Benth,et al.  Stochastic Modeling of Electricity and Related Markets , 2008 .

[9]  Jan Bulla,et al.  Computational issues in parameter estimation for stationary hidden Markov models , 2008, Comput. Stat..

[10]  Haikady N. Nagaraja,et al.  Inference in Hidden Markov Models , 2006, Technometrics.

[11]  P. Brill,et al.  A distribution estimation method based on level crossings , 2004 .

[12]  R. Weron,et al.  Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models , 2008 .

[13]  James D. Hamilton Regime switching models , 2010 .

[14]  James D. Hamilton Analysis of time series subject to changes in regime , 1990 .

[15]  C. Withers,et al.  The distribution and quantiles of functionals of weighted empirical distributions when observations have different distributions , 2010, 1002.4338.

[16]  T. Alderweireld,et al.  A Theory for the Term Structure of Interest Rates , 2004, cond-mat/0405293.

[17]  Marine Carrasco,et al.  Optimal test for Markov switching , 2004 .

[18]  Carlo Mari,et al.  Random movements of power prices in competitive markets: a hybrid model approach , 2008 .

[19]  Daniel R. Smith Evaluating Specification Tests for Markov-Switching Time Series Models , 2007 .

[20]  M. Rosenblatt Remarks on a Multivariate Transformation , 1952 .

[21]  Gilles Celeux,et al.  Selecting hidden Markov model state number with cross-validated likelihood , 2008, Comput. Stat..

[22]  Xuerong Mao,et al.  Stochastic population dynamics under regime switching II , 2007 .

[23]  R. Maiboroda Estimates for distributions of components of mixtures with varying concentrations , 1996 .

[24]  Andrew Ang,et al.  Regime Switches in Interest Rates , 1998 .

[25]  Eric Moulines,et al.  Inference in Hidden Markov Models (Springer Series in Statistics) , 2005 .

[26]  Fushing Hsieh,et al.  A note on testing regime switching assumption based on recurrence times , 2009 .

[27]  S. Choi Regime-Switching Univariate Diffusion Models of the Short-Term Interest Rate , 2009 .

[28]  René Garcia,et al.  Série Scientifique Scientific Series Nº 95s-7 Asymptotic Null Distribution of the Likelihood Ratio Test in Markov Switching Models , 2022 .

[29]  Chang‐Jin Kim,et al.  Dynamic linear models with Markov-switching , 1994 .

[30]  K. Mosler,et al.  Can Markov regime-switching models improve power-price forecasts? Evidence from German daily power prices , 2006 .

[31]  Rodney C. Wolff,et al.  Outlier Treatment and Robust Approaches for Modeling Electricity Spot Prices , 2007 .

[32]  T. Mount,et al.  ESTIMATING THE VOLATILITY OF SPOT PRICES IN RESTRUCTURED ELECTRICITY MARKETS AND THE IMPLICATIONS FOR OPTION VALUES , 1998 .

[33]  Mecit Cetin,et al.  Short-Term Traffic Flow Prediction with Regime Switching Models , 2006 .

[34]  M. Newton,et al.  Weighted bootstrapping of means , 1991 .

[35]  Oldrich A. Vasicek An equilibrium characterization of the term structure , 1977 .

[36]  G. Hirsch Pricing of hourly exercisable electricity swing options using different price processes , 2009 .

[37]  Jeremy Berkowitz Testing Density Forecasts, With Applications to Risk Management , 2001 .

[38]  Rogemar Mamon,et al.  HMM filtering and parameter estimation of an electricity spot price model , 2010 .

[39]  E. Lehmann Testing Statistical Hypotheses , 1960 .

[40]  Marie Bessec,et al.  What Causes The Forecasting Failure of Markov-Switching Models? A Monte Carlo Study , 2005 .

[41]  Rafał Weron,et al.  Heavy-tails and regime-switching in electricity prices , 2009, Math. Methods Oper. Res..

[42]  Derek W. Bunn,et al.  Forecasting electricity prices: The impact of fundamentals and time-varying coefficients , 2008 .

[43]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[44]  Jin Seo Cho,et al.  Testing for Regime Switching , 2007 .

[45]  Rüdiger Kiesel,et al.  A two-factor model for the electricity forward market , 2009 .

[46]  Joanna Janczura,et al.  Efficient estimation of Markov regime-switching models: An application to electricity wholesale market prices , 2010 .

[47]  Péter Elek,et al.  A two-state regime switching autoregressive model with an application to river flow analysis , 2007 .

[48]  S. Rachev,et al.  Spot and Derivative Pricing in the EEX Power Market , 2007 .

[49]  R. Weron,et al.  Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models , 2006 .

[50]  Joanna Janczura,et al.  Identifying Spikes and Seasonal Components in Electricity Spot Price Data: A Guide to Robust Modeling , 2012 .

[51]  A. Eydeland Energy and Power Risk Management , 2002 .

[52]  Anthony S. Tay,et al.  Evaluating Density Forecasts with Applications to Financial Risk Management , 1998 .

[53]  B. L. S. Prakasa Rao,et al.  Conditional independence, conditional mixing and conditional association , 2009 .

[54]  S. Ross,et al.  A theory of the term structure of interest rates'', Econometrica 53, 385-407 , 1985 .

[55]  Cyriel de Jong The Nature of Power Spikes: a regime-switch approach , 2005 .

[56]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[57]  Kamil Feridun Turkman Non-linear time series models , 1996 .

[58]  James D. Hamilton Specification testing in Markov-switching time-series models , 1996 .

[59]  N. Shephard,et al.  Stochastic Volatility: Likelihood Inference And Comparison With Arch Models , 1996 .

[60]  Denis Talay,et al.  The law of the Euler scheme for stochastic differential equations , 1996, Monte Carlo Methods Appl..

[61]  Christopher R. Knittel,et al.  An empirical examination of restructured electricity prices , 2005 .

[62]  Y. Shin,et al.  Optimal Test for Markov Switching GARCH Models , 2008 .

[63]  S. Ravi Testing Statistical Hypotheses, 3rd edn by E. L. Lehmann and J. P. Romano , 2007 .

[64]  Joanna Janczura,et al.  Regime-switching models for electricity spot prices: Introducing heteroskedastic base regime dynamics and shifted spike distributions , 2009, 2009 6th International Conference on the European Energy Market.

[65]  Rafał Weron,et al.  Efficient estimation of Markov regime-switching models: An application to electricity spot prices , 2012 .

[66]  R. Weron Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach , 2006 .

[67]  Marc S. Paolella,et al.  A New Approach to Markov-Switching GARCH Models , 2004 .

[68]  W. Härdle,et al.  Statistical Tools for Finance and Insurance , 2003 .