A Tabu Search heuristic procedure in Markov chain bootstrapping

Markov chain theory is proving to be a powerful approach to bootstrap finite states processes, especially where time dependence is non linear. In this work we extend such approach to bootstrap discrete time continuous-valued processes. To this purpose we solve a minimization problem to partition the state space of a continuous-valued process into a finite number of intervals or unions of intervals (i.e. its states) and identify the time lags which provide “memory” to the process. A distance is used as objective function to stimulate the clustering of the states having similar transition probabilities. The problem of the exploding number of alternative partitions in the solution space (which grows with the number of states and the order of the Markov chain) is addressed through a Tabu Search algorithm. The method is applied to bootstrap the series of the German and Spanish electricity prices. The analysis of the results confirms the good consistency properties of the method we propose.

[1]  R. Huisman,et al.  Regime Jumps in Electricity Prices , 2001 .

[2]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[3]  R. Weron Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach , 2006 .

[4]  P. Bühlmann,et al.  Variable Length Markov Chains: Methodology, Computing, and Software , 2004 .

[5]  R. Weron,et al.  Modelling Electricity Prices: Jump Diffusion and Regime Switching , 2004 .

[6]  Awi Federgruen,et al.  Structured Partitioning Problems , 1991, Oper. Res..

[7]  Richard M. Leahy,et al.  An Optimal Graph Theoretic Approach to Data Clustering: Theory and Its Application to Image Segmentation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Xin Yao,et al.  An evolutionary clustering algorithm for gene expression microarray data analysis , 2006, IEEE Transactions on Evolutionary Computation.

[9]  Stanislav Anatolyev Electoral behavior of US counties: a panel data approach , 2002 .

[10]  E. Forgy Cluster analysis of multivariate data : efficiency versus interpretability of classifications , 1965 .

[11]  P. Bühlmann Bootstraps for Time Series , 2002 .

[12]  Andrey L. Vasnev,et al.  Markov chain approximation in bootstrapping autoregressions , 2002 .

[13]  Chang Sup Sung,et al.  A tabu-search-based heuristic for clustering , 2000, Pattern Recognit..

[14]  Jun Hong,et al.  Using Markov Chains for Link Prediction in Adaptive Web Sites , 2002, Soft-Ware.

[15]  D. Freedman,et al.  Bootstrapping a Regression Equation: Some Empirical Results , 1984 .

[16]  Maria Grazia Speranza,et al.  On the effectiveness of scenario generation techniques in single-period portfolio optimization , 2009, Eur. J. Oper. Res..

[17]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[18]  Kathrin Klamroth,et al.  An MCDM approach to portfolio optimization , 2004, Eur. J. Oper. Res..

[19]  D. Bunn Modelling prices in competitive electricity markets , 2004 .

[20]  Roy Cerqueti,et al.  Optimal Dimension of Transition Probability Matrices for Markov Chain Bootstrapping , 2009 .

[21]  Michael K. Ng,et al.  Higher-order multivariate Markov chains and their applications , 2008 .

[22]  B. LeBaron,et al.  Simple Technical Trading Rules and the Stochastic Properties of Stock Returns , 1992 .

[23]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[24]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[25]  C. Lucas,et al.  Heuristic algorithms for the cardinality constrained efficient frontier , 2011, Eur. J. Oper. Res..

[26]  Yukio Takahashi,et al.  Weak D-Markov Chain and its Application to a Queueing Network , 1983, Computer Performance and Reliability.

[27]  P.-J. Courtois,et al.  Decomposability: Queueing and Computer System Applications , 2014 .

[28]  D. Freedman On Bootstrapping Two-Stage Least-Squares Estimates in Stationary Linear Models , 1984 .

[29]  Javier Trejos,et al.  Clustering by Ant Colony Optimization , 2004 .

[30]  William M. Spears,et al.  A Compression Algorithm for Probability Transition Matrices , 1998, SIAM J. Matrix Anal. Appl..