Experiments on the Application of IOHMMs to Model Financial Returns Series *

Input-output hidden Markov models (IOHMM) are conditional hidden Markov models in which the emission (and possibly the transition) probabilities can be conditioned on an input sequence. For example, these conditional distributions can be linear, logistic, or nonlinear (using for example multilayer neural networks). We compare the generalization performance of several models which are special cases of input-output hidden Markov models on financial time-series prediction tasks: an unconditional Gaussian, a conditional linear Gaussian, a mixture of Gaussians, a mixture of conditional linear Gaussians, a hidden Markov model, and various IOHMMs. The experiments compare these models on predicting the conditional density of returns of market and sector indices. Note that the unconditional Gaussian estimates the first moment with the historical average. The results show that, although for the first moment the historical average gives the best results, for the higher moments, the IOHMMs yielded significantly better performance, as estimated by the out-of-sample likelihood.

[1]  John E. Moody,et al.  Forecasting the Economy with Neural Nets: A Survey of Challenges and Solutions , 1996, Neural Networks: Tricks of the Trade.

[2]  Peter F. Christoffersen,et al.  Which GARCH Model for Option Valuation? , 2002, Manag. Sci..

[3]  Jin-Young Ha,et al.  Unconstrained handwritten word recognition with interconnected hidden markov models = 상호 연결된 은닉 마르코프 모델을 이용한 무제약 필기 단어 인식 , 1994 .

[4]  Nicolas Chapados,et al.  Valorisation d'Options par Optimisation du Sharpe Ratio , 2002 .

[5]  D. Haussler,et al.  Hidden Markov models in computational biology. Applications to protein modeling. , 1993, Journal of molecular biology.

[6]  Padhraic J. Smyth,et al.  Hidden Markov models for fault detection in dynamic systems , 1993 .

[7]  M. A. McClure,et al.  Hidden Markov models of biological primary sequence information. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[8]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[9]  Kris Jacobs,et al.  Idiosyncratic Consumption Risk and the Cross-Section of Asset Returns , 2004 .

[10]  M. Blais,et al.  Série Scientifique Scientific Series Static versus Dynamic Structural Models of Depression: the Case of the Ces-d Static versus Dynamic Structural Models of Depression: the Case of the Ces-d , 2022 .

[11]  James D. Hamilton A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[12]  C Sander,et al.  Predicting protein structure using hidden Markov models , 1997, Proteins.

[13]  H. Krolzig Markov-Switching Vector Autoregressions , 1997 .

[14]  Yoshua Bengio,et al.  An Input Output HMM Architecture , 1994, NIPS.

[15]  René Garcia,et al.  Are the Effects of Monetary Policy Asymmetric , 1995 .

[16]  Isabelle Guyon,et al.  Recognition-Based Segmentation of On-Line Hand-Printed Words , 1992, NIPS.

[17]  M. Solá,et al.  Testing the term structure of interest rates using a stationary vector autoregression with regime switching , 1994 .

[18]  A. Kundu,et al.  Recognition of handwritten script: a hidden Markov model based approach , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[19]  F. Diebold,et al.  Regime Switching with Time-Varying Transition Probabilities , 2020, Business Cycles.

[20]  René Garcia,et al.  Série Scientifique Scientific Series an Analysis of the Real Interest Rate under Regime Shifts , 2022 .

[21]  Pierre Baldi,et al.  Bioinformatics - the machine learning approach (2. ed.) , 2000 .

[22]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[23]  John Moody,et al.  Predicting the U.S. Index of Industrial Production (Extended Abstract) , 1993 .

[24]  S. Eddy Hidden Markov models. , 1996, Current opinion in structural biology.

[25]  Van Nostrand,et al.  Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm , 1967 .

[26]  Isabelle Guyon,et al.  On-line cursive script recognition using time-delay neural networks and hidden Markov models , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  M. Moreaux,et al.  Maximal Decompositions of Cost Games into Specific and Joint Costs , 2002 .

[28]  Yoshua Bengio,et al.  LeRec: A NN/HMM Hybrid for On-Line Handwriting Recognition , 1995, Neural Computation.

[29]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[30]  René Garcia,et al.  Asymptotic null distribution of the likelihood ratio test in Markov switching models , 1998 .

[31]  René Garcia,et al.  Asymptotic Null Contribution of the Likelihood Ratio Test in Markov Switching Models , 1995 .

[32]  Samy Bengio,et al.  An EM Algorithm for Asynchronous Input/Output Hidden Markov Models , 1996 .

[33]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[34]  Yann LeCun,et al.  Multi-Digit Recognition Using a Space Displacement Neural Network , 1991, NIPS.

[35]  James D. Hamilton Rational-expectations econometric analysis of changes in regime: An investigation of the term structure of interest rates , 1988 .

[36]  Kin Hong Wong,et al.  Script recognition using hidden Markov models , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[37]  Yoshua Bengio,et al.  Input-output HMMs for sequence processing , 1996, IEEE Trans. Neural Networks.

[38]  Steven J. Nowlan,et al.  Mixtures of Controllers for Jump Linear and Non-Linear Plants , 1993, NIPS.

[39]  Pierre Baldi,et al.  Hidden Markov Models of the G-Protein-Coupled Receptor Family , 1994, J. Comput. Biol..

[40]  James D. Hamilton Specification testing in Markov-switching time-series models , 1996 .