Markov Models for Time Series Analysis

A time series is a series of observations of a quantity of interest. Markov models are commonly used in applications to take into account the dependence between successive observations. This chapter describes the statistical analysis of different types of Markov models for categorical and continuous time series data, including hidden Markov models and state space models. Several examples are considered to illustrate how likelihood and Bayesian methods can be used for parameter estimation and prediction. Exercises are given at the end.