Modeling irregularly spaced residual series as a continuous stochastic process

In this paper, the background and functioning of a simple but effective continuous time approach for modeling irregularly spaced residual series is presented. The basic equations were published earlier by von Asmuth et al. (2002), who used them as part of a continuous time transfer function noise model. It is shown that the methods behind the model are build on two principles: The first is the fact that the equations of a Kalman filter degenerate to a form that is equivalent to “conventional” autoregressive moving average (ARMA) models when the modeled data are considered to be free of measurement errors. This assumption, in comparison to the “full” Kalman filter, also yields a better prediction efficiency (Ahsan and O'Connor, 1994). The second is the mathematical equivalence between discrete time AR parameters and continuous exponentials and the point that continuous time models provide an elegant solution for modeling irregularly spaced observations (e.g., Harvey, 1989). Because simple least squares methods do not apply in case of modeling irregular data, a sum of weighted squared innovations (SWSI) criterion is introduced and derived from the likelihood function of the innovations. In an example application it is shown that the estimates of the SWSI criterion converge to maximum likelihood estimates for larger sample sizes. Finally, we propose to use the so-called innovation variance function as an additional diagnostic check, next to the well-known autocorrelation and cross-correlation functions.

[1]  R. Mazo On the theory of brownian motion , 1973 .

[2]  K. Hipel,et al.  Time series modelling of water resources and environmental systems , 1994 .

[3]  Rory A. Fisher,et al.  Statistical methods and scientific inference. , 1957 .

[4]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[5]  C.B.M. Te Stroet Calibration of stochastic groundwaterflow models. Estimation of noise statistics and model parameters. , 1995 .

[6]  Geza Pesti,et al.  A fuzzy rule-based approach to drought assessment , 1996 .

[7]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[8]  P. Brockwell Continuous-time ARMA processes , 2001 .

[9]  N. Shephard,et al.  Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics , 2001 .

[10]  Jos R. von Asmuth,et al.  Transfer function‐noise modeling in continuous time using predefined impulse response functions , 2002 .

[11]  Demetris Koutsoyiannis,et al.  Coupling stochastic models of different timescales , 2001 .

[12]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[13]  Myeong-Jae Yi,et al.  Transfer function-noise modelling of irregularly observed groundwater heads using precipitation data , 2004 .

[14]  O. Barndorff-Nielsen Superposition of Ornstein--Uhlenbeck Type Processes , 2001 .

[15]  A. Bergstrom Continuous Time Econometric Modelling. , 1992 .

[16]  Andrew Harvey,et al.  Forecasting, Structural Time Series Models and the Kalman Filter. , 1991 .

[17]  G. Tunnicliffe Wilson,et al.  Interpolating Time Series with Application to the Estimation of Holiday Effects on Electricity Demand , 1976 .

[18]  G. Uhlenbeck,et al.  On the Theory of the Brownian Motion , 1930 .

[19]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[20]  A. E. Bryson,et al.  Estimation using sampled data containing sequentially correlated noise. , 1967 .

[21]  Fred C. Schweppe,et al.  Uncertain dynamic systems , 1973 .

[22]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[23]  C. Gardiner Handbook of Stochastic Methods , 1983 .

[24]  Christopher K. Wikle,et al.  Atmospheric Modeling, Data Assimilation, and Predictability , 2005, Technometrics.

[25]  Andrew Harvey,et al.  Estimating Missing Observations in Economic Time Series , 1984 .

[26]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[27]  G. W. Snedecor Statistical Methods , 1964 .

[28]  Martin Knotters,et al.  Estimating fluctuation quantities from time series of water-table depths using models with a stochastic component , 1997 .

[29]  Kieran M. O'Connor,et al.  A reappraisal of the Kalman filtering technique, as applied in river flow forecasting , 1994 .

[30]  R. A. Fisher,et al.  Statistical methods and scientific inference. , 1957 .

[31]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[32]  Marc F. P. Bierkens,et al.  Calibration of transfer function–noise models to sparsely or irregularly observed time series , 1999 .

[33]  J. C. Gehrels,et al.  Decoupling of modeling and measuring interval in groundwater time series analysis based on response characteristics , 2003 .

[34]  Guy Melard,et al.  Algorithm AS197: A fast algorithm for the exact likelihood of autoregressive-moving average models , 1984 .

[35]  Richard H. Jones,et al.  Maximum Likelihood Fitting of ARMA Models to Time Series With Missing Observations , 1980 .

[36]  Martin Knotters,et al.  Characterising groundwater dynamics based on a system identification approach , 2004 .

[37]  Dennis McLaughlin,et al.  Recent developments in hydrologic data assimilation , 1995 .