The Lévy State Space Model

In this paper we introduce a new class of state space models based on shot-noise simulation representations of non-Gaussian L\'evy-driven linear systems, represented as stochastic differential equations. In particular a conditionally Gaussian version of the models is proposed that is able to capture heavy-tailed non-Gaussianity while retaining tractability for inference procedures. We focus on a canonical class of such processes, the $\alpha$-stable L\'evy processes, which retain important properties such as self-similarity and heavy-tails, while emphasizing that broader classes of non-Gaussian L\'evy processes may be handled by similar methodology. An important feature is that we are able to marginalise both the skewness and the scale parameters of these challenging models from posterior probability distributions. The models are posed in continuous time and so are able to deal with irregular data arrival times. Example modelling and inference procedures are provided using Rao-Blackwellised sequential Monte Carlo applied to a two-dimensional Langevin model, and this is tested on real exchange rate data.

[1]  Steffen Dereich,et al.  A multilevel Monte Carlo algorithm for Lévy-driven stochastic differential equations , 2011 .

[2]  S. Godsill,et al.  Bayesian inference for time series with heavy-tailed symmetric α-stable noise processes , 1999 .

[3]  B. Malakooti Forecasting , 2013 .

[4]  M. Ledoux,et al.  A rate of convergence in the poissonian representation of stable distributions , 1996 .

[5]  S. Aachen Stochastic Differential Equations An Introduction With Applications , 2016 .

[6]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[7]  Alin Achim,et al.  Novel Bayesian multiscale method for speckle removal in medical ultrasound images , 2001, IEEE Transactions on Medical Imaging.

[8]  Piotr Kokoszka,et al.  Computer investigation of the Rate of Convergence of Lepage Type Series to α-Stable Random Variables , 1992 .

[9]  Simon J. Godsill,et al.  Nonasymptotic Gaussian Approximation for Inference With Stable Noise , 2018, IEEE Transactions on Information Theory.

[10]  K. Chung,et al.  Limit Distributions for Sums of Independent Random Variables. , 1955 .

[11]  B. Mandelbrot New Methods in Statistical Economics , 1963, Journal of Political Economy.

[12]  J. Rosínski On A Class of Infinitely Divisible Processes Represented as Mixtures of Gaussian Processes , 1991 .

[13]  Ajay Jasra,et al.  Bayesian inference for stable Lévy–driven stochastic differential equations with high‐frequency data , 2017, Scandinavian Journal of Statistics.

[14]  John B. Thomas,et al.  Asymptotically robust detection and estimation for very heavy-tailed noise , 1991, IEEE Trans. Inf. Theory.

[15]  R. Wolpert Lévy Processes , 2000 .

[16]  C. L. Nikias,et al.  Signal processing with alpha-stable distributions and applications , 1995 .

[17]  Nicolas Fournier,et al.  Simulation and approximation of Lévy-driven stochastic differential equations , 2009, 0901.3082.

[18]  M. Taqqu,et al.  Stable Non-Gaussian Random Processes : Stochastic Models with Infinite Variance , 1995 .

[19]  O. Kallenberg Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[20]  Simon J. Godsill,et al.  Inference in symmetric alpha-stable noise using MCMC and the slice sampler , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[21]  Simon J. Godsill,et al.  On-line Bayesian estimation of signals in symmetric /spl alpha/-stable noise , 2006, IEEE Transactions on Signal Processing.

[22]  Gareth W. Peters,et al.  Capacity Bounds for Additive Symmetric $\alpha $ -Stable Noise Channels , 2017, IEEE Transactions on Information Theory.

[23]  Simon J. Godsill,et al.  Inference for models with asymmetric α -stable noise processes , 2015 .

[24]  Simon J. Godsill,et al.  Fully Bayesian inference for α-stable distributions using a Poisson series representation , 2015, Digit. Signal Process..

[25]  Peter J. W. Rayner,et al.  Digital Audio Restoration: A Statistical Model Based Approach , 1998 .

[26]  Laurent Clavier,et al.  Statistical channel model based on α-stable random processes and application to the 60 GHz ultra wide band channel , 2010, IEEE Transactions on Communications.

[27]  Ibrahim C. Abou-Faycal,et al.  On the capacity of additive white alpha-stable noise channels , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[28]  S. Asmussen,et al.  Approximations of small jumps of Lévy processes with a view towards simulation , 2001, Journal of Applied Probability.

[29]  Simon J. Godsill,et al.  Forecasting High-Frequency Futures Returns Using Online Langevin Dynamics , 2012, IEEE Journal of Selected Topics in Signal Processing.

[30]  Kiseon Kim,et al.  Robust minimax detection of a weak signal in noise with a bounded variance and density value at the center of symmetry , 2006, IEEE Transactions on Information Theory.

[31]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[32]  Vidmantas Bentkus,et al.  Lévy–LePage Series Representation of Stable Vectors: Convergence in Variation , 2001 .

[33]  Marina Riabiz On Latent Variable Models for Bayesian Inference with Stable Distributions and Processes , 2019 .

[34]  P. Lee,et al.  14. Simulation and Chaotic Behaviour of α‐Stable Stochastic Processes , 1995 .

[35]  Friedrich Götze,et al.  Bounds for the accuracy of Poissonian approximations of stable laws , 1996 .

[36]  E. Fama The Behavior of Stock-Market Prices , 1965 .

[37]  J. Rosínski Series Representations of Lévy Processes from the Perspective of Point Processes , 2001 .

[38]  Arnaud Gloter,et al.  Estimating functions for SDE driven by stable Lévy processes , 2019, Annales de l'Institut Henri Poincaré, Probabilités et Statistiques.

[39]  Robert Scheichl,et al.  An Euler–Poisson scheme for Lévy driven stochastic differential equations , 2016, Journal of Applied Probability.

[40]  Simon J. Godsill,et al.  Bayesian Inference for Continuous-Time Arma Models Driven by Non-Gaussian LÉVY Processes , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[41]  Marco J. Lombardi,et al.  On-line Bayesian Estimation of Signals in Symmetric α-Stable Noise , 2004 .

[42]  Florin Ciucu,et al.  Delay Bounds in Communication Networks With Heavy-Tailed and Self-Similar Traffic , 2009, IEEE Transactions on Information Theory.

[43]  Josiane Zerubia,et al.  SAR image filtering based on the heavy-tailed Rayleigh model , 2006, IEEE Transactions on Image Processing.

[44]  Steffen Dereich,et al.  Multilevel Monte Carlo for L\'evy-driven SDEs: Central limit theorems for adaptive Euler schemes , 2016, 1602.00548.