A Brief History of Long Memory: Hurst, Mandelbrot and the Road to ARFIMA, 1951-1980

Long memory plays an important role in many fields by determining the behaviour and predictability of systems; for instance, climate, hydrology, finance, networks and DNA sequencing. In particular, it is important to test if a process is exhibiting long memory since that impacts the accuracy and confidence with which one may predict future events on the basis of a small amount of historical data. A major force in the development and study of long memory was the late Benoit B. Mandelbrot. Here, we discuss the original motivation of the development of long memory and Mandelbrot’s influence on this fascinating field. We will also elucidate the sometimes contrasting approaches to long memory in different scientific communities.

[1]  Luciano Pietronero,et al.  FRACTALS IN PHYSICS , 1990 .

[2]  J. M. Mejía,et al.  Long memory monthly streamflow simulation by a broken line model , 1972 .

[3]  Dennis P. Lettenmaier,et al.  Operational assessment of hydrologic models of long-term persistence , 1977 .

[4]  B. Mandlebrot.  The Variation of Certain Speculative Prices , 1963 .

[5]  W. Rippl.  The capacity of storage reservoirs for water supply , 1883 .

[6]  Benoit B. Mandelbrot,et al.  Multifractals and 1/f noise : wild self-affinity in physics (1963-1976) : selecta volume N , 1999 .

[7]  M. Allen,et al.  Sensitivity of Climate Change Detection and Attribution to the Characterization of Internal Climate Variability , 2014 .

[8]  E. H. Lloyd,et al.  Long-Term Storage: An Experimental Study. , 1966 .

[9]  Roy E. Plotnick.  Fractals and Chaos in Geology and Geophysics , 1994 .

[10]  Murad S. Taqqu,et al.  Benoît Mandelbrot and Fractional Brownian Motion , 2013, 1302.5237.

[11]  Richard T. Baillie,et al.  Long memory processes and fractional integration in econometrics , 1996 .

[12]  J. R. Wallis,et al.  Noah, Joseph, and Operational Hydrology , 1968 .

[13]  E. H. Lloyd.  Stochastic Reservoir Theory , 1967 .

[14]  Benoit B. Mandelbrot,et al.  Comment on ‘Stochastic Models in Hydrology’ by Adrian E. Scheidegger , 1970 .

[15]  M. M. Siddiqui.  The Asymptotic Distribution of the Range and Other Functions of Partial Sums of Stationary Processes , 1976 .

[16]  C. Granger,et al.  AN INTRODUCTION TO LONG‐MEMORY TIME SERIES MODELS AND FRACTIONAL DIFFERENCING , 1980 .

[17]  J. R. Wallis,et al.  Robustness of the rescaled range R/S in the measurement of noncyclic long run statistical dependence , 1969 .

[18]  Nan-Jung Hsu,et al.  Bayesian analysis of fractionally integrated ARMA with additive noise , 2003 .

[19]  J. R. Wallis,et al.  FIRM RESERVOIR YIELD—HOW RELIABLE ARE HISTORIC HYDROLOGICAL RECORDS? , 1973 .

[20]  N. Watkins,et al.  Bunched black (and grouped grey) swans: Dissipative and non‐dissipative models of correlated extreme fluctuations in complex geosystems , 2013 .

[21]  R. Kupferman.  Fractional Kinetics in Kac–Zwanzig Heat Bath Models , 2004 .

[22]  D. M. Hutton,et al.  The (Mis)Behaviour of Markets: A Fractual View of Risk, Ruin and Reward , 2008 .

[23]  A. I. McLeod,et al.  Preservation of the rescaled adjusted range: 1. A reassessment of the Hurst Phenomenon , 1978 .

[24]  H. Hurst.  METHODS OF USING LONG-TERM STORAGE IN RESERVOIRS. , 1956 .

[25]  J. R. Wallis,et al.  Computer Experiments with Fractional Gaussian Noises: Part 2, Rescaled Ranges and Spectra , 1969 .

[26]  Donald B. Percival,et al.  Interpretation of North Pacific Variability as a Short- and Long-Memory Process* , 2001 .

[27]  Gary Koop,et al.  Bayesian Analysis of Long Memory and Persistence using ARFIMA Models , 1995 .

[28]  A. I. McLeod,et al.  Preservation of the rescaled adjusted range: 2. Simulation studies using Box‐Jenkins Models , 1978 .

[29]  R. Bhattacharya,et al.  THE HURST EFFECT UNDER TRENDS , 1983 .

[30]  Jeffrey D. Scargle,et al.  Fractal-Based Point Processes , 2007, Technometrics.

[31]  H. E. Hurst,et al.  Long-Term Storage Capacity of Reservoirs , 1951 .

[32]  H. Handa,et al.  Discussion to 22 , 1967 .

[33]  J. R. Wallis,et al.  Computer Experiments With Fractional Gaussian Noises: Part 1, Averages and Variances , 1969 .

[34]  J. R. Wallis,et al.  Sensitivity of reservoir design to the generating mechanism of inflows , 1972 .

[35]  A. Lo.  Long-Term Memory in Stock Market Prices , 1989 .

[36]  W. Feller.  The Asymptotic Distribution of the Range of Sums of Independent Random Variables , 1951 .

[37]  Kenneth W. Potter,et al.  Evidence for nonstationarity as a physical explanation of the Hurst Phenomenon , 1976 .

[38]  Eric R. Ziegel,et al.  Time Series: Theory and Methods (2nd ed,) , 2012 .

[39]  R. K. Adenstedt,et al.  On Large-Sample Estimation for the Mean of a Stationary Random Sequence , 1974 .

[40]  Streamflow simulation: 3. The broken line process and operational hydrology , 1974 .

[41]  Stephen P. Brooks,et al.  Adaptive Proposal Construction for Reversible Jump MCMC , 2008 .

[42]  ON THE MOMENTS OF THE MAXIMUM OF PARTIAL SUMS OF A FINITE NUMBER OF INDEPENDENT NORMAL VARIATES , 1956 .

[43]  V. Klemeš,et al.  One hundred years of applied storage reservoir theory , 1987 .

[44]  Ignacio Rodriguez-Iturbe,et al.  Streamflow simulation: 2. The broken line process as a potential model for hydrologic simulation , 1972 .

[45]  Holger Kantz,et al.  Fluctuations of 1/f noise and the low-frequency cutoff paradox. , 2012, Physical review letters.

[46]  THE VARIANCE OF THE MAXIMUM OF PARTIAL SUMS OF A FINITE NUMBER OF INDEPENDENT NORMAL VARIATES , 1955 .

[47]  Sounak Chakraborty,et al.  A Bayesian approach to estimating the long memory parameter , 2009 .

[48]  V. Klemeš.  The Hurst Phenomenon: A puzzle? , 1974 .

[49]  Armin Bunde,et al.  How significant is West Antarctic warming , 2014 .

[50]  H. Markowitz,et al.  The Random Character of Stock Market Prices. , 1965 .

[51]  Christian Franzke,et al.  Nonlinear Trends, Long-Range Dependence, and Climate Noise Properties of Surface Temperature , 2012 .

[52]  Robert B. Gramacy,et al.  Efficient Bayesian inference for long memory processes , 2014, 1403.2940.

[53]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[54]  L. Bachelier,et al.  Théorie de la spéculation , 1900 .

[55]  Gennady Samorodnitsky,et al.  Long Range Dependence , 2007, Found. Trends Stoch. Syst..

[56]  B. Mandelbrot.  Broken line process derived as an approximation to fractional noise , 1972 .

[57]  R. Ehlers.  Bayesian Analysis of Order Uncertainty in ARIMA Models , 2006 .

[58]  R. Davies,et al.  Tests for Hurst effect , 1987 .

[59]  A. I. McLeod,et al.  Preservation of the rescaled adjusted range: 3. Fractional Gaussian noise algorithms , 1978 .

[60]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[61]  Clive W. J. Granger,et al.  New Classes of Time Series Models , 1978 .

[62]  Jan Beran,et al.  Statistics for long-memory processes , 1994 .

[63]  D. Passoja.  The Fractalist: Memoir of a Scientific Maverick. , 2013 .

[64]  Murad S. Taqqu,et al.  Theory and applications of long-range dependence , 2003 .

[65]  P. A. P. Moran,et al.  On the range of cumulative sums , 1964 .

[66]  N. T. Kottegoda,et al.  Stochastic Modelling of Riverflow Time Series , 1977 .

[67]  J. K. Friend,et al.  The Theory of Storage , 1962 .

[68]  R. Srikanthan,et al.  Long-memory flow models in reservoir analysis: What is their practical value? , 1981 .

[69]  D.sc..  THE PROBLEM OF LONG-TERM STORAGE IN RESERVOIRS , 1956 .

[70]  L. Gil‐Alana.  Statistical Modeling of the Temperatures in the Northern Hemisphere Using Fractional Integration Techniques , 2005 .

[71]  R. D. Black,et al.  DISCUSSION. METHODS OF USING LONG-TERM STORAGE IN RESERVOIRS. , 1956 .

[72]  M. Taqqu,et al.  Stable Non-Gaussian Random Processes : Stochastic Models with Infinite Variance , 1995 .

[73]  N. Watkins.  Mandelbrot's 1/f fractional renewal models of 1963-67: The non-ergodic missing link between change points and long range dependence , 2016, 1603.00738.

[74]  Benoit B. Mandelbrot,et al.  Some noises with I/f spectrum, a bridge between direct current and white noise , 1967, IEEE Trans. Inf. Theory.

[75]  Benoit B. Mandelbrot,et al.  The Fractalist: Memoir of a Scientific Maverick , 2012 .

[76]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[77]  Christian L. E. Franzke,et al.  Long-Range Dependence and Climate Noise Characteristics of Antarctic Temperature Data , 2010 .

[78]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[79]  B. Mandelbrot.  A Fast Fractional Gaussian Noise Generator , 1971 .

[80]  M. Taqqu.  Note on evaluations of R/S for fractional noises and geophysical records , 1970 .

[81]  Jose M. Mejia,et al.  Streamflow Simulation: 1. A new look at Markovian Models, fractional Gaussian noise, and Crossing Theory , 1972 .

[82]  J. R. Wallis,et al.  Some long‐run properties of geophysical records , 1969 .

[83]  D. W. Allan,et al.  A statistical model of flicker noise , 1966 .

[84]  C. Granger.  Long memory relationships and the aggregation of dynamic models , 1980 .

[85]  THE MEAN AND VARIANCE OF THE MAXIMUM OF THE ADJUSTED PARTIAL SUMS OF A FINITE NUMBER OF INDEPENDENT NORMAL VARIATES , 1957 .

[86]  H. Hurst,et al.  A Suggested Statistical Model of some Time Series which occur in Nature , 1957, Nature.

[87]  Translation from Russian , 2000 .

[88]  B. Mandelbrot,et al.  Fractional Brownian Motions, Fractional Noises and Applications , 1968 .

[89]  F. Diebold,et al.  Long Memory and Regime Switching , 2000 .

[90]  Allen Hazen,et al.  Storage to be Provided Impounding Reservoirs for Municipal Water Supply , 1913 .

[91]  ON THE RANGE OF PARTIAL SUMS OF A FINITE NUMBER OF INDEPENDENT NORMAL VARIATES , 1953 .

[92]  Edward H. Wiser,et al.  Stochastic Models in Hydrology , 1967 .

[93]  Nalini Ravishanker,et al.  Bayesian analysis of autoregressive fractionally integrated moving‐average processes , 1998 .

[94]  Hashem Dezhbakhsh,et al.  On the typical spectral shape of an economic variable , 2003 .

[95]  R. Gorvett.  Why Stock Markets Crash: Critical Events in Complex Financial Systems , 2005 .

[96]  Brunero Liseo,et al.  Bayesian semiparametric inference on long-range dependence , 2001 .

[97]  B. Mandelbrot.  The Variation of Some Other Speculative Prices , 1967 .

[98]  L. Schmetterer.  Zeitschrift fur Wahrscheinlichkeitstheorie und Verwandte Gebiete. , 1963 .