Entropy Theory for Streamflow Forecasting

Streamflow forecasting is used in river training and management, river restoration, reservoir operation, power generation, irrigation, and navigation. In hydrology, streamflow forecasting is often done using time series analysis. Although monthly streamflow time series are stochastic, they exhibit seasonal and periodic patterns. Therefore, streamflow forecasting entails modeling two main aspects: seasonality and correlation structure. Spectral analysis can be employed to characterize patterns of streamflow variation and identify the periodicity of streamflow. That is, it permits to extract significant information for understanding the streamflow process and prediction thereof. For forecasting streamflow, spectral analysis has, however, not yet been widely applied. Streamflow spectra can be determined using entropy theory. There are three ways to employ entropy theory: (1) Burg entropy, (2) configurational entropy, and (3) relative entropy. In either way, the methodology involves determination of spectral density, determination of parameters, and extension of autocorrelation function. This paper reviews the methods of spectral analysis using the entropy theory and tests them using streamflow data.

[1]  R H Jones,et al.  Time series with periodic structure. , 1967, Biometrika.

[2]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[3]  Roy W. Koch,et al.  Surface Climate and Streamflow Variability in the Western United States and Their Relationship to Large‐Scale Circulation Indices , 1991 .

[4]  Yan-Fang Sang,et al.  Period identification in hydrologic time series using empirical mode decomposition and maximum entropy spectral analysis , 2012 .

[5]  Jose D. Salas,et al.  ARMA Model identification of hydrologic time series , 1982 .

[6]  B. Frieden Restoring with maximum likelihood and maximum entropy. , 1972, Journal of the Optical Society of America.

[7]  Forecasting streamflows in Australia using the tropical Indo-Pacific thermocline as predictor , 2007 .

[8]  Ö. F. Durdu Application of linear stochastic models for drought forecasting in the Büyük Menderes river basin, western Turkey , 2010 .

[9]  S. Shukla,et al.  Use of a standardized runoff index for characterizing hydrologic drought , 2008 .

[10]  Alaa H. Aly,et al.  Practical applications of spectral analysis to hydrologic time series , 2002 .

[11]  V. Singh,et al.  Understanding changes in water availability in the Rio Grande/Río Bravo del Norte basin under the influence of large-scale circulation indices using the Noah land surface model , 2012 .

[12]  D. Garen,et al.  Daily Updating of Operational Statistical Seasonal Water Supply Forecasts for the western U.S. 1 , 2009 .

[13]  D. Woolhiser,et al.  Southern oscillation effects on daily precipitation in the southwestern United States , 1993 .

[14]  T. Ulrych,et al.  Minimum relative entropy: Forward probabilistic modeling , 1993 .

[15]  C. Bishop,et al.  Ensemble Transform Kalman Filter-based ensemble perturbations in an operational global prediction system at NCEP , 2006 .

[16]  Hoshin Vijai Gupta,et al.  Do Nash values have value? , 2007 .

[17]  Keith W. Hipel,et al.  Forecasting monthly riverflow time series , 1985 .

[18]  T. Ulrych,et al.  Minimum Relative Entropy Inversion: Theory and Application to Recovering the Release History of a Groundwater Contaminant , 1996 .

[19]  P. F. Krstanovic An entropy based method for flood forecasting , 1989 .

[20]  V. Singh,et al.  Mathematical models of small watershed hydrology and applications. , 2002 .

[21]  Gerald N. Day,et al.  Extended Streamflow Forecasting Using NWSRFS , 1985 .

[22]  Kevin E. Trenberth,et al.  The Definition of El Niño. , 1997 .

[23]  Philip Hans Franses,et al.  A seasonal periodic long memory model for monthly river flows , 1998, Environ. Model. Softw..

[24]  K. Beven,et al.  Testing a physically-based flood forecasting model (TOPMODEL) for three U.K. catchments , 1984 .

[25]  Sergio M. Vicente-Serrano,et al.  Accurate Computation of a Streamflow Drought Index , 2012 .

[26]  Ashish Sharma,et al.  Seasonal to interannual rainfall probabilistic forecasts for improved water supply management: Part 3 — A nonparametric probabilistic forecast model , 2000 .

[27]  D. McLaughlin,et al.  Hydrologic Data Assimilation with the Ensemble Kalman Filter , 2002 .

[28]  FREQUENCY RESOLUTION: A COMPARATIVE STUDY OF FOUR ENTROPY METHODS , 1986 .

[29]  Anthony G. Constantinides,et al.  International conference on digital signal processing , 1979 .

[30]  Vijay P. Singh,et al.  A univariate model for long-term streamflow forecasting , 1991 .

[31]  K. Chau,et al.  Predicting monthly streamflow using data‐driven models coupled with data‐preprocessing techniques , 2009 .

[32]  A. Mangin,et al.  Climatic and hydrological variations during the last 117-166 years in the south of the Iberian Peninsula, from spectral and correlation analyses and continuous wavelet analyses , 2006 .

[33]  Thomas C. Piechota,et al.  Drought and Regional Hydrologic Variation in the United States: Associations with the El Niño-Southern Oscillation , 1996 .

[34]  E. Toth,et al.  Comparison of short-term rainfall prediction models for real-time flood forecasting , 2000 .

[35]  V. Singh,et al.  Computer Models of Watershed Hydrology , 1995 .

[36]  R. C. Papademetriou Experimental comparison of two information-theoretic spectral estimators , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[37]  I. Tošić,et al.  Analysis of precipitation series for Belgrade , 2005 .

[38]  A. Ramachandra Rao,et al.  Maximum entropy spectral analysis of hydrologic data , 1988 .

[39]  Laurence C. Smith,et al.  Stream flow characterization and feature detection using a discrete wavelet transform , 1998 .

[40]  R. Ibbitt,et al.  Hydrological data assimilation with the ensemble Kalman filter: Use of streamflow observations to update states in a distributed hydrological model , 2007 .

[41]  Michael A. Tzannes,et al.  A general method of minimum cross-entropy spectral estimation , 1985, IEEE Trans. Acoust. Speech Signal Process..

[42]  R. Abrahart,et al.  Comparing neural network and autoregressive moving average techniques for the provision of continuous river flow forecasts in two contrasting catchments , 2000 .

[43]  David Labat,et al.  Recent advances in wavelet analyses: Part 1. A review of concepts , 2005 .

[44]  Adarsh Singh,et al.  Daily river flow forecasting using wavelet ANN hybrid models , 2010 .

[45]  Robert M. Gray,et al.  Minimum Cross-Entropy Pattern Classification and Cluster Analysis , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Manfred R. Schroeder Linear prediction, extermal entropy and prior information in speech signal analysis and synthesis , 1982, Speech Commun..

[47]  A. Mishra,et al.  Drought forecasting using stochastic models , 2005 .

[48]  Jose D. Salas,et al.  Estimation of ARMA Models with seasonal parameters , 1982 .

[49]  O. Kisi Wavelet regression model for short-term streamflow forecasting. , 2010 .

[50]  Slobodan P. Simonovic,et al.  Estimation of missing streamflow data using principles of chaos theory , 2002 .

[51]  Florian Pappenberger,et al.  Ensemble flood forecasting: a review. , 2009 .

[52]  T. M. Cengiz Periodic structures of Great Lakes levels using wavelet analysis , 2011 .

[53]  Josyane Ronchail,et al.  Recent advances in wavelet analyses: Part 2—Amazon, Parana, Orinoco and Congo discharges time scale variability , 2005 .

[54]  Cedrick Collomb Burg's Method, Algorithm and Recursion , 2009 .

[55]  Patrick Durand,et al.  Study of three subsurface hydrologic systems based on spectral and cross-spectral analysis of time series , 1999 .

[56]  Robert E. Davis,et al.  The continuing search for an anthropogenic climate change signal: Limitations of correlation‐based approaches , 1997 .

[57]  S. Morid,et al.  Drought forecasting using artificial neural networks and time series of drought indices , 2007 .

[58]  S. Yakowitz,et al.  Nearest‐neighbor methods for nonparametric rainfall‐runoff forecasting , 1987 .

[59]  D. Garen Improved Techniques in Regression‐Based Streamflow Volume Forecasting , 1992 .

[60]  E. Pardo‐Igúzquiza,et al.  Maximum entropy spectral analysis of climatic time series revisited: Assessing the statistical significance of estimated spectral peaks , 2006 .

[61]  E. J. Hannan,et al.  Multivariate linear time series models , 1984, Advances in Applied Probability.

[62]  S. Gull,et al.  Image reconstruction from incomplete and noisy data , 1978, Nature.

[63]  Jan Adamowski,et al.  Determining the amplitude and timing of streamflow discontinuities: A cross wavelet analysis approach , 2014 .

[64]  Nicolas R. Dalezios,et al.  Maximum entropy spectra for regional precipitation analysis and forecasting , 1989 .

[65]  J. Delleur,et al.  Kalman Filter Estimation and Prediction of Daily Stream Flows: I. Review, Algorithm, and Simulation Experiments , 1985 .

[66]  H. Tabari,et al.  Hydrological Drought Assessment in Northwestern Iran Based on Streamflow Drought Index (SDI) , 2012, Water Resources Management.

[67]  P. Krause,et al.  COMPARISON OF DIFFERENT EFFICIENCY CRITERIA FOR HYDROLOGICAL MODEL ASSESSMENT , 2005 .

[68]  J. Shore Minimum cross-entropy spectral analysis , 1981 .

[69]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[70]  Development and testing of a multivariate, seasonal ARMA(1,1) model , 1988 .

[71]  Allan D. Woodbury,et al.  A FORTRAN program to produce minimum relative entropy distributions , 2004, Comput. Geosci..

[72]  H. Hasanean Fluctuations of surface air temperature in the Eastern Mediterranean , 2001 .

[73]  Mathew Barlow,et al.  ENSO, Pacific Decadal Variability, and U.S. Summertime Precipitation, Drought, and Stream Flow , 2001 .

[74]  N. Wiener The Wiener RMS (Root Mean Square) Error Criterion in Filter Design and Prediction , 1949 .

[75]  Climent Nadeu Finite length cepstrum modelling - A simple spectrum estimation technique , 1992, Signal Process..

[76]  R. Bhandari Maximum Entropy Spectral Analysis - Some Comments , 1978 .

[77]  T. Ulrych,et al.  Minimum relative entropy and probabilistic inversion in groundwater hydrology , 1998 .

[78]  G. Yule On a Method of Investigating Periodicities in Disturbed Series, with Special Reference to Wolfer's Sunspot Numbers , 1927 .

[79]  Chester F. Ropelewski,et al.  North American Precipitation and Temperature Patterns Associated with the El Niño/Southern Oscillation (ENSO) , 1986 .

[80]  ENEL-CRIS Savizio Idrologico,et al.  A comparison of parametric and non-parametric methods for runoff forecasting , 2007 .

[81]  D. Lettenmaier,et al.  An ensemble approach for attribution of hydrologic prediction uncertainty , 2008 .

[82]  A NEW APPROACH TO THE ESTIMATION OF CONTINUOUS SPECTRA , 1981 .

[83]  D. G. Watts,et al.  Application of Linear Random Models to Four Annual Streamflow Series , 1970 .

[84]  Michael Ghil,et al.  ADVANCED SPECTRAL METHODS FOR CLIMATIC TIME SERIES , 2002 .

[85]  V. Singh Entropy Spectral Analyses , 2013 .

[86]  R. Modarres Streamflow drought time series forecasting , 2007 .

[87]  Keith W. Hipel,et al.  Advances in Box‐Jenkins modeling: 2. Applications , 1977 .

[88]  Arun Kumar,et al.  A retrospective assessment of National Centers for Environmental Prediction climate model-based ensemble hydrologic forecasting in the western United States , 2005 .

[89]  P. E. O'connell,et al.  An introduction to the European Hydrological System — Systeme Hydrologique Europeen, “SHE”, 2: Structure of a physically-based, distributed modelling system , 1986 .

[90]  David R. Cox,et al.  Time Series Analysis , 2012 .

[91]  Q. J. Wang,et al.  Multisite probabilistic forecasting of seasonal flows for streams with zero value occurrences , 2011 .

[92]  T. McMahon,et al.  Global ENSO-streamflow teleconnection, streamflow forecasting and interannual variability , 2002 .

[93]  A. I. McLeod,et al.  Advances in Box-Jenkins modeling: 1. Model construction , 1977 .

[94]  Murad S. Taqqu,et al.  A seasonal fractional ARIMA Model applied to the Nile River monthly flows at Aswan , 2000 .

[95]  Vijay P. Singh,et al.  Low frequency drought variability associated with climate indices , 2009 .

[96]  J. A. Ferreira,et al.  Singular spectrum analysis and forecasting of hydrological time series , 2006 .

[97]  Fourier analysis of Nile flood levels , 1984 .

[98]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[99]  Craig H. Bishop,et al.  Adaptive sampling with the ensemble transform Kalman filter , 2001 .

[100]  O. Kisi,et al.  Short-term and long-term streamflow forecasting using a wavelet and neuro-fuzzy conjunction model , 2010 .

[101]  Vijay P. Singh,et al.  Hydrologic Synthesis Using Entropy Theory: Review , 2011 .

[102]  Upmanu Lall,et al.  Seasonality of streamflow: The Upper Mississippi River , 1999 .

[103]  Eulogio Pardo-Igúzquiza,et al.  Spectral and cross-spectral analysis of uneven time series with the smoothed Lomb-Scargle periodogram and Monte Carlo evaluation of statistical significance , 2012, Comput. Geosci..

[104]  D. E. Boekee,et al.  Minimum information spectral analysis , 1987 .

[105]  Nai-Long Wu An explicit solution and data extension in the maximum entropy method , 1983 .

[106]  S. Yakowitz,et al.  Rainfall-runoff forecasting methods, old and new , 1987 .

[107]  V. Singh,et al.  THE USE OF ENTROPY IN HYDROLOGY AND WATER RESOURCES , 1997 .

[108]  Ling Chen,et al.  An experimental comparison between maximum entropy and minimum relative-entropy spectral analysis , 1993, IEEE Trans. Signal Process..

[109]  Michael A. Palecki,et al.  Pacific and Atlantic Ocean influences on multidecadal drought frequency in the United States , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[110]  A. Berger,et al.  Evolutive spectral analysis of sunspot data over the past 300 years , 1990, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[111]  H. G. Rees,et al.  Spatio-temporal development of streamflow droughts in north- west Europe , 2002 .

[112]  R. Cùrrie Geomagnetic line spectra-2 to 70 years , 1973 .

[113]  V. Singh,et al.  A COMPARISON OF TRANSFORMATION METHODS FOR FLOOD FREQUENCY ANALYSIS , 1986 .

[114]  Keith Beven,et al.  A dynamic TOPMODEL , 2001 .

[115]  V. Singh,et al.  Entropy Theory and Its Applications in Risk Analysis , 2007 .

[116]  K. Hipel,et al.  Time series modelling of water resources and environmental systems , 1994 .

[117]  D A Gray Maximum Entropy Spectrum Analysis Technique - A Review of Its Theoretical Properties. , 1977 .

[118]  T. McKee,et al.  THE RELATIONSHIP OF DROUGHT FREQUENCY AND DURATION TO TIME SCALES , 1993 .

[119]  Vijay P. Singh,et al.  A real-time flood forecasting model based on maximum-entropy spectral analysis: II. Application , 1993 .

[120]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[121]  Robert M. Gray,et al.  Rate-distortion speech coding with a minimum discrimination information distortion measure , 1981, IEEE Trans. Inf. Theory.

[122]  J. Adamowski River flow forecasting using wavelet and cross‐wavelet transform models , 2008 .

[123]  Elizabeth E. Hoyt,et al.  A Review of Concepts , 2016 .

[124]  Sophie Lambert-Lacroix,et al.  Periodic Levinson-Durbin algorithm for entropy maximization , 2011 .

[125]  V. Singh,et al.  Application and testing of the simple rainfall-runoff model SIMHYD , 2002 .

[126]  Upmanu Lall,et al.  Seasonal to interannual rainfall probabilistic forecasts for improved water supply management : Part 2 - Predictor identification of quarterly rainfall using ocean-atmosphere information , 2000 .

[127]  R. Bradley,et al.  Winter precipitation variability and corresponding teleconnections over the northeastern United States , 2014 .

[128]  Jan Adamowski,et al.  Influence of the 11 year solar cycle on annual streamflow maxima in Southern Canada , 2012 .

[129]  Casey Brown,et al.  Multivariate streamflow forecasting using independent component analysis , 2008 .

[130]  Maziar Palhang,et al.  Generalization performance of support vector machines and neural networks in runoff modeling , 2009, Expert Syst. Appl..

[131]  Climatic influences on streamflow variability: A comparison between southeastern Australia and southeastern United States of America , 1990 .

[132]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[133]  O. Kisi Neural Networks and Wavelet Conjunction Model for Intermittent Streamflow Forecasting , 2009 .

[134]  Evgueni A. Haroutunian,et al.  Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.

[135]  Vijay P. Singh,et al.  Configurational entropy theory for streamflow forecasting , 2015 .

[136]  Dennis P. Lettenmaier,et al.  Predictability of seasonal runoff in the Mississippi River basin , 2003 .

[137]  Juan Frausto-Solís,et al.  Short-term streamflow forecasting: ARIMA vs neural networks , 2008 .

[138]  Dong Wang,et al.  The relation between periods’ identification and noises in hydrologic series data , 2009 .

[139]  J. W. Delleur,et al.  KALMAN FILTER ESTIMATION AND PREDICTION OF DAILY STREAM FLOWS: II. APPLICATION TO THE POTOMAC RIVER , 1985 .

[140]  Edward K. Wong,et al.  A survey on the maximum entropy method and parameter spectral estimation , 1990 .

[141]  Robert B. Randall,et al.  Enhancement of autoregressive model based gear tooth fault detection technique by the use of minimum entropy deconvolution filter , 2007 .

[142]  R.W. Schafer,et al.  From frequency to quefrency: a history of the cepstrum , 2004, IEEE Signal Processing Magazine.

[143]  G. McCabe,et al.  DECADAL VARIATIONS IN THE STRENGTH OF ENSO TELECONNECTIONS WITH PRECIPITATION IN THE WESTERN UNITED STATES , 1999 .

[144]  T. McMahon,et al.  El Nino/Southern Oscillation and Australian rainfall, streamflow and drought : Links and potential for forecasting , 1998 .