Entropy of hydrological systems under small samples: Uncertainty and variability

Summary Entropy theory has been increasingly applied in hydrology in both descriptive and inferential ways. However, little attention has been given to the small-sample condition widespread in hydrological practice, where either hydrological measurements are limited or are even nonexistent. Accordingly, entropy estimated under this condition may incur considerable bias. In this study, small-sample condition is considered and two innovative entropy estimators, the Chao–Shen (CS) estimator and the James–Stein-type shrinkage (JSS) estimator, are introduced. Simulation tests are conducted with common distributions in hydrology, that lead to the best-performing JSS estimator. Then, multi-scale moving entropy-based hydrological analyses (MM-EHA) are applied to indicate the changing patterns of uncertainty of streamflow data collected from the Yangtze River and the Yellow River, China. For further investigation into the intrinsic property of entropy applied in hydrological uncertainty analyses, correlations of entropy and other statistics at different time-scales are also calculated, which show connections between the concept of uncertainty and variability.

[1]  Walter M. Grayman,et al.  Incorporating Uncertainty and Variability in Engineering Analysis , 2005 .

[2]  Grey Nearing,et al.  Estimating information entropy for hydrological data: One‐dimensional case , 2014 .

[3]  Vijay P. Singh,et al.  Assessment of Environmental Flow Requirements by Entropy-Based Multi-Criteria Decision , 2013, Water Resources Management.

[4]  Xi Chen,et al.  Sample entropy‐based adaptive wavelet de‐noising approach for meteorologic and hydrologic time series , 2014 .

[5]  Dong Wang,et al.  Sensitivity analysis of the probability distribution of groundwater level series based on information entropy , 2012, Stochastic Environmental Research and Risk Assessment.

[6]  Amir AghaKouchak,et al.  Entropy–Copula in Hydrology and Climatology , 2014 .

[7]  Vijay P. Singh,et al.  Entropy-Based Parameter Estimation In Hydrology , 1998 .

[8]  Vijay P. Singh,et al.  Modeling multisite streamflow dependence with maximum entropy copula , 2013 .

[9]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[10]  Vijay P. Singh,et al.  Hybrid fuzzy and optimal modeling for water quality evaluation , 2007 .

[11]  Alfred O. Hero,et al.  Estimating epistemic and aleatory uncertainties during hydrologic modeling: An information theoretic approach , 2013 .

[12]  Vijay P. Singh,et al.  Hydrologic Synthesis Using Entropy Theory: Review , 2011 .

[13]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[14]  Y. Lian,et al.  Entropy-based assessment and zoning of rainfall distribution , 2013 .

[15]  Zhongwei Li,et al.  Multi-scale entropy analysis of Mississippi River flow , 2007 .

[16]  Nick van de Giesen,et al.  An information-theoretical perspective on weighted ensemble forecasts , 2013 .

[17]  A. Orlitsky,et al.  Always Good Turing: Asymptotically Optimal Probability Estimation , 2003, Science.

[18]  S. Fleming,et al.  Availability, volatility, stability, and teleconnectivity changes in prairie water supply from Canadian Rocky Mountain sources over the last millennium , 2013 .

[19]  D. Horvitz,et al.  A Generalization of Sampling Without Replacement from a Finite Universe , 1952 .

[20]  J. Amorocho,et al.  Entropy in the assessment of uncertainty in hydrologic systems and models , 1973 .

[21]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[22]  Yoram Rubin,et al.  On minimum relative entropy concepts and prior compatibility issues in vadose zone inverse and forward modeling , 2005 .

[23]  T. Phillips,et al.  How well do CMIP5 climate simulations replicate historical trends and patterns of meteorological droughts? , 2015 .

[24]  Vijay P. Singh,et al.  Integrating Entropy and Copula Theories for Hydrologic Modeling and Analysis , 2015, Entropy.

[25]  I. Good THE POPULATION FREQUENCIES OF SPECIES AND THE ESTIMATION OF POPULATION PARAMETERS , 1953 .

[26]  Vijay P. Singh,et al.  Association between Uncertainties in Meteorological Variables and Water-Resources Planning for the State of Texas , 2011 .

[27]  F. Huang,et al.  Flow-Complexity Analysis of the Upper Reaches of the Yangtze River, China , 2011 .

[28]  A. Chao,et al.  Nonparametric estimation of Shannon’s index of diversity when there are unseen species in sample , 2004, Environmental and Ecological Statistics.

[29]  V. Singh,et al.  The entropy theory as a tool for modelling and decision-making in environmental and water resources. , 2000 .

[30]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[31]  Alan Agresti,et al.  Bayesian inference for categorical data analysis , 2005, Stat. Methods Appl..

[32]  William M. Shyu,et al.  Local Regression Models , 2017 .

[33]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[34]  Xiaohong Chen,et al.  Hydrological effects of water reservoirs on hydrological processes in the East River (China) basin: complexity evaluations based on the multi‐scale entropy analysis , 2012 .

[35]  P. E. O'connell,et al.  IAHS Decade on Predictions in Ungauged Basins (PUB), 2003–2012: Shaping an exciting future for the hydrological sciences , 2003 .

[36]  William Bialek,et al.  Entropy and Inference, Revisited , 2001, NIPS.

[37]  Vijay P. Singh,et al.  Single‐site monthly streamflow simulation using entropy theory , 2011 .

[38]  Vijay P. Singh,et al.  Entropy-Based Method for Bivariate Drought Analysis , 2013 .

[39]  P. E. Vijay P. Singh,et al.  Entropy Theory in Hydraulic Engineering: An Introduction , 2014 .

[40]  Holger R. Maier,et al.  Selection of input variables for data driven models: An average shifted histogram partial mutual information estimator approach , 2009 .

[41]  Wade T. Crow,et al.  An approach to quantifying the efficiency of a Bayesian filter , 2013 .

[42]  Bin Yu,et al.  Coverage-adjusted entropy estimation. , 2007, Statistics in medicine.

[43]  V. Singh,et al.  THE USE OF ENTROPY IN HYDROLOGY AND WATER RESOURCES , 1997 .

[44]  Ga Miller,et al.  Note on the bias of information estimates , 1955 .

[45]  J. Gibbs Elementary Principles in Statistical Mechanics , 1902 .

[46]  Vijay P. Singh,et al.  Entropy Theory in Hydrologic Science and Engineering , 2014 .

[47]  Korbinian Strimmer,et al.  Entropy Inference and the James-Stein Estimator, with Application to Nonlinear Gene Association Networks , 2008, J. Mach. Learn. Res..

[48]  S. Weijs,et al.  Why hydrological predictions should be evaluated using information theory , 2010 .