The stationarity paradigm revisited: Hypothesis testing using diagnostics, summary metrics, and DREAM(ABC)

PUBLICATIONS Water Resources Research RESEARCH ARTICLE 10.1002/2014WR016805 Key Points: Stationarity paradigm is revisited using diagnostic model evaluation with DREAM (ABC) Nonstationarity is not readily apparent from statistical analysis Nonstationarity is evident from analysis of summary metrics Correspondence to: J. A. Vrugt, jasper@uci.edu Citation: Sadegh, M., J. A. Vrugt, C. Xu, and E. Volpi (2015), The stationarity paradigm revisited: Hypothesis testing using diagnostics, summary metrics, and DREAM (ABC) , Water Resour. Res., 51, 9207–9231, doi:10.1002/ 2014WR016805. Received 19 DEC 2014 Accepted 9 SEP 2015 Accepted article online 21 SEP 2015 Published online 28 NOV 2015 The stationarity paradigm revisited: Hypothesis testing using diagnostics, summary metrics, and DREAM (ABC) Mojtaba Sadegh 1 , Jasper A. Vrugt 1,2 , Chonggang Xu 3 , and Elena Volpi 4 Department of Civil and Environmental Engineering, University of California, Irvine, California, USA, 2 Department of Earth System Science, University of California, Irvine, California, USA, 3 Earth and Environmental Sciences Division, Los Alamos National Laboratory, Los Alamos, New Mexico, USA, 4 Department of Engineering, University of Roma Tre, Rome, Italy Abstract Many watershed models used within the hydrologic research community assume (by default) stationary conditions, that is, the key watershed properties that control water flow are considered to be time invariant. This assumption is rather convenient and pragmatic and opens up the wide arsenal of (multi- variate) statistical and nonlinear optimization methods for inference of the (temporally fixed) model param- eters. Several contributions to the hydrologic literature have brought into question the continued usefulness of this stationary paradigm for hydrologic modeling. This paper builds on the likelihood-free diagnostics approach of Vrugt and Sadegh (2013) and uses a diverse set of hydrologic summary metrics to test the stationary hypothesis and detect changes in the watersheds response to hydroclimatic forcing. Models with fixed parameter values cannot simulate adequately temporal variations in the summary statis- tics of the observed catchment data, and consequently, the DREAM (ABC) algorithm cannot find solutions that sufficiently honor the observed metrics. We demonstrate that the presented methodology is able to differentiate successfully between watersheds that are classified as stationary and those that have under- gone significant changes in land use, urbanization, and/or hydroclimatic conditions, and thus are deemed nonstationary. 1. Introduction The flow of water through watersheds is an incredibly complex process controlled by physical characteris- tics of the basin and a myriad of highly interrelated, spatially distributed, water, energy, and vegetation processes. As available measurements lack the resolution and information content required to warrant a detailed characterization of watershed structure, properties, and processes, relatively simple models are used to describe (among others) soil moisture flow, groundwater recharge, surface runoff, preferential flow, root water uptake, and river discharge at different spatial and temporal scales. This includes prediction in space (interpolation/extrapolation) and prediction in time (forecasting). These models describe spatially dis- tributed vegetation and subsurface properties with much simpler homogeneous units using transfer func- tions that describe the flow of water within and between different storage compartments. C 2015. American Geophysical Union. V All Rights Reserved. SADEGH ET AL. Many watershed models used within the hydrologic research community assume (by default) stationary conditions, that is, the key watershed properties that control water flow are considered to be time invariant. As a consequence, the watershed behavior as measured in hydrologic states and fluxes (jointly called varia- bles) is assumed to vary around some constant mean value with fixed variance and serial correlation struc- ture [Clarke, 2007]. This assumption is rather convenient and opens up the wide arsenal of (multivariate) statistical and nonlinear optimization methods for inference of the (temporally fixed) model parameters. Notwithstanding the progress made, several contributions to the hydrologic literature have brought into question the continued usefulness of this stationary paradigm for hydrologic modeling [Westmacott and Burn, 1997; Karl and Knight, 1998; Strupczewski et al., 2001; McCabe and Wolock, 2002; Groisman et al., 2004; Fu et al., 2004; Lins and Slack, 2005; Svensson et al., 2005; Alexander et al., 2006; Hodgkins and Dudley, 2006; Xu et al., 2006; Leclerc and Ouarda, 2007; Milly et al., 2008; Villarini et al., 2009; Kundzewicz, 2011; Stedinger and Griffis, 2011; Vogel et al., 2011; Waage and Kaatz, 2011; Ishak et al., 2013; Salas and Obeysekera, 2014]. For example, Strupczewski et al. [2001] showed evidence of nonstationarity in the annual maximum flows of 39 Polish rivers during the period of 1921–1990. Villarini et al. [2009] examined annual peak discharges from REVISITING SATIONARITY PARADIGM

[1]  J. R. Wallis,et al.  Hydro-Climatological Trends in the Continental United States, 1948-88 , 1994 .

[2]  Donald H. Burn,et al.  Climate change effects on the hydrologic regime within the Churchill-Nelson River Basin , 1997 .

[3]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[4]  Donald H. Burn,et al.  Non-stationary pooled flood frequency analysis , 2003 .

[5]  H. Lins,et al.  Stationarity: Wanted Dead or Alive? 1 , 2011 .

[6]  T. Jiang,et al.  Analysis of spatial distribution and temporal trend of reference evapotranspiration and pan evaporation in Changjiang (Yangtze River) catchment , 2006 .

[7]  Paul D. Bates,et al.  The Regional Hydrology of Extreme Floods in an Urbanizing Drainage Basin , 2002 .

[8]  Jasper A. Vrugt,et al.  Bridging the gap between GLUE and formal statistical approaches: approximate Bayesian computation , 2013 .

[9]  B. Biggs,et al.  Flow variables for ecological studies in temperate streams: groupings based on covariance , 2000 .

[10]  M. Lang,et al.  Statistical analysis of extreme events in a non-stationary context via a Bayesian framework: case study with peak-over-threshold data , 2006 .

[11]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[12]  S. Yue,et al.  Power of the Mann–Kendall and Spearman's rho tests for detecting monotonic trends in hydrological series , 2002 .

[13]  Zbigniew W. Kundzewicz,et al.  Change detection in hydrological records—a review of the methodology / Revue méthodologique de la détection de changements dans les chroniques hydrologiques , 2004 .

[14]  Hubert H. G. Savenije,et al.  A framework to assess the realism of model structures using hydrological signatures , 2012 .

[15]  J. Vrugt,et al.  Toward diagnostic model calibration and evaluation: Approximate Bayesian computation , 2013 .

[16]  Robin T. Clarke,et al.  Estimating trends in data from the Weibull and a generalized extreme value distribution , 2002 .

[17]  Soroosh Sorooshian,et al.  The role of hydrograph indices in parameter estimation of rainfall–runoff models , 2005 .

[18]  Harry F. Lins,et al.  Streamflow trends in the United States , 1999 .

[19]  T. Ouarda,et al.  Bayesian Estimation for GEV-B-Spline Model , 2013 .

[20]  G. Villarini,et al.  Flood peak distributions for the eastern United States , 2009 .

[21]  Hoshin Vijai Gupta,et al.  Regionalization of constraints on expected watershed response behavior for improved predictions in ungauged basins , 2007 .

[22]  T. Ouarda,et al.  Bayesian Nonstationary Frequency Analysis of Hydrological Variables 1 , 2011 .

[23]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[24]  Thibault Mathevet,et al.  Hydrology under change: an evaluation protocol to investigate how hydrological models deal with changing catchments , 2015 .

[25]  M. Feldman,et al.  Population growth of human Y chromosomes: a study of Y chromosome microsatellites. , 1999, Molecular biology and evolution.

[26]  Michael Herbst,et al.  UvA-DARE ( Digital Academic Repository ) Inverse modelling of in situ soil water dynamics : investigating the effect of different prior distributions of the soil hydraulic parameters , 2011 .

[27]  S. Yue,et al.  Corrigendum to ``Power of the Mann-Kendall and Spearman's rho tests for detecting monotonic trends in hydrological series'' [J. Hydrol. 259 (2002) 254 271] , 2002 .

[28]  A R Rao,et al.  Detection of nonstationarity in hydrologic time series , 1986 .

[29]  Fateh Chebana,et al.  Testing for multivariate trends in hydrologic frequency analysis , 2013 .

[30]  Jasper A. Vrugt,et al.  Markov chain Monte Carlo simulation using the DREAM software package: Theory, concepts, and MATLAB implementation , 2016, Environ. Model. Softw..

[31]  R. T. Clarke,et al.  Hydrological prediction in a non-stationary world , 2007 .

[32]  Richard M. Vogel,et al.  Trends in floods and low flows in the United States: impact of spatial correlation , 2000 .

[33]  Gregory J. McCabe,et al.  A step increase in streamflow in the conterminous United States , 2002 .

[34]  Konstantine P. Georgakakos,et al.  Objective, observations‐based, automatic estimation of the catchment response timescale , 2002 .

[35]  Richard M. Vogel,et al.  Nonstationarity: Flood Magnification and Recurrence Reduction Factors in the United States 1 , 2011 .

[36]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[37]  J. Stedinger,et al.  Getting From Here to Where? Flood Frequency Analysis and Climate 1 , 2011 .

[38]  J. Vrugt,et al.  A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non‐Gaussian errors , 2010 .

[39]  Upmanu Lall,et al.  Floods in a changing climate: Does the past represent the future? , 2001, Water Resources Research.

[40]  M North Time-Dependent Stochastic Model of Floods , 1980 .

[41]  Cajo J. F. ter Braak,et al.  Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation , 2008 .

[42]  Maciej Radziejewski,et al.  Trend detection in river flow series: 1. Annual maximum flow / Détection de tendance dans des séries de débit fluvial: 1. Débit maximum annuel , 2005 .

[43]  Guobin Fu,et al.  Hydro-Climatic Trends of the Yellow River Basin for the Last 50 Years , 2004 .

[44]  Yuqiong Liu,et al.  Reconciling theory with observations: elements of a diagnostic approach to model evaluation , 2008 .

[45]  J. Olden,et al.  Redundancy and the choice of hydrologic indices for characterizing streamflow regimes , 2003 .

[46]  T. A. Buishand,et al.  SOME METHODS FOR TESTING THE HOMOGENEITY OF RAINFALL RECORDS , 1982 .

[47]  D. Oki,et al.  Trends and shifts in streamflow in Hawai‘i, 1913–2008 , 2013 .

[48]  Sylvie Parey,et al.  Trends and climate evolution: Statistical approach for very high temperatures in France , 2007 .

[49]  J. K. Searcy Flow-duration curves , 1959 .

[50]  Thomas R. Karl,et al.  Secular Trends of Precipitation Amount, Frequency, and Intensity in the United States , 1998 .

[51]  Brandon M. Turner,et al.  Journal of Mathematical Psychology a Tutorial on Approximate Bayesian Computation , 2022 .

[52]  J. Vrugt,et al.  Approximate Bayesian Computation using Markov Chain Monte Carlo simulation: DREAM(ABC) , 2014 .

[53]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[54]  J. Salas,et al.  Revisiting the Concepts of Return Period and Risk for Nonstationary Hydrologic Extreme Events , 2014 .

[55]  Demetris Koutsoyiannis,et al.  Hurst‐Kolmogorov Dynamics and Uncertainty 1 , 2011 .

[56]  M. Dettinger Climate Change, Atmospheric Rivers, and Floods in California – A Multimodel Analysis of Storm Frequency and Magnitude Changes 1 , 2011 .

[57]  Keith Beven,et al.  Stage‐discharge uncertainty derived with a non‐stationary rating curve in the Choluteca River, Honduras , 2011 .

[58]  Heinz G. Stefan,et al.  Stream flow in Minnesota : Indicator of climate change , 2007 .

[59]  A. C. Pandey,et al.  Trend and spectral analysis of rainfall over India during 1901–2000 , 2011 .

[60]  H. Lins,et al.  Seasonal and Regional Characteristics of U.S. Streamflow Trends in the United States from 1940 to 1999 , 2005 .

[61]  T. Ouarda,et al.  Non-stationary regional flood frequency analysis at ungauged sites , 2007 .

[62]  W. D. Hogg,et al.  Trends in Canadian streamflow , 2000 .

[63]  K. Eckhardt How to construct recursive digital filters for baseflow separation , 2005 .

[64]  T. Ouarda,et al.  Regional flood-duration frequency modeling in the changing environment , 2006 .

[65]  Harry F. Lins,et al.  Streamflow Variability in the United States: 1931–78 , 1985 .

[66]  Z. Kundzewicz Nonstationarity in Water Resources – Central European Perspective 1 , 2011 .

[67]  J. V. Revadekar,et al.  Global observed changes in daily climate extremes of temperature and precipitation , 2006 .

[68]  P. Diggle,et al.  Monte Carlo Methods of Inference for Implicit Statistical Models , 1984 .

[69]  David R. Easterling,et al.  Contemporary Changes of the Hydrological Cycle over the Contiguous United States: Trends Derived from In Situ Observations , 2004 .

[70]  Laurna Kaatz,et al.  Nonstationary Water Planning: An Overview of Several Promising Planning Methods 1 , 2011 .

[71]  Ximing Cai,et al.  Detecting gradual and abrupt changes in hydrological records , 2013 .

[72]  George Kuczera,et al.  Evaluating the non-stationarity of Australian annual maximum flood , 2013 .

[73]  Demetris Koutsoyiannis,et al.  Hydrology and change , 2013 .

[74]  Chuen-Fa Ni,et al.  Efficient approximate spectral method to delineate stochastic well capture zones in nonstationary groundwater flow systems , 2011 .

[75]  Demetris Koutsoyiannis “Hurst-Kolomogorov Dynamics and Uncertainty” , 2010 .

[76]  T. Ouarda,et al.  Generalized maximum likelihood estimators for the nonstationary generalized extreme value model , 2007 .

[77]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[78]  Peter Molnar,et al.  Streamflow trends in Switzerland , 2005 .

[79]  Jasper A. Vrugt,et al.  High‐dimensional posterior exploration of hydrologic models using multiple‐try DREAM(ZS) and high‐performance computing , 2012 .

[80]  George Kuczera,et al.  The quest for more powerful validation of conceptual catchment models , 1997 .

[81]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[82]  Demetris Koutsoyiannis,et al.  Nonstationarity versus scaling in hydrology , 2006 .

[83]  Thomas R. Karl,et al.  Heavy Precipitation and High Streamflow in the Contiguous United States: Trends in the Twentieth Century. , 2001 .

[84]  Keith E. Schilling,et al.  Increasing streamflow and baseflow in Mississippi River since the 1940 s: Effect of land use change , 2006 .

[85]  D. Burn,et al.  Detection of hydrologic trends and variability , 2002 .

[86]  V. Singh,et al.  Non-stationary approach to at-site flood frequency modelling. III. Flood analysis of Polish rivers , 2001 .

[87]  Demetris Koutsoyiannis,et al.  Negligent killing of scientific concepts: the stationarity case , 2015 .

[88]  C. Cunnane Methods and merits of regional flood frequency analysis , 1988 .

[89]  Zbigniew W. Kundzewicz,et al.  Trend detection in river flow series: 2. Flood and low-flow index series / Détection de tendance dans des séries de débit fluvial: 2. Séries d'indices de crue et d'étiage , 2005 .

[90]  Scott A. Sisson,et al.  Detection of non-stationarity in precipitation extremes using a max-stable process model , 2011 .

[91]  Hubert H. G. Savenije,et al.  The runoff coefficient as the key to moisture recycling , 1996 .

[92]  R. Stouffer,et al.  Stationarity Is Dead: Whither Water Management? , 2008, Science.

[93]  K. Potter Hydrological impacts of changing land management practices in a moderate‐sized agricultural catchment , 1991 .

[94]  Rodolfo Soncini-Sessa,et al.  Trend detection in seasonal data: from hydrology to water resources , 2014 .

[95]  L. Karthikeyan,et al.  Predictability of nonstationary time series using wavelet and EMD based ARMA models , 2013 .

[96]  G. Villarini,et al.  On the stationarity of annual flood peaks in the continental United States during the 20th century , 2009 .

[97]  Ž. Andreić,et al.  Flow duration curves , 2011 .

[98]  Martin F. Lambert,et al.  A strategy for diagnosing and interpreting hydrological model nonstationarity , 2014 .

[99]  Arnaud Doucet,et al.  An adaptive sequential Monte Carlo method for approximate Bayesian computation , 2011, Statistics and Computing.

[100]  D. Higdon,et al.  Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling , 2009 .

[101]  T. Ouarda,et al.  Identification of hydrological trends in the presence of serial and cross correlations: A review of selected methods and their application to annual flow regimes of Canadian rivers , 2009 .

[102]  B. Merz,et al.  Trends in flood magnitude, frequency and seasonality in Germany in the period 1951–2002 , 2009 .

[103]  Upmanu Lall,et al.  Spatial scaling in a changing climate: A hierarchical bayesian model for non-stationary multi-site annual maximum and monthly streamflow , 2010 .

[104]  W. V. Pitman,et al.  Trends in streamflow due to upstream land-use changes , 1978 .

[105]  Chong-yu Xu,et al.  Trends and abrupt changes of precipitation maxima in the Pearl River basin, China , 2009 .

[106]  Jin Teng,et al.  Climate non-stationarity – Validity of calibrated rainfall–runoff models for use in climate change studies , 2010 .

[107]  W. Graf Network Characteristics in Suburbanizing Streams , 1977 .

[108]  Dawen Yang,et al.  Hydrological trend analysis in the Yellow River basin using a distributed hydrological model , 2009 .

[109]  G. Hodgkins,et al.  Changes in the timing of winter–spring streamflows in eastern North America, 1913–2002 , 2006 .

[110]  F. Zwiers,et al.  Global increasing trends in annual maximum daily precipitation , 2013 .