Robust data assimilation in hydrological modeling – A comparison of Kalman and H-infinity filters

Abstract Hydrological model and observation errors are often non-Gaussian and/or biased, and the statistical properties of the errors are often unknown or not fully known. Thus, determining the true error covariance matrices is a challenge for data assimilation approaches such as the most widely used Kalman filter (KF) and its extensions, which assume Gaussian error nature and need fully known error statistics. This paper introduces H-infinite filter (HF) to hydrological modeling and compares HF with KF under various model and observation error conditions. HF is basically a robust version of KF. When model performance is not well known, or changes unpredictably, HF may be preferred over KF. HF is especially suitable for the cases where the estimation performance in the worst error case needs to be guaranteed. Through the application of HF to a hypothetical hydrologic model, this paper shows that HF is less sensitive to the uncertainty in the initial condition, corrects system bias more effectively, and converges to true state faster after interruptions than KF. In particular, HF performs better in dealing with instant human inputs (irrigation is used as an example), which are characterized by non-stationary, non-Gaussian and not fully known errors. However HF design can be more difficult than KF design due to the sensitivity of HF performance to design parameters (weights for model and observation error terms). Through sensitivity analysis, this paper shows the existence of a certain range of those parameters, in which the “best” value of the parameters is located. The tuning of HF design parameters, which can be based on users’ prior knowledge on the nature of model and observation errors, is critical for the implementation of HF.

[1]  Robert Grover Brown,et al.  Introduction to random signal analysis and Kalman filtering , 1983 .

[2]  Deva K. Borah,et al.  Calibrating a watershed simulation model involving human interference - An application of multi-objective genetic algorithms , 2007 .

[3]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[4]  Jeffrey B. Burl,et al.  Linear Optimal Control , 1998 .

[5]  Jr Raol Performance of H-infinity filter-based data fusion algorithm with outliers AIAA Paper 2002-0251 , 2002 .

[6]  Jetse D. Kalma,et al.  One-Dimensional Soil Moisture Profile Retrieval by Assimilation of Near-Surface Measurements: A Simplified Soil Moisture Model and Field Application , 2001 .

[7]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[8]  U. Shaked,et al.  H,-OPTIMAL ESTIMATION: A TUTORIAL , 1992 .

[9]  Henrik Madsen,et al.  Parameter sensitivity of three Kalman filter schemes for assimilation of water levels in shelf sea models , 2006 .

[10]  Ravi N. Banavar A game theoretic approach to linear dynamic estimation , 1992 .

[11]  Alex Acero,et al.  Spoken Language Processing , 2001 .

[12]  Soroosh Sorooshian,et al.  Dual state-parameter estimation of hydrological models using ensemble Kalman filter , 2005 .

[13]  Fuwen Yang,et al.  Robust H/sub /spl infin// filtering for stochastic time-delay systems with missing measurements , 2006, IEEE Transactions on Signal Processing.

[14]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[15]  Jetse D. Kalma,et al.  One-dimensional soil moisture profile retrieval by assimilation of near-surface observations: a comparison of retrieval algorithms , 2001 .

[16]  Xuemin Shen,et al.  H-infinity filtering for speech enhancement , 1996, ICSLP.

[17]  D. McLaughlin,et al.  Hydrologic Data Assimilation with the Ensemble Kalman Filter , 2002 .

[18]  C. H. Leng,et al.  Aquifer parameter identification using the extended Kalman filter , 2003 .

[19]  Tamer Bąar Optimum performance levels for minimax filters, predictors and smoothers , 1991 .

[20]  Paul R. Houser,et al.  Requirements of a global near-surface soil moisture satellite mission: accuracy, repeat time, and spatial resolution , 2004 .

[21]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[22]  Xuemin Shen,et al.  Game theory approach to discrete H∞ filter design , 1997, IEEE Trans. Signal Process..

[23]  Thomas Kailath,et al.  H∞ adaptive filtering , 1995, ICASSP.

[24]  Xuemin Shen,et al.  H/sub /spl infin// filtering for speech enhancement , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[25]  H. Madsen,et al.  Comparison of extended and ensemble Kalman filters for data assimilation in coastal area modelling , 1999 .

[26]  Tamer Basar,et al.  Parameter identification for uncertain plants using H∞ methods , 1995, Autom..

[27]  Geir Evensen,et al.  The Ensemble Kalman Filter: theoretical formulation and practical implementation , 2003 .

[28]  P. Dorato,et al.  Optimallty, insensitivity, and game theory , 1964 .

[29]  Jonathan P. How,et al.  Estimation-based synthesis of H∞-optimal adaptive FIR filters for filtered-LMS problems , 2001, IEEE Trans. Signal Process..

[30]  M. Eppstein,et al.  SIMULTANEOUS ESTIMATION OF TRANSMISSIVITY VALUES AND ZONATION , 1996 .

[31]  Ximing Cai,et al.  Optimal estimation of irrigation schedule – An example of quantifying human interferences to hydrologic processes , 2007 .

[32]  H. Madsen,et al.  Bias aware Kalman filters: Comparison and improvements , 2006 .

[33]  Praveen Kumar,et al.  Assimilation of near-surface temperature using extended Kalman filter , 2003 .

[34]  David Huard,et al.  A Bayesian perspective on input uncertainty in model calibration: Application to hydrological model “abc” , 2006 .

[35]  H. Madsen,et al.  Data assimilation in hydrodynamic modelling: on the treatment of non-linearity and bias , 2004 .

[36]  T. Basar,et al.  H∞-0ptimal Control and Related Minimax Design Problems: A Dynamic Game Approach , 1996, IEEE Trans. Autom. Control..

[37]  U. Shaked,et al.  Minimum H/sub infinity /-norm regulation of linear discrete-time systems and its relation to linear quadratic discrete games , 1990 .

[38]  Fuwen Yang,et al.  Robust H-infinity filtering for stochastic time-delay systems with missing measurements , 2006 .