Parameter Estimation by Ensemble Kalman Filters with Transformed Data

[1] Ensemble Kalman filters (EnKFs) are a successful tool for estimating state variables in atmospheric and oceanic sciences. Recent research has prepared the EnKF for parameter estimation in groundwater applications. EnKFs are optimal in the sense of Bayesian updating only if all involved variables are multivariate Gaussian. Subsurface flow and transport state variables, however, generally do not show Gaussian dependence on hydraulic log conductivity and among each other, even if log conductivity is multi-Gaussian. To improve EnKFs in this context, we apply nonlinear, monotonic transformations to the observed states, rendering them Gaussian (Gaussian anamorphosis, GA). Similar ideas have recently been presented by Beal et al. (2010) in the context of state estimation. Our work transfers and adapts this methodology to parameter estimation. Additionally, we address the treatment of measurement errors in the transformation and provide several multivariate analysis tools to evaluate the expected usefulness of GA beforehand. For illustration, we present a first-time application of an EnKF to parameter estimation from 3-D hydraulic tomography in multi-Gaussian log conductivity fields. Results show that (1) GA achieves an implicit pseudolinearization of drawdown data as a function of log conductivity and (2) this makes both parameter identification and prediction of flow and transport more accurate. Combining EnKFs with GA yields a computationally efficient tool for nonlinear inversion of data with improved accuracy. This is an attractive benefit, given that linearization-free methods such as particle filters are computationally extremely demanding.

[1]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[2]  Virgilio Fiorotto,et al.  Solute Concentration Statistics in Heterogeneous Aquifers for Finite Péclet Values , 2002 .

[3]  David R. Cox,et al.  Testing multivariate normality , 1978 .

[4]  Peter Jan,et al.  Particle Filtering in Geophysical Systems , 2009 .

[5]  Long Chen FINITE ELEMENT METHOD , 2013 .

[6]  P. Leeuwen,et al.  Nonlinear data assimilation in geosciences: an extremely efficient particle filter , 2010 .

[7]  Wolfgang Nowak,et al.  Efficient Computation of Linearized Cross-Covariance and Auto-Covariance Matrices of Interdependent Quantities , 2003 .

[8]  J. Gómez-Hernández,et al.  To be or not to be multi-Gaussian? A reflection on stochastic hydrogeology , 1998 .

[9]  Dongxiao Zhang,et al.  Investigation of flow and transport processes at the MADE site using ensemble Kalman filter , 2008 .

[10]  Ted Chang,et al.  Introduction to Geostatistics: Applications in Hydrogeology , 2001, Technometrics.

[11]  S. P. Neuman,et al.  Theoretical derivation of Darcy's law , 1977 .

[12]  Xian-Huan Wen,et al.  Some Practical Issues on Real-Time Reservoir Model Updating Using Ensemble Kalman Filter , 2007 .

[13]  S. M. Hassanizadeh,et al.  A model for two‐phase flow in porous media including fluid‐fluid interfacial area , 2008 .

[14]  Xian-Huan Wen,et al.  Real-Time Reservoir Model Updating Using Ensemble Kalman Filter , 2005 .

[15]  Dean S. Oliver,et al.  An Iterative Ensemble Kalman Filter for Multiphase Fluid Flow Data Assimilation , 2007 .

[16]  C. R. Dietrich,et al.  A fast and exact method for multidimensional gaussian stochastic simulations , 1993 .

[17]  Junfeng Zhu,et al.  Sequential aquifer tests at a well field, Montalto Uffugo Scalo, Italy , 2007 .

[18]  Bill X. Hu,et al.  Using data assimilation method to calibrate a heterogeneous conductivity field conditioning on transient flow test data , 2010 .

[19]  Jean-Michel Brankart,et al.  Characterization of mixing errors in a coupled physical biogeochemical model of the North Atlantic: implications for nonlinear estimation using Gaussian anamorphosis , 2010 .

[20]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .

[21]  A. Bellin,et al.  A Bayesian approach for inversion of hydraulic tomographic data , 2009 .

[22]  Harrie-Jan Hendricks Franssen,et al.  Ensemble Kalman filtering versus sequential self-calibration for inverse modelling of dynamic groundwater flow systems , 2009 .

[23]  R. Ibbitt,et al.  Hydrological data assimilation with the ensemble Kalman filter: Use of streamflow observations to update states in a distributed hydrological model , 2007 .

[24]  Rainer Helmig,et al.  Convergence of the multipoint flux approximation L‐method for homogeneous media on uniform grids , 2011 .

[25]  James J. Butler,et al.  Pumping tests in networks of multilevel sampling wells: Motivation and methodology , 1999 .

[26]  Ronggao Liu,et al.  Simultaneous estimation of both soil moisture and model parameters using particle filtering method through the assimilation of microwave signal , 2009 .

[27]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[28]  H. Wackernagle,et al.  Multivariate geostatistics: an introduction with applications , 1998 .

[29]  W. Nowak,et al.  Geostatistical inverse modeling of transient pumping tests using temporal moments of drawdown , 2005 .

[30]  T. Higuchi,et al.  Merging particle filter for sequential data assimilation , 2007 .

[31]  A. Scheidegger General Theory of Dispersion in Porous Media , 1961 .

[32]  Dean S. Oliver,et al.  The Ensemble Kalman Filter for Continuous Updating of Reservoir Simulation Models , 2006 .

[33]  H. Sorenson Least-squares estimation: from Gauss to Kalman , 1970, IEEE Spectrum.

[34]  Wolfgang Nowak,et al.  Impact of sampling volume on the probability density function of steady state concentration , 2008 .

[35]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[36]  Benjamin Faigle,et al.  Two-phase flow modeling in porous media with kinetic interphase mass transfer processes in fractures , 2009 .

[37]  Kuolin Hsu,et al.  Uncertainty assessment of hydrologic model states and parameters: Sequential data assimilation using the particle filter , 2005 .

[38]  Tian-Chyi J. Yeh,et al.  Characterization of aquifer heterogeneity using transient hydraulic tomography , 2004 .

[39]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[40]  Albert C. Reynolds,et al.  Assessing the Uncertainty in Reservoir Description and Performance Predictions With the Ensemble Kalman Filter , 2007 .

[41]  J. J. Gómez-Hernández,et al.  3D inverse modelling of groundwater flow at a fractured site using a stochastic continuum model with multiple statistical populations , 2002 .

[42]  Olaf A Cirpka,et al.  Interpolation of Steady‐State Concentration Data by Inverse Modeling , 2009, Ground water.

[43]  D. McLaughlin,et al.  Using data assimilation to identify diffuse recharge mechanisms from chemical and physical data in the unsaturated zone , 2009 .

[44]  G. Evensen,et al.  Analysis Scheme in the Ensemble Kalman Filter , 1998 .

[45]  D. McLaughlin,et al.  Hydrologic Data Assimilation with the Ensemble Kalman Filter , 2002 .

[46]  R. Hilfer,et al.  Numerical solutions of a generalized theory for macroscopic capillarity. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Carl Friedrich Gauss Theoria motus corporum coelestium , 1981 .

[48]  W. Li,et al.  Two‐dimensional characterization of hydraulic heterogeneity by multiple pumping tests , 2007 .

[49]  E. Poeter,et al.  Inverse Models: A Necessary Next Step in Ground‐Water Modeling , 1997 .

[50]  J. Chilès,et al.  Geostatistics: Modeling Spatial Uncertainty , 1999 .

[51]  L. Gelhar Stochastic Subsurface Hydrology , 1992 .

[52]  H. Vereecken,et al.  Coupled hydrogeophysical parameter estimation using a sequential Bayesian approach , 2009 .

[53]  Clayton V. Deutsch,et al.  A Step by Step Guide to Bi-Gaussian Disjunctive Kriging , 2005 .

[54]  P. Bickel,et al.  Obstacles to High-Dimensional Particle Filtering , 2008 .

[55]  G. Evensen Data Assimilation: The Ensemble Kalman Filter , 2006 .

[56]  Junfeng Zhu,et al.  Comparison of aquifer characterization approaches through steady state groundwater model validation: A controlled laboratory sandbox study , 2010 .

[57]  H. H. Franssen,et al.  A comparison of seven methods for the inverse modelling of groundwater flow. Application to the characterisation of well catchments , 2009 .

[58]  Jean-Michel Brankart,et al.  Controllability of mixing errors in a coupled physical biogeochemical model of the North Atlantic: a nonlinear study using anamorphosis , 2009 .

[59]  Dean S. Oliver,et al.  Ensemble Kalman filter for automatic history matching of geologic facies , 2005 .

[60]  Alberto Bellin,et al.  Probability density function of non-reactive solute concentration in heterogeneous porous formations. , 2007, Journal of contaminant hydrology.

[61]  Peter Dietrich,et al.  An inversion strategy for hydraulic tomography: Coupling travel time and amplitude inversion , 2007 .

[62]  A. Journel Nonparametric estimation of spatial distributions , 1983 .

[63]  J. Bear Dynamics of Fluids in Porous Media , 1975 .

[64]  Xin Li,et al.  An evaluation of the nonlinear/non-Gaussian filters for the sequential data assimilation , 2008 .

[65]  K. Støverud,et al.  Modeling Convection-Enhanced Delivery into Brain Tissue using Information from Magnetic Resonance Imaging. , 2009 .

[66]  G. Evensen The ensemble Kalman filter for combined state and parameter estimation , 2009, IEEE Control Systems.

[67]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[68]  D. W. Vasco,et al.  Interpretation and inversion of low‐frequency head observations , 2006 .

[69]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[70]  H. Moradkhani,et al.  Snow water equivalent prediction using Bayesian data assimilation methods , 2011 .

[71]  Ionel Michael Navon,et al.  A Note on the Particle Filter with Posterior Gaussian Resampling , 2006 .

[72]  Geir Nævdal,et al.  Reservoir Monitoring and Continuous Model Updating Using Ensemble Kalman Filter , 2005 .

[73]  Wolfgang Nowak,et al.  Probability density functions of hydraulic head and velocity in three‐dimensional heterogeneous porous media , 2008 .

[74]  Peter Dietrich,et al.  Identification of the permeability distribution in soil by hydraulic tomography , 1995 .

[75]  Wolfgang Nowak,et al.  Measures of Parameter Uncertainty in Geostatistical Estimation and Geostatistical Optimal Design , 2010 .

[76]  Tor Arne Johansen,et al.  Incorporating 4D Seismic Data in Reservoir Simulation Models Using Ensemble Kalman Filter , 2007 .

[77]  Geir Evensen,et al.  The Ensemble Kalman Filter: theoretical formulation and practical implementation , 2003 .

[78]  Keith Beven,et al.  Detection of structural inadequacy in process‐based hydrological models: A particle‐filtering approach , 2008 .

[79]  M. Sklar Fonctions de repartition a n dimensions et leurs marges , 1959 .

[80]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[81]  M. Cardiff,et al.  3‐D transient hydraulic tomography in unconfined aquifers with fast drainage response , 2011 .

[82]  Anil K. Jain,et al.  A Test to Determine the Multivariate Normality of a Data Set , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  Clayton V. Deutsch,et al.  GSLIB: Geostatistical Software Library and User's Guide , 1993 .

[84]  T. Yeh,et al.  Analysis of hydraulic tomography using temporal moments of drawdown recovery data , 2006 .

[85]  Wolfgang Nowak,et al.  On the link between contaminant source release conditions and plume prediction uncertainty. , 2010, Journal of contaminant hydrology.

[86]  S. P. Neuman,et al.  Three‐dimensional numerical inversion of pneumatic cross‐hole tests in unsaturated fractured tuff: 2. Equivalent parameters, high‐resolution stochastic imaging and scale effects , 2001 .

[87]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[88]  A. Bárdossy,et al.  Geostatistical interpolation using copulas , 2008 .

[89]  W. Crow,et al.  The assimilation of remotely sensed soil brightness temperature imagery into a land surface model using Ensemble Kalman filtering: a case study based on ESTAR measurements during SGP97 , 2003 .

[90]  Timothy A. Davis,et al.  Algorithm 832: UMFPACK V4.3---an unsymmetric-pattern multifrontal method , 2004, TOMS.

[91]  A. Weerts,et al.  Particle filtering and ensemble Kalman filtering for state updating with hydrological conceptual rainfall‐runoff models , 2006 .

[92]  Liangping Li,et al.  An approach to handling non-Gaussianity of parameters and state variables in ensemble Kalman filtering , 2011 .

[93]  J. Pearson,et al.  Investigation of Kalman filter divergence using robust stability techniques [combat aircraft tracking/navigation system] , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[94]  C. M. DeChant,et al.  Radiance data assimilation for operational snow and streamflow forecasting , 2011 .

[95]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[96]  Jennifer Niessner,et al.  Philip's redistribution problem revisited: the role of fluid-fluid interfacial areas , 2008 .

[97]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[98]  Yingqi Zhang,et al.  Least cost design of groundwater quality monitoring networks , 2005 .

[99]  M. Canty,et al.  Hydraulic parameter estimation by remotely-sensed top soil moisture observations with the particle filter , 2011 .

[100]  Laurent Bertino,et al.  Application of the Gaussian anamorphosis to assimilation in a 3-D coupled physical-ecosystem model of the North Atlantic with the EnKF: a twin experiment , 2009 .

[101]  R. Iman,et al.  Rank Transformations as a Bridge between Parametric and Nonparametric Statistics , 1981 .

[102]  Nando de Freitas,et al.  The Unscented Particle Filter , 2000, NIPS.

[103]  P. Kitanidis Introduction to Geostatistics: Applications in Hydrogeology , 1997 .

[104]  A. W. Heemink,et al.  The ensemble particle filter (EnPF) in rainfall-runoff models , 2009 .

[105]  Rainer Helmig,et al.  Variational inequalities for modeling flow in heterogeneous porous media with entry pressure , 2009 .

[106]  Alexander Y. Sun,et al.  Sequential updating of multimodal hydrogeologic parameter fields using localization and clustering techniques , 2009 .

[107]  Felipe P. J. de Barros,et al.  Probability density function of steady state concentration in two‐dimensional heterogeneous porous media , 2011 .

[108]  Jennifer Niessner,et al.  Modeling Kinetic Interphase Mass Transfer for Two-Phase Flow in Porous Media Including Fluid–Fluid Interfacial Area , 2009 .

[109]  Franklin W. Schwartz,et al.  mass transport: 2. Analysis of uncertainty in prediction , 1981 .

[110]  Jennifer Niessner,et al.  Stuttgart “ Non linearities and upscaling in porous media “ , 2008 .

[111]  D. Poirier Piecewise Regression Using Cubic Splines , 1973 .

[112]  M. Mccabe,et al.  Estimation of regional terrestrial water cycle using multi-sensor remote sensing observations and data assimilation , 2008 .

[113]  Y. Rubin Applied Stochastic Hydrogeology , 2003 .

[114]  Soroosh Sorooshian,et al.  Dual state-parameter estimation of hydrological models using ensemble Kalman filter , 2005 .

[115]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[116]  Jeffrey P. Walker,et al.  Extended versus Ensemble Kalman Filtering for Land Data Assimilation , 2002 .

[117]  W. Nowak,et al.  Application of FFT-based Algorithms for Large-Scale Universal Kriging Problems , 2009 .

[118]  R. E. Carlson,et al.  Monotone Piecewise Cubic Interpolation , 1980 .

[119]  Florian Doster,et al.  Percolation as a Basic Concept for Macroscopic Capillarity , 2010 .

[120]  D. Entekhabi,et al.  Land data assimilation and estimation of soil moisture using measurements from the Southern Great Plains 1997 Field Experiment , 2001 .

[121]  Roman Krzysztofowicz,et al.  Transformation and normalization of variates with specified distributions , 1997 .

[122]  E. Parzen,et al.  Unified estimators of smooth quantile and quantile density functions , 1997 .

[123]  Andres Alcolea,et al.  Inverse problem in hydrogeology , 2005 .

[124]  W. Kinzelbach,et al.  Real‐time groundwater flow modeling with the Ensemble Kalman Filter: Joint estimation of states and parameters and the filter inbreeding problem , 2008 .

[125]  Rainer Helmig,et al.  Geometrical interpretation of the multi‐point flux approximation L‐method , 2009 .

[126]  Xian-Huan Wen,et al.  Real-Time Reservoir Model Updating Using Ensemble Kalman Filter With Confirming Option , 2006 .

[127]  Yan Chen,et al.  Data assimilation for transient flow in geologic formations via ensemble Kalman filter , 2006 .

[128]  Wolfgang Nowak,et al.  Best unbiased ensemble linearization and the quasi‐linear Kalman ensemble generator , 2009 .

[129]  Rainer Helmig,et al.  An effective model for biofilm growth in a thin strip , 2009 .

[130]  P. Kitanidis Parameter Uncertainty in Estimation of Spatial Functions: Bayesian Analysis , 1986 .

[131]  Harald Osnes,et al.  Stochastic analysis of head spatial variability in bounded rectangular heterogeneous aquifers , 1995 .

[132]  Yoram Rubin,et al.  Stochastic analysis of boundaries effects on head spatial variability in heterogeneous aquifers: 2. Impervious boundary , 1989 .

[133]  Y. Rubin,et al.  Bayesian geostatistical design: Task‐driven optimal site investigation when the geostatistical model is uncertain , 2010 .

[134]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[135]  Rolf Johan Lorentzen,et al.  Analysis of the ensemble Kalman filter for estimation of permeability and porosity in reservoir models , 2005 .

[136]  G. Dagan,et al.  Stochastic analysis of boundaries effects on head spatial variability in heterogeneous aquifers: 1. Constant head boundary , 1988 .

[137]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[138]  M. Bocquet,et al.  Beyond Gaussian Statistical Modeling in Geophysical Data Assimilation , 2010 .

[139]  G. Evensen,et al.  Sequential Data Assimilation Techniques in Oceanography , 2003 .

[140]  Dean S. Oliver,et al.  THE ENSEMBLE KALMAN FILTER IN RESERVOIR ENGINEERING-A REVIEW , 2009 .

[141]  James J. Butler,et al.  Steady shape analysis of tomographic pumping tests for characterization of aquifer heterogeneities , 2002 .

[142]  K. H. Coats,et al.  A New Technique for Determining Reservoir Description from Field Performance Data , 1970 .

[143]  A. Bowman,et al.  Applied smoothing techniques for data analysis : the kernel approach with S-plus illustrations , 1999 .

[144]  G. Evensen Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[145]  Katherine Campbell,et al.  Introduction to disjunctive kriging and non-linear geostatistics , 1994 .

[146]  Alan E. Gelfand,et al.  Bayesian statistics without tears: A sampling-resampling perspective , 1992 .

[147]  P. Kitanidis Quasi‐Linear Geostatistical Theory for Inversing , 1995 .

[148]  T. Yeh,et al.  Hydraulic tomography: Development of a new aquifer test method , 2000 .