On Localization and Multiscale in Data Assimilation

The main goal of inverse problems is the reconstruction of unknown quantities, often they are located in an inaccessible part of space. Data assimilation, which is the integration of inverse problems techniques with dynamical systems with the task of forecasting the evolution of some quantity, has evolved strongly, with important applications in meteorology and atmospherical sciences. Localization is an essential part of ensemble based assimilation schemes. The size of an ensemble is always much smaller than the dimension of the state space for real numerical predictions. It is necessary to ensure a sufficent number of degree's of freedom when generating the analysis ensemble and, thus, increase the rank of the set of analysis equations. Also, the small ensemble size gives an insufficent estimate of the background error correlations. Localization effectivly eliminates spurious correlations in the background ensemble between distant state variables. The choice of the localization radius needs to depend on the number of ensemble members for the short-range forcasts used to calculate the background error for the analysis step as well as on the number of observations and the observation error. However, a challenge arises when the observation operator under consideration is non-local (e.g. satellite radiance data), the localization which is applicable to the problem can be severly limited, with strong effects on the quality of the assimilation step. We study a transformation approach to change non-local operators to local operators in transformed space, such that localization becomes applicable. We interpret this approach as a generalized localization and study its general algebraic formulation. Examples are provided for a compact integral operator and a non-local matrix observation operator to demonstrate the feasibility of the approach and study the quality of the assimilation by transformation. In particular, we apply the approach to temperature profile reconstruction from infrared measurements given by the IASI Infrared Sounder and show that the approach is feasible for this important data type in atmospheric analysis and forecasting. We also believe that our derivations will work in a similar way for particle filters. If we do localization we have to adjust the localization radius to the scale of the problem. In this respect choosing large radius mean the data we have is important for large scale and vice versa. Thus localization is linked to the scale of the meteorological processes under consideration. Inherently when we choose localization, we chose scale. This leads to the topic of scales, which usually comes under the umbrella of multiscale methods. The broad idea of a multiscale approach is to decompose your problem into different scales or levels and to use these decompositions either for constructing appropriate approximations or to solve smaller problems on each of these levels, leading to increased stability or increased efficiency. Our goal is to analyse the sequential multiscale approach applied to an inversion or state estimation problem. We work in a generic setup given by a Hilbert space environment. We work out the analysis both for an unregularized and a regularized sequential multiscale inversion. In general the sequential multiscale approach is not equivalent to a full solution, but we show that under appropriate assumptions we obtain convergence of an iterative sequential multiscale version of the method. For the regularized case we develop a strategy to appropriately adapt the regularization when an iterative approach is taken. We demonstrate the validity of the iterative sequential multiscale approach by testing the method on an integral equation as it appears for atmospheric temperature retrieval from infrared satellite radiances.

[1]  J. Hadamard,et al.  Lectures on Cauchy's Problem in Linear Partial Differential Equations , 1924 .

[2]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .

[3]  A. Bryson,et al.  Discrete square root filtering: A survey of current techniques , 1971 .

[4]  G. J. Haltiner Numerical Prediction and Dynamic Meteorology , 1980 .

[5]  O. Thompson HIRS-AMTS Satellite Sounding System Test--Theoretical and Empirical Vertical Resolving Power. , 1982 .

[6]  M. Koda,et al.  Square Root Filtering Formulation for Satellite Autonomous Navigation , 1984 .

[7]  F. L. Dimet,et al.  Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects , 1986 .

[8]  Bernd Hofmann,et al.  Regularization for applied inverse and ill-posed problems : a numerical approach , 1986 .

[9]  C. Vogel Computational Methods for Inverse Problems , 1987 .

[10]  P. Hansen Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion , 1987 .

[11]  R. Kress Linear Integral Equations , 1989 .

[12]  M. Ghil,et al.  Data assimilation in meteorology and oceanography , 1991 .

[13]  John Derber,et al.  The National Meteorological Center's spectral-statistical interpolation analysis system , 1992 .

[14]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[15]  Philippe Courtier,et al.  A comparison between four-dimensional variational assimilation and simplified sequential assimilation relying on three-dimensional variational analysis , 1993 .

[16]  C. W. Groetsch,et al.  Inverse Problems in the Mathematical Sciences , 1993 .

[17]  David R. Stauffer,et al.  Multiscale four-dimensional data assimilation , 1994 .

[18]  Tim J. Hewison,et al.  Radiometric characterization of AMSU-B , 1995 .

[19]  Domenico Solimini,et al.  MICROWAVE RADIOMETRY AND REMOTE SENSING OF THE ENVIRONMENT , 1995 .

[20]  M. Hanke,et al.  A convergence analysis of the Landweber iteration for nonlinear ill-posed problems , 1995 .

[21]  A. Kirsch An Introduction to the Mathematical Theory of Inverse Problems , 1996, Applied Mathematical Sciences.

[22]  Roger W. Saunders,et al.  Measurements of the AMSU-B antenna pattern , 1996, IEEE Trans. Geosci. Remote. Sens..

[23]  Arnold Neumaier,et al.  Solving Ill-Conditioned and Singular Linear Systems: A Tutorial on Regularization , 1998, SIAM Rev..

[24]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[25]  S. Mallat,et al.  Adaptive covariance estimation of locally stationary processes , 1998 .

[26]  M. Matricardi,et al.  An improved fast radiative transfer model for assimilation of satellite radiance observations , 1999 .

[27]  S. Cohn,et al.  Ooce Note Series on Global Modeling and Data Assimilation Construction of Correlation Functions in Two and Three Dimensions and Convolution Covariance Functions , 2022 .

[28]  Chris Snyder,et al.  Ensemble Forecasting in the Short to Medium Range: Report from a Workshop , 2000 .

[29]  P. Houtekamer,et al.  A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation , 2001 .

[30]  J. Whitaker,et al.  Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter , 2001 .

[31]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[32]  Istvan Szunyogh,et al.  A Local Ensemble Kalman Filter for Atmospheric Data Assimilation , 2002 .

[33]  J. Whitaker,et al.  Ensemble Data Assimilation without Perturbed Observations , 2002 .

[34]  Claire L. Parkinson,et al.  Aqua: an Earth-Observing Satellite mission to examine water and other climate variables , 2003, IEEE Trans. Geosci. Remote. Sens..

[35]  John D. Albertson,et al.  Multi-scale assimilation of surface soil moisture data for robust root zone moisture predictions , 2003 .

[36]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[37]  J. Coyle Inverse Problems , 2004 .

[38]  S. Park Data Assimilation for Atmospheric Modeling - Formulation, Issues, and Problems , 2004 .

[39]  E. Somersalo,et al.  Statistical and computational inverse problems , 2004 .

[40]  C. Muth,et al.  Advanced Technology Microwave Sounder on NPOESS and NPP , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[41]  P. L. Houtekamer,et al.  Ensemble Kalman filtering , 2005 .

[42]  Christopher K. Wikle,et al.  Atmospheric Modeling, Data Assimilation, and Predictability , 2005, Technometrics.

[43]  J. Ackermann,et al.  The ATOVS and AVHRR product processing facility of EPS , 2005 .

[44]  Roger G. Ghanem,et al.  A Multiscale Data Assimilation with the Ensemble Kalman Filter , 2005, Multiscale Model. Simul..

[45]  M. Buehner,et al.  Atmospheric Data Assimilation with an Ensemble Kalman Filter: Results with Real Observations , 2005 .

[46]  Paul Lee,et al.  Advanced technology microwave sounder on the National Polar-Orbiting Operational Environmental Satellite System , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[47]  J. M. Lewis,et al.  Dynamic Data Assimilation: A Least Squares Approach , 2006 .

[48]  Istvan Szunyogh,et al.  Predictability of Weather and Climate: Ensemble forecasting and data assimilation: two problems with the same solution? , 2006 .

[49]  Fuzhong Weng,et al.  Advanced Technology Microwave Sounder , 2006 .

[50]  Christian Mätzler,et al.  Thermal Microwave Radiation: Applications for Remote Sensing , 2006 .

[51]  Dianne P. O'Leary,et al.  Deblurring Images: Matrices, Spectra, and Filtering (Fundamentals of Algorithms 3) (Fundamentals of Algorithms) , 2006 .

[52]  Neil Salkind Encyclopedia of Measurement and Statistics , 2006 .

[53]  W. Gao,et al.  Earth Science Satellite Remote Sensing , 2006 .

[54]  Serge Gratton,et al.  Approximate Gauss-Newton Methods for Nonlinear Least Squares Problems , 2007, SIAM J. Optim..

[55]  Peter R. Oke,et al.  Impacts of localisation in the EnKF and EnOI: experiments with a small model , 2007 .

[56]  Yoshiaki Sato,et al.  Assimilating Satellite Radiances with a Local Ensemble Transform Kalman Filter (LETKF) Applied to the JMA Global Model (GSM) , 2007 .

[57]  Takemasa Miyoshi,et al.  Localizing the Error Covariance by Physical Distances within a Local Ensemble Transform Kalman Filter (LETKF) , 2007 .

[58]  T. Bengtsson,et al.  Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants , 2007 .

[59]  Robert G. Ellingson,et al.  Development of the HIRS Outgoing Longwave Radiation Climate Dataset , 2007 .

[60]  Jens Schröter,et al.  On domain localization in ensemble based Kalman Flter algorithms , 2008 .

[61]  Ruth Petrie,et al.  Localization in the ensemble Kalman Filter , 2008 .

[62]  Istvan Szunyogh,et al.  A local ensemble transform Kalman filter data assimilation system for the NCEP global model , 2008 .

[63]  Dara Entekhabi,et al.  An Ensemble Multiscale Filter for Large Nonlinear Data Assimilation Problems , 2008 .

[64]  Seiichi Nakamori Square-root algorithms of RLS Wiener filter and fixed-point smoother in linear discrete stochastic systems , 2008, Appl. Math. Comput..

[65]  Grigorios A. Pavliotis,et al.  Multiscale Methods: Averaging and Homogenization , 2008 .

[66]  Thomas M. Hamill,et al.  Ensemble Data Assimilation with the NCEP Global Forecast System , 2008 .

[67]  Masahiro Kazumori,et al.  Impact Study of AMSR-E Radiances in the NCEP Global Data Assimilation System , 2008 .

[68]  Peter R. Oke,et al.  A deterministic formulation of the ensemble Kalman filter : an alternative to ensemble square root filters , 2008 .

[69]  Barbara Kaltenbacher,et al.  Iterative Regularization Methods for Nonlinear Ill-Posed Problems , 2008, Radon Series on Computational and Applied Mathematics.

[70]  X. Deng,et al.  Model Error Representation in an Operational Ensemble Kalman Filter , 2009 .

[71]  J. Eyre,et al.  Assimilation of IASI at the Met Office and assessment of its impact through observing system experiments , 2009 .

[72]  Lifeng Luo,et al.  A Multiscale Ensemble Filtering System for Hydrologic Data Assimilation. Part I: Implementation and Synthetic Experiment , 2009 .

[73]  Eric F. Wood,et al.  A Multiscale Ensemble Filtering System for Hydrologic Data Assimilation. Part II: Application to Land Surface Modeling with Satellite Rainfall Forcing , 2009 .

[74]  Ruth E. Petrie,et al.  Ensemble‐based data assimilation and the localisation problem , 2010 .

[75]  Richard Bamler,et al.  Tomographic SAR Inversion by $L_{1}$ -Norm Regularization—The Compressive Sensing Approach , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[76]  Nancy Nichols,et al.  Mathematical Concepts of Data Assimilation , 2010 .

[77]  Takemasa Miyoshi,et al.  Ensemble Kalman Filter and 4D-Var Intercomparison with the Japanese Operational Global Analysis and Prediction System , 2010 .

[78]  Paul E. Bieringer,et al.  A Space-Time Multiscale Analysis System: A Sequential Variational Analysis Approach , 2011 .

[79]  Nicholas Zabaras,et al.  A Bayesian approach to multiscale inverse problems using the sequential Monte Carlo method , 2011 .

[80]  Lei Shi,et al.  Three decades of intersatellite‐calibrated High‐Resolution Infrared Radiation Sounder upper tropospheric water vapor , 2011 .

[81]  Cheng-Zhi Zou,et al.  Intersatellite calibration of AMSU‐A observations for weather and climate applications , 2011 .

[82]  Jiang Zhu,et al.  A new localization implementation scheme for ensemble data assimilation of non-local observations , 2011 .

[83]  Santha Akella,et al.  Reservoir Multiscale Data Assimilation Using the Ensemble Kalman Filter , 2011 .

[84]  Bormin Huang,et al.  Development of GPU-based RTTOV-7 IASI and AMSU-A forward models , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[85]  Yanfei Wang,et al.  Optimization and regularization for computational inverse problems and applications , 2011 .

[86]  T. Miyoshi The Gaussian Approach to Adaptive Covariance Inflation and Its Implementation with the Local Ensemble Transform Kalman Filter , 2011 .

[87]  Fuqing Zhang,et al.  Limited-Area Ensemble-Based Data Assimilation , 2011 .

[88]  Harry Vereecken,et al.  Multivariate and Multiscale Data Assimilation in Terrestrial Systems: A Review , 2012, Sensors.

[89]  G. A. Pavliotis,et al.  Multiscale modelling and inverse problems , 2010, 1009.2943.

[90]  Jens Schröter,et al.  A regulated localization scheme for ensemble‐based Kalman filters , 2012 .

[91]  Roland Potthast,et al.  On instabilities in data assimilation algorithms , 2012 .

[92]  M. Tanguay,et al.  Four-Dimensional Variational Data Assimilation for the Canadian Regional Deterministic Prediction System , 2012 .

[93]  Barbara Kaltenbacher,et al.  Regularization Methods in Banach Spaces , 2012, Radon Series on Computational and Applied Mathematics.

[94]  Yu Feng Zhang,et al.  A New Adaptive Square-Root Unscented Kalman Filter for Nonlinear Systems , 2013 .

[95]  Roland Potthast,et al.  A Survey on Inverse Problems for Applied Sciences , 2013 .

[96]  Takemasa Miyoshi,et al.  A Multi-Scale Localization Approach to an Ensemble Kalman filter , 2013 .

[97]  Clemens Pechstein,et al.  Finite and Boundary Element Tearing and Interconnecting Solvers for Multiscale Problems , 2012, Lecture Notes in Computational Science and Engineering.

[98]  Roger W. Saunders,et al.  Monitoring Satellite Radiance Biases Using NWP Models , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[99]  Anu Dudhia,et al.  Improving the selection of IASI channels for use in numerical weather prediction , 2014 .

[100]  Lars Nerger,et al.  On the influence of model nonlinearity and localization on ensemble Kalman smoothing , 2014 .

[101]  Antonia Gambacorta,et al.  Evaluation of a revised IASI channel selection for cloudy retrievals with a focus on the Mediterranean basin , 2014 .

[102]  Roland Potthast,et al.  Optimal Localization for Ensemble Kalman Filter Systems , 2014 .

[103]  Lars Nerger,et al.  On the Choice of an Optimal Localization Radius in Ensemble Kalman Filter Methods , 2014 .

[104]  Andrew J. Majda,et al.  Multiscale Methods for Data Assimilation in Turbulent Systems , 2015, Multiscale Model. Simul..

[105]  Jan Mandel,et al.  Convergence of the Square Root Ensemble Kalman Filter in the Large Ensemble Limit , 2014, SIAM/ASA J. Uncertain. Quantification.

[106]  Roland Potthast,et al.  A concept for the assimilation of satellite cloud information in an Ensemble Kalman Filter: single‐observation experiments , 2015 .

[107]  Rodolfo Guzzi,et al.  Data Assimilation: Mathematical Concepts and Instructive Examples , 2015, SpringerBriefs in Earth Sciences.

[108]  Roland Potthast,et al.  Kilometre‐scale ensemble data assimilation for the COSMO model (KENDA) , 2016 .

[109]  Roland Potthast,et al.  Transformed and generalized localization for ensemble methods in data assimilation , 2016 .

[110]  R. Treadon,et al.  The application of AIRS radiances in numerical weather prediction , 2022 .