An algorithm for optimization with disjoint linear constraints and its application for predicting rain

A specialized algorithm for quadratic optimization (QO, or, formerly, QP) with disjoint linear constraints is presented. In the considered class of problems, a subset of variables are subject to linear equality constraints, while variables in a different subset are constrained to remain in a convex set. The proposed algorithm exploits the structure by combining steps in the nullspace of the equality constraint's matrix with projections onto the convex set. The algorithm is motivated by application in weather forecasting. Numerical results on a simple model designed for predicting rain show that the algorithm is an improvement on current practice and that it reduces the computational burden compared to a more general interior point QO method. In particular, if constraints are disjoint and the rank of the set of linear equality constraints is small, further reduction in computational costs can be achieved, making it possible to apply this algorithm in high dimensional weather forecasting problems.

[1]  Chih-Jen Lin,et al.  Newton's Method for Large Bound-Constrained Optimization Problems , 1999, SIAM J. Optim..

[2]  G. Craig,et al.  A simple dynamical model of cumulus convection for data assimilation research , 2014 .

[3]  Trevor Davies,et al.  An Overview of Numerical Methods for the Next Generation U.K. NWP and Climate Model , 1997 .

[4]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[5]  Philip E. Gill,et al.  Practical optimization , 1981 .

[6]  Mark Buehner,et al.  A New Environment Canada Regional Ice Analysis System , 2013 .

[7]  A. Arakawa,et al.  A Potential Enstrophy and Energy Conserving Scheme for the Shallow Water Equations , 1981 .

[8]  Laurent Bertino,et al.  Application of the Gaussian anamorphosis to assimilation in a 3-D coupled physical-ecosystem model of the North Atlantic with the EnKF: a twin experiment , 2009 .

[9]  G. S. Ketefian,et al.  A mass, energy, vorticity, and potential enstrophy conserving lateral fluid-land boundary scheme for the shallow water equations , 2008, J. Comput. Phys..

[10]  Nils Gustafsson,et al.  Survey of data assimilation methods for convective‐scale numerical weather prediction at operational centres , 2018 .

[11]  P. Courtier,et al.  The ECMWF implementation of three‐dimensional variational assimilation (3D‐Var). II: Structure functions , 1998 .

[12]  P. Courtier,et al.  The ECMWF implementation of three‐dimensional variational assimilation (3D‐Var). I: Formulation , 1998 .

[13]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[14]  George C. Craig,et al.  Testing particle filters on simple convective‐scale models. Part 2: A modified shallow‐water model , 2016 .

[15]  Yvonne Ruckstuhl,et al.  Parameter and state estimation with ensemble Kalman filter based algorithms for convective‐scale applications , 2018 .

[16]  Yuefei Zeng,et al.  Study of conservation laws with the Local Ensemble Transform Kalman Filter , 2016 .

[17]  P. Toint,et al.  Numerical Methods for Large-Scale Non-Convex Quadratic Programming , 2002 .

[18]  G. Evensen,et al.  Sequential Data Assimilation Techniques in Oceanography , 2003 .

[19]  A. Lorenc.  A Global Three-Dimensional Multivariate Statistical Interpolation Scheme , 1981 .

[20]  Nicholas I. M. Gould,et al.  On the Solution of Equality Constrained Quadratic Programming Problems Arising in Optimization , 2001, SIAM J. Sci. Comput..

[21]  E. Lorenz,et al.  The predictability of a flow which possesses many scales of motion , 1969 .

[22]  Matthias Sommer,et al.  A conservative scheme for the shallow‐water system on a staggered geodesic grid based on a Nambu representation , 2009 .

[23]  Stephen E. Cohn,et al.  The Behavior of Forecast Error Covariances for a Kalman Filter in Two Dimensions , 1991 .

[24]  Serge Gratton,et al.  Preconditioning and globalizing conjugate gradients in dual space for quadratically penalized nonlinear-least squares problems , 2013, Comput. Optim. Appl..

[25]  Laurent Bertino,et al.  Gaussian anamorphosis extension of the DEnKF for combined state parameter estimation: Application to a 1D ocean ecosystem model , 2012 .

[26]  Yvonne Ruckstuhl,et al.  Ensemble‐type Kalman filter algorithm conserving mass, total energy and enstrophy , 2017 .

[27]  Joachim Dahl,et al.  Implementation of nonsymmetric interior-point methods for linear optimization over sparse matrix cones , 2010, Math. Program. Comput..

[28]  Zdenek Dostál,et al.  Box Constrained Quadratic Programming with Proportioning and Projections , 1997, SIAM J. Optim..

[29]  Michael A. Saunders,et al.  Procedures for optimization problems with a mixture of bounds and general linear constraints , 1984, ACM Trans. Math. Softw..

[30]  R. Sadourny.  The Dynamics of Finite-Difference Models of the Shallow-Water Equations , 1975 .

[31]  Nicholas I. M. Gould,et al.  Lancelot: A FORTRAN Package for Large-Scale Nonlinear Optimization (Release A) , 1992 .

[32]  Martin Verlaan,et al.  Conservation of Mass and Preservation of Positivity with Ensemble-Type Kalman Filter Algorithms , 2014 .