Fast spin up of Ocean biogeochemical models using matrix-free Newton–Krylov

Abstract A novel computational approach is introduced for the efficient computation of equilibrium solutions of seasonally forced ocean biogeochemical models. The essential idea is to formulate the problem as a large system of nonlinear algebraic equations to be solved with a class of methods known as matrix-free Newton–Krylov (MFNK). MFNK is a combination of Newton-type methods for superlinearly convergent solution of nonlinear equations, and Krylov subspace methods for solving the Newton correction equations. The basic link between the two methods is the Jacobian-vector product, which may be probed approximately without forming and storing the elements of the true Jacobian. To render this approach practical for global models with O(10 6 ) degrees of freedom, a flexible preconditioning strategy is developed. The result is an essentially “black-box” numerical scheme than can be applied to most existing biogeochemical models. The method is illustrated by applying it to find the equilibrium solutions of two realistic biogeochemical problems. Compared with the conventional approach of direct time integration, the preconditioned-MFNK scheme is shown to be roughly two orders of magnitude more efficient. Several potential refinements of the basic algorithm that may yield further performance gains are discussed. The numerical scheme described here addresses a fundamental challenge to using ocean biogeochemical models more effectively.

[1]  M. Powell,et al.  On the Estimation of Sparse Jacobian Matrices , 1974 .

[2]  Stig Skelboe,et al.  Computation of the periodic steady-state response of nonlinear networks by extrapolation methods , 1980 .

[3]  Fred Wubs,et al.  A method to reduce the spin-up time of ocean models , 2008 .

[4]  Homer F. Walker,et al.  Choosing the Forcing Terms in an Inexact Newton Method , 1996, SIAM J. Sci. Comput..

[5]  James Demmel,et al.  A Supernodal Approach to Sparse Partial Pivoting , 1999, SIAM J. Matrix Anal. Appl..

[6]  P. Brown A local convergence theory for combined inexact-Newton/finite-difference projection methods , 1987 .

[7]  P. Brown,et al.  Matrix-free methods for stiff systems of ODE's , 1986 .

[8]  Trond Steihaug,et al.  Truncated-newtono algorithms for large-scale unconstrained optimization , 1983, Math. Program..

[9]  Randy Showstack,et al.  World Ocean Database , 2009 .

[10]  Carl Wunsch,et al.  Practical global oceanic state estimation , 2007 .

[11]  Edward A. Boyle,et al.  Decoupling of iron and phosphate in the global ocean , 2005 .

[12]  F. Primeau,et al.  A fast Newton-Krylov solver for seasonally varying global ocean biogeochemistry models , 2008 .

[13]  Yousef Saad,et al.  Hybrid Krylov Methods for Nonlinear Systems of Equations , 1990, SIAM J. Sci. Comput..

[14]  Patrick Heimbach,et al.  Controls on ocean productivity and air‐sea carbon flux: An adjoint model sensitivity study , 2006 .

[15]  Gautam M. Shroff,et al.  You have printed the following article : Stabilization of Unstable Procedures : The Recursive Projection Method , 2007 .

[16]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[17]  T. Aprille,et al.  A computer algorithm to determine the steady-state response of nonlinear oscillators , 1972 .

[18]  Bryan D. Davidson,et al.  Large-Scale Continuation and Numerical Bifurcation for Partial Differential Equations , 1997 .

[19]  Stephanie Dutkiewicz,et al.  Interactions of the iron and phosphorus cycles: A three‐dimensional model study , 2005 .

[20]  R. Dembo,et al.  INEXACT NEWTON METHODS , 1982 .

[21]  Carol S. Woodward,et al.  Enabling New Flexibility in the SUNDIALS Suite of Nonlinear and Differential/Algebraic Equation Solvers , 2020, ACM Trans. Math. Softw..

[22]  S. Khatiwala,et al.  Accelerated simulation of passive tracers in ocean circulation models , 2003 .

[23]  Patrick R. Amestoy,et al.  Multifrontal parallel distributed symmetric and unsymmetric solvers , 2000 .

[24]  Alex Pothen,et al.  What Color Is Your Jacobian? Graph Coloring for Computing Derivatives , 2005, SIAM Rev..

[25]  C. Wunsch,et al.  How long to oceanic tracer and proxy equilibrium , 2008 .

[26]  William J. Rider,et al.  Physics-Based Preconditioning and the Newton-Krylov Method for Non-equilibrium Radiation Diffusion , 2000 .

[27]  Charles S. Zender,et al.  Interannual variability in atmospheric mineral aerosols from a 22‐year model simulation and observational data , 2003 .

[28]  G. Sohie,et al.  Generalization of the matrix inversion lemma , 1986, Proceedings of the IEEE.

[29]  Jacob K. White,et al.  Efficient Steady-State Analysis Based on Matrix-Free Krylov-Subspace Methods , 1995, 32nd Design Automation Conference.

[30]  C. W. Gear,et al.  Iterative Solution of Linear Equations in ODE Codes , 1983 .

[31]  Andrzej A. Wyszogrodzki,et al.  An efficient physics-based preconditioner for the fully implicit solution of small-scale thermally driven atmospheric flows , 2003 .

[32]  T. Chan,et al.  Nonlinearly Preconditioned Krylov Subspace Methods for Discrete Newton Algorithms , 1984 .

[33]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[34]  Thomas Kaminski,et al.  Recipes for adjoint code construction , 1998, TOMS.

[35]  D. Keyes,et al.  Jacobian-free Newton-Krylov methods: a survey of approaches and applications , 2004 .

[36]  Christian H. Bischof,et al.  ADIC: an extensible automatic differentiation tool for ANSI‐C , 1997, Softw. Pract. Exp..

[37]  Timothy M. Merlis,et al.  Fast Dynamical Spin up of Ocean General Circulation Models , 2006 .

[38]  J. J. Moré,et al.  Estimation of sparse jacobian matrices and graph coloring problems , 1983 .

[39]  C. Kelley Iterative Methods for Linear and Nonlinear Equations , 1987 .

[40]  James Demmel,et al.  SuperLU_DIST: A scalable distributed-memory sparse direct solver for unsymmetric linear systems , 2003, TOMS.

[41]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.