A Case Study in Adjoint Sensitivity Analysis of Parameter Calibration

Adjoint sensitivity computation of parameter estimation problems is a widely used technique in the field of computational science and engineering for retrieving derivatives of a cost functional with respect to parameters efficiently. Those derivatives can be used, e.g. for sensitivity analysis, optimization, or robustness analysis. Deriving and implementing adjoint code is an error-prone, non-trivial task which can be avoided by using Algorithmic Differentiation (AD) software. Generating adjoint code by AD software has the downside of usually requiring a huge amount of memory as well as a non-optimal run time. In this article, we couple two approaches for achieving both, a robust and efficient adjoint code: symbolically derived adjoint formulations and AD. Comparisons are carried out for a real-world case study originating from the remote atmospheric sensing simulation software JURASSIC developed at the Institute of Energy and Climate Research Stratosphere, Research Center Jlich. We show, that the coupled approach outperforms the fully algorithmic approach by AD in terms of run time and memory requirement and argue that this can be achieved while still preserving the desireable feature of AD being automatic.

[1]  Martin Riese,et al.  Tomographic retrieval approach for mesoscale gravity wave observations by the PREMIER Infrared Limb-Sounder , 2009 .

[2]  P. I. Barton,et al.  Bilevel optimization formulation for parameter estimation in vapor–liquid(–liquid) phase equilibrium problems , 2009 .

[3]  Uwe Naumann,et al.  Hierarchical Algorithmic Differentiation A Case Study , 2012 .

[4]  Omar M. Knio,et al.  Spectral Methods for Uncertainty Quantification , 2010 .

[5]  Paul I. Barton,et al.  Towards global bilevel dynamic optimization , 2009, J. Glob. Optim..

[6]  Andreas Griewank,et al.  Evaluating derivatives - principles and techniques of algorithmic differentiation, Second Edition , 2000, Frontiers in applied mathematics.

[7]  Uwe Naumann,et al.  Discrete Adjoints of PETSc through dco/c++ and Adjoint MPI , 2013, Euro-Par.

[8]  Alexander Mitsos,et al.  Higher-order Discrete Adjoint ODE Solver in C++ for Dynamic Optimization , 2015, ICCS.

[9]  O. L. Maître,et al.  Spectral Methods for Uncertainty Quantification: With Applications to Computational Fluid Dynamics , 2010 .

[10]  Serge Gratton,et al.  Approximate Gauss-Newton Methods for Nonlinear Least Squares Problems , 2007, SIAM J. Optim..

[11]  Uwe Naumann,et al.  Second-order Tangent Solvers for Systems of Parameterized Nonlinear Equations , 2015, ICCS.

[12]  Uwe Naumann,et al.  Algorithmic Differentiation of a Complex C++ Code with Underlying Libraries , 2013, ICCS.

[13]  Uwe Naumann,et al.  Algorithmic Differentiation of Numerical Methods , 2015, ACM Trans. Math. Softw..

[14]  Uwe Naumann,et al.  "To be recorded" analysis in reverse-mode automatic differentiation , 2005, Future Gener. Comput. Syst..

[15]  Uwe Naumann,et al.  The Art of Differentiating Computer Programs - An Introduction to Algorithmic Differentiation , 2012, Software, environments, tools.

[16]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[17]  Johannes Orphal,et al.  Retrieval of three-dimensional small-scale structures in upper-tropospheric/lower-stratospheric composition as measured by GLORIA , 2014 .