Methods of continuation and their implementation in the COCO software platform with application to delay differential equations

This paper treats comprehensively the construction of problems from nonlinear dynamics and constrained optimization amenable to parameter continuation techniques and with particular emphasis on multi-segment boundary-value problems with delay. The discussion is grounded in the context of the COCO software package and its explicit support for community-driven development. To this end, the paper first formalizes the COCO construction paradigm for augmented continuation problems compatible with simultaneous analysis of implicitly defined manifolds of solutions to nonlinear equations and the corresponding adjoint variables associated with optimization of scalar objective functions along such manifolds. The paper uses applications to data assimilation from finite time histories and phase response analysis of periodic orbits to identify a universal paradigm of construction that permits abstraction and generalization. It then details the theoretical framework for a COCO-compatible toolbox able to support the analysis of a large family of delay-coupled multi-segment boundary-value problems, including periodic orbits, quasiperiodic orbits, connecting orbits, initial-value problems, and optimal control problems, as illustrated in a suite of numerical examples. The paper aims to present a pedagogical treatment that is accessible to the novice and inspiring to the expert by appealing to the many senses of the applied nonlinear dynamicist. Sprinkled among a systematic discussion of problem construction, graph representations of delay-coupled problems, and vectorized formulas for problem discretization, the paper includes an original derivation using Lagrangian sensitivity analysis of phase-response functionals for periodic-orbit problems in abstract Banach spaces, as well as a demonstration of the regularizing benefits of multi-dimensional manifold continuation for near-singular problems.

[1]  D. Barton.  Control-based continuation: bifurcation and stability analysis for physical experiments , 2015, 1506.04052.

[2]  S. Ross,et al.  Global invariant manifolds delineating transition and escape dynamics in dissipative systems: an application to snap-through buckling , 2020, Nonlinear Dynamics.

[3]  S. Crescitelli,et al.  On the choice of the optimal periodic operation for a continuous fermentation process , 2010, Biotechnology progress.

[4]  Daniel Wetzel,et al.  pde2path - A Matlab package for continuation and bifurcation in 2D elliptic systems , 2012, 1208.3112.

[5]  Yuri A. Kuznetsov,et al.  SlideCont: An Auto97 driver for bifurcation analysis of Filippov systems , 2005, TOMS.

[6]  Michael Dellnitz,et al.  The Computation of Unstable Manifolds Using Subdivision and Continuation , 1996 .

[8]  L. Renson,et al.  Application of control-based continuation to a nonlinear structure with harmonically coupled modes , 2019, Mechanical Systems and Signal Processing.

[9]  Layne T. Watson,et al.  Algorithm 652: HOMPACK: a suite of codes for globally convergent homotopy algorithms , 1987, TOMS.

[10]  D. Roose,et al.  Continuation and Bifurcation Analysis of Delay Differential Equations , 2007 .

[11]  Andrew J Szeri,et al.  Optimization of acoustic scattering from dual-frequency driven microbubbles at the difference frequency. , 2003, The Journal of the Acoustical Society of America.

[12]  P. Berck,et al.  Calculus of variations and optimal control theory , 1993 .

[13]  Z. Bartoszewski.  Solving boundary value problems for delay differential equations by a fixed-point method , 2011, J. Comput. Appl. Math..

[14]  Marco Amabili,et al.  Nonlinear normal modes for damped geometrically nonlinear systems: Application to reduced-order modelling of harmonically forced structures , 2006 .

[15]  A. Szeri,et al.  Optimized translation of microbubbles driven by acoustic fields. , 2007, The Journal of the Acoustical Society of America.

[16]  Frank Schilder,et al.  An Extended Continuation Problem for Bifurcation Analysis in the Presence of Constraints , 2010, Journal of Computational and Nonlinear Dynamics.

[17]  R. Szalai.  Model Reduction of Non-densely Defined Piecewise-Smooth Systems in Banach Spaces , 2015, J. Nonlinear Sci..

[18]  Kestutis Pyragas,et al.  Phase reduction of weakly perturbed limit cycle oscillations in time-delay systems , 2012 .

[19]  L. Renson,et al.  Numerical continuation in nonlinear experiments using local Gaussian process regression , 2019, Nonlinear Dynamics.

[20]  Daniel J. Inman,et al.  Assessing the effect of nonlinearities on the performance of a tuned inerter damper , 2017 .

[21]  M. Crisfield.  An arc‐length method including line searches and accelerations , 1983 .

[22]  Simon A Neild,et al.  Robust identification of backbone curves using control-based continuation , 2016 .

[23]  C. Kelley.  Iterative Methods for Linear and Nonlinear Equations , 1987 .

[24]  H. Maurer,et al.  Optimal control problems with delays in state and control variables subject to mixed control–state constraints , 2009 .

[25]  Ernst Hairer,et al.  Implementing Radau IIA Methods for Stiff Delay Differential Equations , 2001, Computing.

[26]  Jeff Moehlis,et al.  Continuation-based Computation of Global Isochrons , 2010, SIAM J. Appl. Dyn. Syst..

[27]  Ilmar F. Santos,et al.  Experimental bifurcation analysis—Continuation for noise-contaminated zero problems , 2015 .

[28]  Willy Govaerts,et al.  MATCONT: A MATLAB package for numerical bifurcation analysis of ODEs , 2003, TOMS.

[29]  Frank Schilder,et al.  Recipes for Continuation , 2013, Computational science and engineering.

[30]  George Haller,et al.  Nonlinear normal modes and spectral submanifolds: existence, uniqueness and use in model reduction , 2016, 1602.00560.

[31]  George Haller,et al.  Automated computation of autonomous spectral submanifolds for nonlinear modal analysis , 2017, 1709.00886.

[32]  Bernd Krauskopf,et al.  Numerical Continuation Methods for Dynamical Systems , 2007 .

[33]  H. Dankowicz,et al.  Optimization along families of periodic and quasiperiodic orbits in dynamical systems with delay , 2019, Nonlinear Dynamics.

[34]  V. Arnold.  LECTURES ON BIFURCATIONS IN VERSAL FAMILIES , 1972 .

[35]  Wolf-Jürgen Beyn,et al.  The Numerical Computation of Connecting Orbits in Dynamical Systems , 1990 .

[36]  Firas A. Khasawneh,et al.  A multi-interval Chebyshev collocation approach for the stability of periodic delay systems with discontinuities , 2011 .

[37]  Bard Ermentrout,et al.  Type I Membranes, Phase Resetting Curves, and Synchrony , 1996, Neural Computation.

[38]  Leon Glass,et al.  Mackey-Glass equation , 2010, Scholarpedia.

[39]  Bard Ermentrout,et al.  Simulating, analyzing, and animating dynamical systems - a guide to XPPAUT for researchers and students , 2002, Software, environments, tools.

[41]  Frank Schilder,et al.  Continuation of Quasi-periodic Invariant Tori , 2005, SIAM J. Appl. Dyn. Syst..

[42]  Bernd Krauskopf,et al.  Tracking oscillations in the presence of delay-induced essential instability , 2008 .

[43]  Stewart Heitmann,et al.  Arrhythmogenic effects of ultra-long and bistable cardiac action potentials , 2021, PLoS Comput. Biol..

[44]  John Guckenheimer,et al.  Invariant manifolds and global bifurcations. , 2015, Chaos.

[45]  On a boundary value problem for delay differential equations of population dynamics and Chebyshev approximation , 2007 .

[46]  Xiaoting Rui,et al.  A parametric study on supersonic/hypersonic flutter behavior of aero-thermo-elastic geometrically imperfect curved skin panel , 2011 .

[47]  Carmen Chicone,et al.  Asymptotic phase revisited , 2004 .

[48]  Yang Liu,et al.  A numerical approach for the bifurcation analysis of nonsmooth delay equations , 2020, Commun. Nonlinear Sci. Numer. Simul..

[49]  W. Govaerts,et al.  Computation of the Phase Response Curve: A Direct Numerical Approach , 2006, Neural Computation.

[50]  Harry Dankowicz,et al.  TC-HAT: A Novel Toolbox for the Continuation of Periodic Trajectories in Hybrid Dynamical Systems , 2008, SIAM J. Appl. Dyn. Syst..

[51]  Wayne H. Enright,et al.  Numerical methods for computing sensitivities for ODEs and DDEs , 2017, Numerical Algorithms.

[52]  Bernd Krauskopf,et al.  A Lin's method approach to finding and continuing heteroclinic connections involving periodic orbits , 2008 .

[53]  Hubertus Th. Jongen,et al.  Parametric optimization - singularities, pathfollowing and jumps , 1990 .

[54]  Joseph Páez Chávez,et al.  Controlling multistability in a vibro-impact capsule system , 2017 .

[55]  Harry Dankowicz,et al.  Multidimensional Manifold Continuation for Adaptive Boundary-Value Problems , 2020 .

[56]  Karl Iagnemma,et al.  A polynomial chaos approach to the analysis of vehicle dynamics under uncertainty , 2012 .

[57]  B. Mann,et al.  Control-based continuation for investigating nonlinear experiments , 2012 .

[58]  Eusebius J. Doedel,et al.  Lecture Notes on Numerical Analysis of Nonlinear Equations , 2007 .

[59]  E. Doedel,et al.  Optimization in Bifurcation Problems using a Continuation Method , 1987 .

[60]  Lawrence F. Shampine,et al.  Numerical Solution of Delay Differential Equations , 2009 .

[61]  Elena Braverman,et al.  Mackey-glass equation with variable coefficients , 2006, Comput. Math. Appl..

[62]  Bernd Krauskopf,et al.  Global bifurcations of the Lorenz manifold , 2006 .

[63]  Harry Dankowicz,et al.  Coupling FEM With Parameter Continuation for Analysis of Bifurcations of Periodic Responses in Nonlinear Structures , 2013 .

[64]  The Mackey-Glass model of respiratory dynamics: Review and new results , 2012 .

[65]  E. Allgower,et al.  Introduction to Numerical Continuation Methods , 1987 .

[66]  M.I. Wallace,et al.  An adaptive polynomial based forward prediction algorithm for multi-actuator real-time dynamic substructuring , 2005, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[67]  Dirk Roose,et al.  Numerical bifurcation analysis of delay differential equations using DDE-BIFTOOL , 2002, TOMS.