Periodic shadowing sensitivity analysis of chaotic systems

Abstract The sensitivity of long-time averages of a hyperbolic chaotic system to parameter perturbations can be determined using the shadowing direction, the uniformly-bounded-in-time solution of the sensitivity equations. Although its existence is formally guaranteed for certain systems, methods to determine it are hardly available. One practical approach is the Least-Squares Shadowing (LSS) algorithm (Wang (2014) [18] ), whereby the shadowing direction is approximated by the solution of the sensitivity equations with the least square average norm. Here, we present an alternative, potentially simpler shadowing-based algorithm, termed periodic shadowing. The key idea is to obtain a bounded solution of the sensitivity equations by complementing it with periodic boundary conditions in time. We show that this is not only justifiable when the reference trajectory is itself periodic, but also possible and effective for chaotic trajectories. Our error analysis shows that periodic shadowing has the same convergence rates as LSS when the time span T is increased: the sensitivity error first decays as 1 / T and then, asymptotically as 1 / T . We demonstrate the approach on the Lorenz equations, and also show that, as T tends to infinity, periodic shadowing sensitivities converge to the same value obtained from long unstable periodic orbits (Lasagna (2018) [14] ) for which there is no shadowing error. Finally, finite-difference approximations of the sensitivity are also examined, and we show that subtle non-hyperbolicity features of the Lorenz system introduce a small, yet systematic, bias.

[1]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[2]  George Papadakis,et al.  A preconditioned Multiple Shooting Shadowing algorithm for the sensitivity analysis of chaotic systems , 2018, J. Comput. Phys..

[3]  S. Grossmann Linear response in chaotic states of discrete dynamics , 1984 .

[4]  M. Allen,et al.  Sensitivity analysis of the climate of a chaotic system , 2000 .

[5]  Willy Govaerts,et al.  Numerical methods for bifurcations of dynamical equilibria , 1987 .

[6]  P. Hartman Ordinary Differential Equations , 1965 .

[7]  S. Kuznetsov Hyperbolic Chaos: A Physicist’s View , 2012 .

[8]  Juan Sánchez,et al.  On the Multiple Shooting Continuation of Periodic orbits by Newton-Krylov Methods , 2010, Int. J. Bifurc. Chaos.

[9]  Celso Grebogi,et al.  Do numerical orbits of chaotic dynamical processes represent true orbits? , 1987, J. Complex..

[10]  Qiqi Wang,et al.  Multiple shooting shadowing for sensitivity analysis of chaotic dynamical systems , 2017, J. Comput. Phys..

[11]  D. Ruelle A review of linear response theory for general differentiable dynamical systems , 2009, 0901.0484.

[12]  Calyampudi R. Rao,et al.  Linear statistical inference and its applications , 1965 .

[13]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[14]  D. Viswanath Recurrent motions within plane Couette turbulence , 2006, Journal of Fluid Mechanics.

[15]  D. J. Albers,et al.  Structural stability and hyperbolicity violation in high-dimensional dynamical systems , 2004 .

[16]  Alfio Borzì,et al.  Computational Optimization of Systems Governed by Partial Differential Equations , 2012, Computational science and engineering.

[17]  John Thuburn,et al.  Climate sensitivities via a Fokker–Planck adjoint approach , 2005 .

[18]  Qiqi Wang,et al.  Least squares shadowing sensitivity analysis of a modified Kuramoto–Sivashinsky equation , 2013, 1307.8197.

[19]  C. Reick,et al.  Linear response of the Lorenz system. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  P. Luchini,et al.  Adjoint Equations in Stability Analysis , 2014, 2404.17304.

[21]  D. Ruelle Smooth Dynamics and New Theoretical Ideas in Nonequilibrium Statistical Mechanics , 1998, chao-dyn/9812032.

[22]  Qiqi Wang,et al.  Forward and adjoint sensitivity computation of chaotic dynamical systems , 2012, J. Comput. Phys..

[23]  Robert D. Russell,et al.  Numerical solution of boundary value problems for ordinary differential equations , 1995, Classics in applied mathematics.

[24]  C. Sparrow The Lorenz Equations: Bifurcations, Chaos, and Strange Attractors , 1982 .

[25]  R. Bowen ω-Limit sets for Axiom A diffeomorphisms , 1975 .

[26]  E. Cohen,et al.  Dynamical ensembles in stationary states , 1995, chao-dyn/9501015.

[27]  Qiqi Wang,et al.  Least Squares Shadowing Method for Sensitivity Analysis of Differential Equations , 2015, SIAM J. Numer. Anal..

[28]  M. Viana What’s new on lorenz strange attractors? , 2000 .

[29]  Roger Temam,et al.  DNS-based predictive control of turbulence: an optimal benchmark for feedback algorithms , 2001, Journal of Fluid Mechanics.

[30]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[31]  Fred Wubs,et al.  Numerical Bifurcation Methods and their Application to Fluid Dynamics: Analysis beyond Simulation , 2012 .

[32]  Colin Sparrow,et al.  The Lorenz equations , 1982 .

[33]  James A. Yorke,et al.  Explosions of chaotic sets , 2000 .

[34]  D. Ruelle Differentiation of SRB States , 1997 .

[35]  Qiqi Wang,et al.  Convergence of the Least Squares Shadowing Method for Computing Derivative of Ergodic Averages , 2013, SIAM J. Numer. Anal..

[36]  O. Pironneau,et al.  SHAPE OPTIMIZATION IN FLUID MECHANICS , 2004 .

[37]  J. Hale,et al.  Ordinary Differential Equations , 2019, Fundamentals of Numerical Mathematics for Physicists and Engineers.

[38]  D. Cacuci Sensitivity theory for nonlinear systems. I. Nonlinear functional analysis approach , 1981 .

[39]  S. Ershov Is a perturbation theory for dynamical chaos possible , 1993 .

[40]  G. Eyink,et al.  Ruelle's linear response formula, ensemble adjoint schemes and Lévy flights , 2004 .

[41]  H. Chaté,et al.  Characterizing dynamics with covariant Lyapunov vectors. , 2007, Physical review letters.

[42]  Divakar Viswanath,et al.  The Lindstedt-Poincaré Technique as an Algorithm for Computing Periodic Orbits , 2001, SIAM Rev..

[43]  Farmer Sensitive dependence on parameters in nonlinear dynamics. , 1985, Physical review letters.

[44]  Haitao Liao,et al.  Efficient sensitivity analysis method for chaotic dynamical systems , 2016, J. Comput. Phys..

[45]  Davide Lasagna,et al.  Sensitivity Analysis of Chaotic Systems Using Unstable Periodic Orbits , 2017, SIAM J. Appl. Dyn. Syst..

[46]  Qiqi Wang,et al.  Least Squares Shadowing sensitivity analysis of chaotic limit cycle oscillations , 2012, J. Comput. Phys..

[47]  Qiqi Wang,et al.  Probability density adjoint for sensitivity analysis of the Mean of Chaos , 2013, J. Comput. Phys..

[48]  Matthew P. Juniper,et al.  Matrix-free continuation of limit cycles for bifurcation analysis of large thermoacoustic systems , 2013, J. Comput. Phys..