Optimal Fluctuations and the Control of Chaos

The energy-optimal migration of a chaotic oscillator from one attractor to another coexisting attractor is investigated via an analogy between the Hamiltonian theory of fluctuations and Hamiltonian formulation of the control problem. We demonstrate both on physical grounds and rigorously that the Wentzel-Freidlin Hamiltonian arising in the analysis of fluctuations is equivalent to Pontryagin's Hamiltonian in the control problem with an additive linear unrestricted control. The deterministic optimal control function is identied with the optimal fluctuational force. Numerical and analogue experiments undertaken to verify these ideas demonstrate that, in the limit of small noise intensity, fluctuational escape from the chaotic attractor occurs via a unique (optimal) path corresponding to a unique (optimal) fluctuational force. Initial conditions on the chaotic attractor are identified. The solution of the boundary value control problem for the Pontryagin Hamiltonian is found numerically. It is shown that this solution is approximated very accurately by the optimal fluctuational force found using statistical analysis of the escape trajectories. A second series of numerical experiments on the deterministic system (i.e. in the absence of noise) show that a control function of precisely the same shape and magnitude is indeed able to instigate escape. It is demonstrated that this control function minimizes the cost functional and the corresponding energy is found to be smaller than that obtained with some earlier adaptive control algorithms.

[1]  S. Dreyfus.  Dynamic Programming and the Calculus of Variations , 1960 .

[2]  Peter V. E. McClintock,et al.  Analogue studies of nonlinear systems , 1998 .

[3]  Robert Graham,et al.  Existence of a potential for dissipative dynamical systems , 1984 .

[4]  Yuri Kifer,et al.  A Discrete-Time Version of the Wentzell-Friedlin Theory , 1990 .

[5]  Celso Grebogi,et al.  Dynamical properties of a simple mechanical system with a large number of coexisting periodic attractors , 1998 .

[6]  N. S. Simonovića.  Calculations of periodic orbits : The monodromy method and application to regularized systems , 1999 .

[7]  Vadim N. Smelyanskiy,et al.  Observable and hidden singular features of large fluctuations in nonequilibrium systems , 1994 .

[8]  Kurths,et al.  Influence of noise on statistical properties of nonhyperbolic attractors , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[9]  D. Luchinsky,et al.  Corrals and Critical Behavior of the Distribution of Fluctuational Paths. , 1996, Physical review letters.

[10]  Celso Grebogi,et al.  Using small perturbations to control chaos , 1993, Nature.

[11]  Vadim N. Smelyanskiy,et al.  Optimal Control of Large Fluctuations. , 1997 .

[12]  Alexander N. Pisarchik,et al.  Investigation of a CO2 laser response to loss perturbation near period doubling. , 1995 .

[13]  Dmitry G. Luchinsky,et al.  LETTER TO THE EDITOR: On the nature of large fluctuations in equilibrium systems: observation of an optimal force , 1997 .

[14]  Peter Schmelcher,et al.  Detecting Unstable Periodic Orbits of Chaotic Dynamical Systems , 1997 .

[15]  Stein,et al.  Optimal paths and the prehistory problem for large fluctuations in noise-driven systems. , 1992, Physical review letters.

[16]  Grebogi,et al.  Efficient switching between controlled unstable periodic orbits in higher dimensional chaotic systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[17]  Riccardo Mannella,et al.  Fluctuational Escape from Chaotic Attractors , 2000 .

[18]  Troy Shinbrot,et al.  Progress in the control of chaos , 1995 .

[19]  R. Feynman,et al.  Quantum Mechanics and Path Integrals , 1965 .

[20]  Beale.  Noise-induced escape from attractors in one-dimensional maps. , 1989, Physical review. A, General physics.

[21]  C. Grebogi,et al.  Multistability and the control of complexity. , 1997, Chaos.

[22]  Kaufman,et al.  Kramers problem for a multiwell potential , 2000, Physical review letters.

[23]  J. Cash.  On the Numerical Integration of Nonlinear Two-Point Boundary Value Problems Using Iterated Deferred Corrections. Part 2: The Development and Analysis of Highly Stable Deferred Correction Formulae , 1988 .

[24]  Richard L. Kautz,et al.  Activation energy for thermally induced escape from a basin of attraction , 1987 .

[25]  McKane,et al.  Use of Hamiltonian mechanics in systems driven by colored noise. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  C Grebogi,et al.  Preference of attractors in noisy multistable systems. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[27]  V. N. Chizhevsky,et al.  Optimal timing for targeting periodic orbits in a loss-driven CO2 laser☆ , 1997 .

[28]  J. Cash.  Numerical integration of non-linear two-point boundary-value problems using iterated deferred corrections—I , 1986 .

[29]  M. Freidlin,et al.  Random Perturbations of Dynamical Systems , 1984 .

[30]  E. Atlee Jackson,et al.  The OPCL control method for entrainment, model-resonance, and migration actions on multiple-attractor systems. , 1997, Chaos.

[31]  Auerbach,et al.  Exploring chaotic motion through periodic orbits. , 1987, Physical review letters.

[32]  Mannella,et al.  Zero-dispersion nonlinear resonance in dissipative systems. , 1996, Physical review letters.

[33]  Shanmuganathan Rajasekar,et al.  Migration control in two coupled Duffing oscillators , 1997 .

[34]  Martienssen,et al.  Controlling chaos experimentally in systems exhibiting large effective Lyapunov exponents. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[35]  Robert S. Maier,et al.  Escape problem for irreversible systems. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[36]  Igor A. Khovanov,et al.  Fluctuation-induced escape from the basin of attraction of a quasiattractor , 1999 .

[37]  Margaret H. Wright,et al.  A Deferred Correction Method for Nonlinear Two-Point Boundary Value Problems: Implementation and Numerical Evaluation , 1991, SIAM J. Sci. Comput..

[38]  Mary W. Cooper,et al.  Dynamic Programming and the Calculus of Variations , 1981 .

[39]  W. Fleming.  Exit probabilities and optimal stochastic control , 1977 .

[40]  R. Zwanzig.  Nonlinear generalized Langevin equations , 1973 .

[41]  Vadim N. Smelyanskiy,et al.  Resonant directed diffusion in nonadiabatically driven systems , 1998 .

[42]  Y. Lai,et al.  Unstable periodic orbits and the natural measure of nonhyperbolic chaotic saddles. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[43]  George Marsaglia,et al.  A Fast, Easily Implemented Method for Sampling from Decreasing or Symmetric Unimodal Density Functions , 1984 .

[44]  Robert S. Maier,et al.  Limiting Exit Location Distributions in the Stochastic Exit Problem , 1994, SIAM J. Appl. Math..

[45]  Robert S. Maier,et al.  A scaling theory of bifurcations in the symmetric weak-noise escape problem , 1996 .

[46]  Vadim N. Smelyanskiy,et al.  Topological features of large fluctuations to the interior of a limit cycle , 1997 .

[47]  Francisco Tirado,et al.  Supercomputation in Nonlinear and Disordered Systems: Algorithms, Applications and Architectures , 1997 .

[48]  Grebogi,et al.  Unstable periodic orbits and the dimensions of multifractal chaotic attractors. , 1988, Physical review. A, General physics.

[49]  H. Jauslin,et al.  Nondifferentiable potentials for nonequilibrium steady states , 1987 .

[50]  Riccardo Mannella,et al.  Observation of saddle-point avoidance in noise-induced escape. , 1999 .

[51]  S. Boccaletti,et al.  The control of chaos: theory and applications , 2000 .

[52]  D. G. Luchinsky,et al.  Irreversibility of classical fluctuations studied in analogue electrical circuits , 1997, Nature.

[53]  Mannella,et al.  Fluctuations and the energy-optimal control of chaos , 2000, Physical review letters.

[54]  Leslie M. Hocking,et al.  Optimal control , 1991 .

[55]  Yuri Kifer,et al.  Large deviations in dynamical systems and stochastic processes , 1990 .

[56]  Grebogi,et al.  Using chaos to direct trajectories to targets. , 1990, Physical review letters.

[57]  Peter Whittle,et al.  Optimal Control: Basics and Beyond , 1996 .

[58]  Lars Onsager,et al.  Fluctuations and Irreversible Processes , 1953 .

[59]  G. Dangelmayr,et al.  Learning to control a complex multistable system. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[60]  Stanislav M. Soskin.  Zero-dispersion nonlinear resonance , 1994, Other Conferences.

[61]  Chizhevsky Vn,et al.  Periodically loss-modulated CO2 laser as an optical amplitude and phase multitrigger. , 1994 .

[62]  E. M. Lifshitz,et al.  Statistical physics. Pt.1, Pt.2 , 1980 .

[63]  Graham,et al.  Nonequilibrium potentials for dynamical systems with fractal attractors or repellers. , 1991, Physical review letters.

[64]  Peter Grassberger,et al.  Noise-induced escape from attractors , 1989 .

[65]  Mark Dykman,et al.  Large fluctuations and optimal paths in chemical kinetics , 1994 .