Implementation of dynamic programming for chaos control in discrete systems

In this paper the control of discrete chaotic systems by designing linear feedback controllers is presented. The linear feedback control problem for nonlinear systems has been formulated under the viewpoint of dynamic programming. For suppressing chaos with minimum control effort, the system is stabilized on its first order unstable fixed point (UFP). The presented method also could be employed to make any desired nth order fixed point of the system, stable. Two different methods for higher order UFPs stabilization are suggested. Afterwards, these methods are applied to two well-known chaotic discrete systems: the Logistic and the Henon Maps. For each of them, the first and second UFPs in their chaotic regions are stabilized and simulation results are provided for the demonstration of performance.

[1]  W. Rudin.  Principles of mathematical analysis , 1964 .

[2]  Kestutis Pyragas.  Continuous control of chaos by self-controlling feedback , 1992 .

[3]  Moritz Diehl,et al.  Approximate robust dynamic programming and robustly stable MPC , 2006, Autom..

[4]  Eckehard Schöll,et al.  Handbook of Chaos Control , 2007 .

[5]  Aria Alasty,et al.  Stabilizing periodic orbits of chaotic systems using fuzzy adaptive sliding mode control , 2008 .

[6]  Carlos A. Cruz-Villar,et al.  Optimal stabilization of unstable periodic orbits embedded in chaotic systems , 2007 .

[7]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[8]  Moses O. Tadé,et al.  Constrained control of chaos , 2002 .

[9]  José Manoel Balthazar,et al.  On control and synchronization in chaotic and hyperchaotic systems via linear feedback control , 2008 .

[10]  M. Yassen.  Controlling chaos and synchronization for new chaotic system using linear feedback control , 2005 .

[11]  Ju H. Park,et al.  H∞ synchronization of chaotic systems via dynamic feedback approach , 2008 .

[12]  Manuel S. Santos,et al.  Analysis of a Numerical Dynamic Programming Algorithm Applied to Economic Models , 1998 .

[13]  Ju H. Park.  Adaptive synchronization of Rossler system with uncertain parameters , 2005 .

[14]  R. Bellman.  Dynamic programming. , 1957, Science.

[15]  Ju H Park,et al.  Exponential synchronization of the Genesio–Tesi chaotic system via a novel feedback control , 2007 .

[16]  Xinghuo Yu,et al.  Stabilizing unstable periodic orbits of chaotic systems via an optimal principle , 2000, J. Frankl. Inst..

[17]  M. Tadi,et al.  Synchronization of chaotic systems based on SDRE method , 2006 .

[18]  Ju H. Park,et al.  ADAPTIVE ℋ∞ SYNCHRONIZATION OF UNIFIED CHAOTIC SYSTEMS , 2009 .

[19]  G. Baier,et al.  Maximum hyperchaos in generalized Hénon maps , 1990 .

[20]  José Manoel Balthazar,et al.  On an optimal control design for Rössler system , 2004 .

[21]  Awad El-Gohary,et al.  Optimal synchronization of Rössler system with complete uncertain parameters , 2006 .

[22]  David A. Kendrick,et al.  Stochastic control for economic models: past, present and the paths ahead , 2005 .

[23]  Mohammad Shahrokhi,et al.  Indirect adaptive control of discrete chaotic systems , 2007 .

[24]  M. Paskota.  On Local Control of Chaos: the Neighbourhood Size , 1996 .

[25]  Chongzhao Han,et al.  Robust adaptive tracking control for a class of uncertain chaotic systems , 2003 .

[26]  Controlling chaotic discrete system via the improved closed-loop control , 1998 .

[27]  Ying-Cheng Lai,et al.  Controlling chaos , 1994 .

[28]  Jiong Ruan,et al.  An improved estimation of the fixed point's neighborhood in controlling discrete chaotic systems , 1998 .

[29]  J. Primbs,et al.  Finite Receding Horizon Linear Quadratic Control: A Unifying Theory for Stability and Performance Analysis , 1997 .

[30]  Alexander L. Fradkov,et al.  Control of Chaos: Methods and Applications. I. Methods , 2003 .

[31]  Aria Alasty,et al.  Nonlinear feedback control of chaotic pendulum in presence of saturation effect , 2007 .

[32]  Gert de Cooman,et al.  Dynamic programming for deterministic discrete-time systems with uncertain gain , 2005, Int. J. Approx. Reason..

[33]  P. Samuelson.  Lifetime Portfolio Selection by Dynamic Stochastic Programming , 1969 .