Attraction of Li-Yorke chaos by retarded SICNNs

Abstract In the present study, dynamics of retarded shunting inhibitory cellular neural networks (SICNNs) is investigated with Li–Yorke chaotic external inputs and outputs. Within the scope of our results, we prove the presence of generalized synchronization in coupled retarded SICNNs, and confirm it by means of the auxiliary system approach. We have obtained more than just synchronization, as it is proved that the Li–Yorke chaos is extended with its ingredients, proximality and frequent separation, which have not been considered in the theory of synchronization at all. Our procedure is used to synchronize chains of unidirectionally coupled neural networks. The results may explain the high performance of brain functioning and can be extended by specific stability analysis methods. Illustrations supporting the results are depicted. For the first time in the literature, proximality and frequent separation features are demonstrated numerically for continuous-time dynamics.

[1]  Olga I. Moskalenko,et al.  Generalized synchronization in discrete maps. New point of view on weak and strong synchronization , 2013 .

[2]  F. Zou,et al.  Bifurcation and chaos in cellular neural networks , 1993 .

[3]  Wen Liu,et al.  Variable Thresholds in the Chaotic Cellular Neural Network , 2007, 2007 International Joint Conference on Neural Networks.

[4]  P. Davis,et al.  Chaotic wandering and search in a cycle-memory neural network , 1992 .

[5]  Takashi Yoneyama,et al.  Isochronal synchronization of time delay and delay-coupled chaotic systems , 2011, Journal of Physics A: Mathematical and Theoretical.

[6]  J. Yorke,et al.  Differentiable generalized synchronization of chaos , 1997 .

[7]  Robert B. Pinter,et al.  Luminance adaptation of preferred object size in identified dragonfly movement detectors , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[8]  Walter J. Freeman,et al.  Hardware architecture of a neural network model simulating pattern recognition by the olfactory bulb , 1989, Neural Networks.

[9]  H. Abarbanel,et al.  Generalized synchronization of chaos: The auxiliary system approach. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  Walter J. Freeman,et al.  TUTORIAL ON NEUROBIOLOGY: FROM SINGLE NEURONS TO BRAIN CHAOS , 1992 .

[11]  Alvin Shrier,et al.  Chaos in neurobiology , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Haijun Jiang,et al.  Global exponential synchronization of fuzzy cellular neural networks with delays and reaction-diffusion terms , 2011, Neurocomputing.

[13]  R. B. Pinter,et al.  Shunting inhibitory cellular neural networks: derivation and stability analysis , 1993 .

[14]  Chunxia Ou,et al.  Almost periodic solutions for shunting inhibitory cellular neural networks , 2009 .

[15]  Ke Qin,et al.  Projective synchronization of different chaotic neural networks with mixed time delays based on an integral sliding mode controller , 2014, Neurocomputing.

[16]  S. Arik,et al.  New exponential stability results for delayed neural networks with time varying delays , 2004 .

[17]  Yongkun Li,et al.  Global exponential stability of periodic solution for shunting inhibitory CNNs with delays , 2005 .

[18]  R. Westervelt,et al.  Stability of analog neural networks with delay. , 1989, Physical review. A, General physics.

[19]  Shigetoshi Nara,et al.  CHAOTIC MEMORY DYNAMICS IN A RECURRENT NEURAL NETWORK WITH CYCLE MEMORIES EMBEDDED BY PSEUDO-INVERSE METHOD , 1995 .

[20]  Ethan Akin,et al.  Li-Yorke sensitivity , 2003 .

[21]  H. Fujisaka,et al.  Stability Theory of Synchronized Motion in Coupled-Oscillator Systems , 1983 .

[22]  L. Tsimring,et al.  Generalized synchronization of chaos in directionally coupled chaotic systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[23]  Marat Akhmet,et al.  Neural Networks with Discontinuous/Impact Activations , 2013 .

[24]  Peter E. Kloeden,et al.  Li–Yorke chaos in higher dimensions: a review , 2006 .

[25]  Kazuyuki Aihara,et al.  Chaotic wandering and its sensitivity to external input in a chaotic neural network , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[26]  Weigao Ge,et al.  Periodic solution and chaotic strange attractor for shunting inhibitory cellular neural networks with impulses. , 2006, Chaos.

[27]  F. R. Marotto.  Snap-back repellers imply chaos in Rn , 1978 .

[28]  Abdesselam Bouzerdoum,et al.  Properties of shunting inhibitory cellular neural networks for colour image enhancement , 1999, ICONIP'99. ANZIIS'99 & ANNES'99 & ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378).

[29]  J. Ruan,et al.  Chaotic dynamics of an integrate-and-fire circuit with periodic pulse-train input , 2003 .

[30]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[31]  Almost periodic solutions for shunting inhibitory cellular neural networks without global Lipschitz and bounded activation functions , 2007 .

[32]  R. Devaney.  An Introduction to Chaotic Dynamical Systems , 1990 .

[33]  Francisco Sandoval Hernández,et al.  Identification of noisy dynamical systems with parameter estimation based on Hopfield neural networks , 2013, Neurocomputing.

[34]  W. Freeman,et al.  Chaotic Oscillations and the Genesis of Meaning in Cerebral Cortex , 1994 .

[35]  M. Akhmet.  Homoclinical structure of the chaotic attractor , 2010 .

[36]  M M Mesulam,et al.  Large‐scale neurocognitive networks and distributed processing for attention, language, and memory , 1990, Annals of neurology.

[37]  M. Feigenbaum.  Universal behavior in nonlinear systems , 1983 .

[38]  J. Kurths,et al.  Global generalized synchronization in networks of different time-delay systems , 2013, 1301.7590.

[39]  Yılmaz Uyaroğlu,et al.  Synchronization and control of chaos in supply chain management , 2015, Comput. Ind. Eng..

[40]  Eva Kaslik,et al.  Nonlinear dynamics and chaos in fractional-order neural networks , 2012, Neural Networks.

[41]  I. Prigogine,et al.  Exploring Complexity: An Introduction , 1989 .

[42]  Yan Huang,et al.  Chaos of a new class of Hopfield neural networks , 2008, Appl. Math. Comput..

[43]  Bahram Nabet,et al.  Analysis and analog implementation of directionally sensitive shunting inhibitory neural networks , 1991, Defense, Security, and Sensing.

[44]  Lihong Huang,et al.  Finite time stability of periodic solution for Hopfield neural networks with discontinuous activations , 2013, Neurocomputing.

[45]  B. John Oommen,et al.  Logistic Neural Networks: Their chaotic and pattern recognition properties , 2014, Neurocomputing.

[46]  I. Tsuda.  Chaotic itinerancy as a dynamical basis of hermeneutics in brain and mind , 1991 .

[47]  Arkady Pikovsky,et al.  On the interaction of strange attractors , 1984 .

[48]  U. Parlitz,et al.  Generalized synchronization of chaos , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[49]  Marat Akhmet,et al.  Chaotic period-doubling and OGY control for the forced Duffing equation , 2012 .

[50]  Zhang Yifeng,et al.  A secure communication scheme based on cellular neural network , 1997, 1997 IEEE International Conference on Intelligent Processing Systems (Cat. No.97TH8335).

[51]  M. K. Ali,et al.  Robust chaos in neural networks , 2000 .

[52]  Jinde Cao,et al.  Existence and exponential stability of almost periodic solution for shunting inhibitory cellular neural networks with impulses , 2007 .

[53]  Hongyong Zhao,et al.  Global stability of almost periodic solution of shunting inhibitory cellular neural networks with variable coefficients , 2008 .

[54]  Period-doubling cascades galore , 2009, Ergodic Theory and Dynamical Systems.

[55]  Masaharu Adachi,et al.  Response to external input of chaotic neural networks based on Newman-Watts model , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[56]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Luigi Occhipinti,et al.  Cellular neural networks in secure transmission applications , 1996, 1996 Fourth IEEE International Workshop on Cellular Neural Networks and their Applications Proceedings (CNNA-96).

[58]  Carroll,et al.  Synchronization in chaotic systems. , 1990, Physical review letters.

[59]  Jinde Cao,et al.  Global asymptotic stability of neural networks with transmission delays , 2000, Int. J. Syst. Sci..

[60]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[61]  Jitao Sun,et al.  Stationary oscillation for chaotic shunting inhibitory cellular neural networks with impulses. , 2007, Chaos.

[62]  Phillipp Meister,et al.  Advanced Synergetics Instability Hierarchies Of Self Organizing Systems And Devices , 2016 .

[63]  B A Huberman,et al.  Chaotic behavior in dopamine neurodynamics. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[64]  Tianping Chen,et al.  Synchronization of coupled connected neural networks with delays , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[65]  J. Yorke,et al.  Period Three Implies Chaos , 1975 .

[66]  M. Rabinovich,et al.  Stochastic synchronization of oscillation in dissipative systems , 1986 .

[67]  Abdesselam Bouzerdoum,et al.  A shunting inhibitory motion detector that can account for the functional characteristics of fly motion-sensitive interneurons , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[69]  Lei Guo,et al.  Stability analysis of reaction-diffusion Cohen-Grossberg neural networks under impulsive control , 2013, Neurocomputing.

[70]  Kazuyuki Aihara,et al.  Self-organization Dynamics in Chaotic Neural Networks , 1997 .

[71]  Marat Akhmet,et al.  Replication of chaos , 2013, Commun. Nonlinear Sci. Numer. Simul..

[72]  Stefan Balint,et al.  Complex and chaotic dynamics in a discrete-time-delayed Hopfield neural network with ring architecture , 2009, Neural Networks.

[73]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[74]  Lu Yan,et al.  Algebraic condition of control for multiple time-delayed chaotic cellular neural networks , 2011, The Fourth International Workshop on Advanced Computational Intelligence.

[75]  V.M. Mladenov,et al.  Synchronization of Chaotic Cellular Neural Networks based on Rössler Cells , 2006, 2006 8th Seminar on Neural Network Applications in Electrical Engineering.

[76]  John R. Terry,et al.  Detection and description of non-linear interdependence in normal multichannel human EEG data , 2002, Clinical Neurophysiology.

[77]  Jianying Shao,et al.  Anti-periodic solutions for shunting inhibitory cellular neural networks with time-varying delays☆ , 2008 .

[78]  Walter J. Freeman,et al.  Chaos and the new science of the brain , 1990 .

[79]  Sabri Arik,et al.  An analysis of exponential stability of delayed neural networks with time varying delays , 2004, Neural Networks.

[80]  Y. Pomeau,et al.  Intermittent transition to turbulence in dissipative dynamical systems , 1980 .

[81]  Shihua Zhang,et al.  Adaptive lag synchronization of chaotic Cohen-Grossberg neural networks with discrete delays. , 2012, Chaos.

[82]  A. Londei,et al.  Synchronization phenomena in 2D chaotic CNN , 1994, Proceedings of the Third IEEE International Workshop on Cellular Neural Networks and their Applications (CNNA-94).

[83]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[84]  Johan A. K. Suykens,et al.  Coupled chaotic simulated annealing processes , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[85]  Weirui Zhao,et al.  On almost periodic solution of shunting inhibitory cellular neural networks with variable coefficients and time-varying delays , 2008 .

[86]  J. Hale,et al.  Dynamics and Bifurcations , 1991 .

[87]  K. Yamashita,et al.  A chaotic neural network for reducing the peak-to-average power ratio of multicarrier modulation , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[88]  M. O. Fen,et al.  Shunting inhibitory cellular neural networks with chaotic external inputs. , 2013, Chaos.

[89]  Zhang Lei,et al.  The Chaotic Cipher Based on CNNs and Its Application in Network , 2011, 2011 2nd International Symposium on Intelligence Information Processing and Trusted Computing.

[90]  Xin Wang,et al.  Period-doublings to chaos in a simple neural network , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[91]  Jinde Cao,et al.  Adaptive synchronization of neural networks with or without time-varying delay. , 2006, Chaos.

[92]  Parlitz,et al.  Generalized synchronization, predictability, and equivalence of unidirectionally coupled dynamical systems. , 1996, Physical review letters.

[93]  Kunihiko Fukushima,et al.  Analysis of the process of visual pattern recognition by the neocognitron , 1989, Neural Networks.

[94]  Jinde Cao,et al.  Synchronization control of switched linearly coupled neural networks with delay , 2010, Neurocomputing.

[95]  Jinde Cao,et al.  Almost periodic solution of shunting inhibitory cellular neural networks with time-varying delay , 2003 .

[96]  John Guckenheimer,et al.  Chaos in the Hodgkin-Huxley Model , 2002, SIAM J. Appl. Dyn. Syst..

[97]  K. Aihara,et al.  12. Chaotic oscillations and bifurcations in squid giant axons , 1986 .

[98]  Huaguang Zhang,et al.  Synchronization stability in complex interconnected neural networks with nonsymmetric coupling , 2013, Neurocomputing.

[99]  Yong Yao,et al.  Central pattern generating and recognizing in olfactory bulb: A correlation learning rule , 1988, Neural Networks.

[100]  Jin Liang,et al.  Existence of almost periodic solutions for SICNNs with time-varying delays , 2008 .

[101]  Bin Jiang,et al.  LMI-Based Approach for Global Asymptotic Stability Analysis of Recurrent Neural Networks with Various Delays and Structures , 2011, IEEE Transactions on Neural Networks.

[102]  M. Akhmet.  Devaney’s chaos of a relay system , 2009 .

[103]  Wentao Wang,et al.  Anti-periodic solutions for shunting inhibitory cellular neural networks with time-varying delays in leakage terms , 2013, Neurocomputing.

[104]  Wolfgang A. Halang,et al.  LI-YORKE CHAOS IN A SPATIOTEMPORAL CHAOTIC SYSTEM , 2006 .

[105]  Yuehua Yu,et al.  Existence and exponential stability of almost periodic solutions for shunting inhibitory cellular neural networks with continuously distributed delays , 2007 .

[106]  Huiyan Kang,et al.  Anti-Periodic Solutions for Shunting Inhibitory Cellular Neural Networks with Continuously Distributed Delays , 2010, 2010 2nd International Conference on Information Engineering and Computer Science.

[107]  Nonsmooth functions in generalized synchronization of chaos , 2001 .

[108]  Feng Liu,et al.  A new chaotic Hopfield neural network and its synthesis via parameter switchings , 2013, Neurocomputing.

[109]  Yang Liu,et al.  Existence and global exponential stability of almost periodic solutions to Cohen-Grossberg neural networks with distributed delays on time scales , 2014, Neurocomputing.

[110]  Christof Koch,et al.  Visual Information Processing: From Neurons to Chips , 1991 .

[111]  Hongbin Zhang,et al.  Global exponential stability of impulsive fuzzy Cohen-Grossberg neural networks with mixed delays and reaction-diffusion terms , 2012, Neurocomputing.

[112]  Lihong Huang,et al.  Existence and stability of almost periodic solutions for shunting inhibitory cellular neural networks with time-varying delays , 2007 .

[113]  Josef A. Nossek,et al.  A chaotic attractor with cellular neural networks , 1991 .

[114]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[115]  Leon O. Chua,et al.  Cellular neural networks with non-linear and delay-type template elements and non-uniform grids , 1992, Int. J. Circuit Theory Appl..