Chaos engineering and its application to parallel distributed processing with chaotic neural networks

Chaotic dynamics and its possible applications are considered from the viewpoint of engineering. Various applications, even to consumer products such as household appliances, are developing in the field of chaos engineering. In particular we review parallel distributed processing with spatio-temporal chaos on the basis of a model of chaotic neural networks.

[1]  Kazuyuki Aihara,et al.  Time‐series analysis of behavior of a two‐link nozzle in a dishwasher , 1996 .

[2]  L. Chua,et al.  A universal circuit for studying and generating chaos. I. Routes to chaos , 1993 .

[3]  D. A. Baxter,et al.  Mathematical Modeling of Gene Networks , 2000, Neuron.

[4]  LeeGeehyuk,et al.  The bifurcating neuron network 2 , 2002 .

[5]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[6]  Kazuyuki Aihara,et al.  Adaptive annealing for chaotic optimization , 1996 .

[7]  Leon Glass.  Chaos in neural systems , 1998 .

[8]  J. Zukas.  Introduction to the Modern Theory of Dynamical Systems , 1998 .

[9]  Kazuyuki Aihara,et al.  Detecting nonlinear Determinism in voiced Sounds of Japanese vowel /a/ , 2000, Int. J. Bifurc. Chaos.

[10]  Kazuyuki Aihara,et al.  Exponential and chaotic neurodynamical tabu searches for quadratic assignment problems , 2000 .

[11]  Leon O. Chua,et al.  Practical Numerical Algorithms for Chaotic Systems , 1989 .

[12]  Kazuyuki Aihara,et al.  Experimental study on chaotic motion of a flooded ship in waves , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[13]  A. Goldbeter,et al.  Chaos and birhythmicity in a model for circadian oscillations of the PER and TIM proteins in drosophila , 1999, Journal of theoretical biology.

[14]  José Luis Huertas,et al.  Implementation of CMOS fuzzy controllers as mixed-signal integrated circuits , 1997, IEEE Trans. Fuzzy Syst..

[15]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[16]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[17]  Shigetoshi Nara,et al.  CHAOTIC MEMORY DYNAMICS IN A RECURRENT NEURAL NETWORK WITH CYCLE MEMORIES EMBEDDED BY PSEUDO-INVERSE METHOD , 1995 .

[18]  Mehmet Emre Çek,et al.  Analysis of observed chaotic data , 2004 .

[19]  Celso Grebogi,et al.  The impact of chaos on science and society , 1997 .

[20]  Kazuyuki Aihara,et al.  Dynamical Cell Assembly Hypothesis -- Theoretical Possibility of Spatio-temporal Coding in the Cortex , 1996, Neural Networks.

[21]  William L. Ditto,et al.  DYNAMICS BASED COMPUTATION , 1998 .

[22]  I. Tokuda,et al.  Aihara K: A simple geometrical structure underlying speech signals of the Japanese vowel a , 1996 .

[23]  Hiroyoshi Nomura,et al.  Introduction of Microwave Oven, "Inverter Ohirome Eleck san" , 1997 .

[24]  K. Ikeda,et al.  Maxwell-Bloch Turbulence , 1989 .

[25]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[26]  S. Yoshizawa,et al.  An Active Pulse Transmission Line Simulating Nerve Axon , 1962, Proceedings of the IRE.

[27]  K. Aihara,et al.  12. Chaotic oscillations and bifurcations in squid giant axons , 1986 .

[28]  A. Selverston,et al.  Interacting biological and electronic neurons generate realistic oscillatory rhythms , 2000, Neuroreport.

[29]  Hatsuo Hayashi,et al.  Chaotic responses of the hippocampal CA3 region to a mossy fiber stimulation in vitro , 1995, Brain Research.

[30]  Kazuyuki Aihara,et al.  Combination of Chaotic Neurodynamics with the 2-opt Algorithm to Solve Traveling Salesman Problems , 1997 .

[31]  M. Bernhard.  Introduction to Chaotic Dynamical Systems , 1992 .

[32]  Richard M. Karp,et al.  The Traveling-Salesman Problem and Minimum Spanning Trees , 1970, Oper. Res..

[33]  Willi-Hans Steeb,et al.  Chaos in electronics , 1997 .

[34]  Hiroshi Nozawa,et al.  A neural network model as a globally coupled map and applications based on chaos. , 1992, Chaos.

[35]  Kazuyuki Aihara,et al.  Chaos engineering in Japan , 1995, CACM.

[36]  Kazuyuki Aihara,et al.  Pulse propagation networks: A neural network model that uses temporal coding by action potentials , 1993, Neural Networks.

[37]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[38]  J. Collins,et al.  Construction of a genetic toggle switch in Escherichia coli , 2000, Nature.

[39]  C. Wu,et al.  A Universal Circuit for Studying and Generating Chaos-Part I: Routes , 1993 .

[40]  K. Aihara,et al.  Chaotic Neural Networks(Bifurcation Phenomena in Nonlinear Systems and Theory of Dynamical Systems) , 1989 .

[41]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[42]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[43]  K Aihara,et al.  Two stable steady states in the Hodgkin-Huxley axons. , 1983, Biophysical journal.

[44]  Kunihiko Kaneko,et al.  Complex Systems: Chaos and Beyond , 2001 .

[45]  H. Abarbanel,et al.  The role of chaos in neural systems , 1998, Neuroscience.

[46]  K. Aihara,et al.  Stability and bifurcation analysis of differential-difference-algebraic equations , 2001 .

[47]  J. Nagumo,et al.  On a response characteristic of a mathematical neuron model , 1972, Kybernetik.

[48]  G. Matsumoto,et al.  Periodic and Nonperiodic Responses of Membrane Potentials in Squid Giant Axons during Sinusoidal Current Stimulation , 1984 .

[49]  K. Aihara,et al.  Chaos and asymptotical stability in discrete-time neural networks , 1997, chao-dyn/9701020.

[50]  Kazuyuki Aihara,et al.  A dynamic neural network with temporal coding and functional connectivity , 1998, Biological Cybernetics.

[51]  Kazuyuki Aihara,et al.  A current-mode circuit of a chaotic neuron model , 1992, [1992] Proceedings of the 35th Midwest Symposium on Circuits and Systems.

[52]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[53]  Christopher G. Langton,et al.  Computation at the edge of chaos: Phase transitions and emergent computation , 1990 .

[54]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[55]  Kazuyuki Aihara,et al.  Strange attractors in chaotic neural networks , 2000 .

[56]  Otto E. Rössler.  An introduction to chaos , 1995, Int. J. Intell. Syst..

[57]  F Bezanilla,et al.  Nerve membrane excitation without threshold. , 1970, Proceedings of the National Academy of Sciences of the United States of America.

[58]  K. Aihara,et al.  Time series analysis and prediction on complex dynamical behavior observed in a blast furnace , 2000 .

[59]  Kazuyuki Aihara,et al.  Forecasting Daily Peak Load by a Deterministic Prediction Method with the Gram-Schmidt Orthonormalization , 1995 .

[60]  Kazuyuki Aihara,et al.  Global searching ability of chaotic neural networks , 1999 .

[61]  John G. Harris,et al.  Design and implementation of a biologically realistic olfactory cortex in analog VLSI , 2001, Proc. IEEE.

[62]  Walter J. Freeman,et al.  Neurodynamics: An Exploration in Mesoscopic Brain Dynamics , 2000, Perspectives in Neural Computing.

[63]  Kazuyuki Aihara,et al.  Solving the binding problem of the brain with bi-directional functional connectivity , 2001, Neural Networks.

[64]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[65]  Kazuyuki Aihara,et al.  Nonlinear Neurodynamics and Combinatorial Optimization in Chaotic Neural Networks , 1997, J. Intell. Fuzzy Syst..

[66]  Teresa Ree Chay,et al.  BURSTING, SPIKING, CHAOS, FRACTALS, AND UNIVERSALITY IN BIOLOGICAL RHYTHMS , 1995 .

[67]  K. Aihara,et al.  Structures of attractors in periodically forced neural oscillators , 1986 .

[68]  K. Aihara,et al.  Chaos and phase locking in normal squid axons , 1987 .

[69]  E. Caianiello.  Outline of a theory of thought-processes and thinking machines. , 1961, Journal of theoretical biology.

[70]  K. Kaneko.  Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements , 1990 .

[71]  Y. Horio,et al.  Switched-capacitor multi-internal-state chaotic neuron circuit with unipolar and bipolar output functions , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[72]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[73]  Kazuyuki Aihara,et al.  Chaos in axons , 1998 .

[74]  B. V. D. Pol,et al.  Frequency Demultiplication , 1927, Nature.

[75]  Kaoru Nakano,et al.  Associatron-A Model of Associative Memory , 1972, IEEE Trans. Syst. Man Cybern..

[76]  J. Segundo,et al.  The spike trains of inhibited pacemaker neurons seen through the magnifying glass of nonlinear analyses. , 1998, Neuroscience.

[77]  Forecasting daily peak load by a deterministic prediction method employing Gram-Schmidt orthonormalization , 1996 .

[78]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[79]  Kazuyuki Aihara,et al.  Optimization using chaotic neural network and its application to lighting design , 2002 .

[80]  Manuel Delgado-Restituto,et al.  Switched-current chaotic neurons , 1994 .

[81]  M. Abeles.  Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[82]  Ángel Rodríguez-Vázquez,et al.  Generation of Chaotic Signals Using Current-Mode Techniques , 1994, J. Intell. Fuzzy Syst..

[83]  Walter J. Freeman,et al.  TUTORIAL ON NEUROBIOLOGY: FROM SINGLE NEURONS TO BRAIN CHAOS , 1992 .

[84]  I. Tsuda.  Chaotic itinerancy as a dynamical basis of hermeneutics in brain and mind , 1991 .

[85]  Yoshihiko Horio,et al.  Experimental Observations of 2- and 3-Neuron Chaotic Neural Networks Using Switched-Capacitor Chaotic Neuron IC Chip , 1995 .

[86]  M. Elowitz,et al.  A synthetic oscillatory network of transcriptional regulators , 2000, Nature.

[87]  Kazuyuki Aihara,et al.  Global bifurcation structure of chaotic neural networks and its application to traveling salesman problems , 1995, Neural Networks.

[88]  K Aihara,et al.  Periodic and non-periodic responses of a periodically forced Hodgkin-Huxley oscillator. , 1984, Journal of theoretical biology.

[89]  Kazuyuki Aihara,et al.  Generation, Recognition and Learning of Recurrent signals by Pulse Propagation Networks , 2000, Int. J. Bifurc. Chaos.

[90]  Kazuyuki Aihara,et al.  Deterministic prediction and chaos in squid axon response , 1992 .

[91]  K. Aihara,et al.  Surrogate analysis for detecting nonlinear dynamics in normal vowels. , 2001, The Journal of the Acoustical Society of America.

[92]  Kazuyuki Aihara,et al.  Associative Dynamics in a Chaotic Neural Network , 1997, Neural Networks.

[93]  M. Conrad,et al.  1. What is the use of chaos , 1986 .

[94]  Leon Glass,et al.  Nonlinear Dynamics and Symbolic Dynamics of Neural Networks , 1992, Neural Computation.

[95]  Here be no dragons , 2001, Nature.

[96]  K Aihara,et al.  Fractal encoding in a chaotic neural network. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[97]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[98]  Yoshisuke Ueda,et al.  The chaos avant-garde : memories of the early days of chaos theory , 2001 .

[99]  K. Aihara,et al.  Hierarchical structure among invariant subspaces of chaotic neural networks , 2001 .

[100]  Kazuyuki Aihara,et al.  Chaos in Neural Networks Composed of Coincidence Detector Neurons , 1997, Neural Networks.

[101]  J. E. Skinner,et al.  Chaos and physiology: deterministic chaos in excitable cell assemblies. , 1994, Physiological reviews.

[102]  Hatsuo Hayashi,et al.  Chaotic behavior in the Onchidium giant neuron under sinusoidal stimulation , 1982 .

[103]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[104]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[105]  I. Tsuda.  Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. , 2001, The Behavioral and brain sciences.