Experimental study of entropy generation and synchronization in networks of coupled dynamical systems

Title of dissertation: EXPERIMENTAL STUDY OF ENTROPY GENERATION AND SYNCHRONIZATION IN NETWORKS OF COUPLED DYNAMICAL SYSTEMS Aaron Morgan Hagerstrom Doctor of Philosophy, 2015 Dissertation directed by: Professor Rajarshi Roy Department of Physics This thesis describes work in two areas: unpredictability in a system with both single photon detection and chaos, and synchronization in networks of coupled systems. The unpredictability of physical systems can depend on the scale at which they are observed. For example, single photons incident on a detector arrive at random times, but slow intensity variations can be observed by counting many photons over large time windows. We describe an experiment in which a weak optical signal is modulated by feedback from a single-photon detector. We demonstrate that at low photon rates, the photon arrivals are described by Poisson noise, while at high photon rates, the intensity of the light shows a deterministic chaotic modulation. Furthermore, we show that measurements of the entropy rate can resolve both noise and chaos, and describe the relevance of this observation to random number generation. We also describe an experimental system that allows for the study of large networks of coupled dynamical systems. This system uses a spatial light modulator (SLM) and a camera in a feedback configuration, and has an optical nonlinearity due to the relationship between a spatially-dependent phase shift applied by the modulator, and the intensity measured by the camera. This system is a powerful platform for studying synchronization in large networks of coupled systems, because it can iterate many (∼1000) maps in parallel, and can be configured with any desired coupling matrix. We use this system to study cluster synchronization. It is often observed that networks synchronize in clusters. We show that the clusters that form can be predicted based on the symmetries of the network, and their stability can be analyzed. This analysis is supported by experimental measurements. The SLM feedback system can also exhibit chimera states. These states were first seen in models of large populations of coupled phase oscillators. Their defining feature is the coexistence of large populations of synchronized and unsynchronized oscillators in spite of symmetrical coupling configurations and homogeneous oscillators. Our SLM feedback system provided one of the first two experimental examples of chimera states. We observed chimeras in coupled map lattices. These states evolve in discrete time, and in this context, “coherence” and “incoherence” refer to smooth and discontinuous regions of a spatial pattern. EXPERIMENTAL STUDY OF ENTROPY GENERATION AND SYNCHRONIZATION IN NETWORKS OF COUPLED DYNAMICAL SYSTEMS by Aaron Morgan Hagerstrom Dissertation submitted to the Faculty of the Graduate School of the University of Maryland, College Park in partial fulfillment of the requirements for the degree of Doctor of Philosophy 2015 Advisory Committee: Professor Rajarshi Roy, Chair/Advisor Professor Thomas E. Murphy, Co-Advisor Dr. Louis M. Pecora Professor Christopher Jarzynski Professor Daniel Lathrop Professor Edward Ott c © Copyright by Aaron Morgan Hagerstrom 2015

[1]  Caputo,et al.  Metric entropy: An experimental means for characterizing and quantifying chaos. , 1987, Physical review. A, General physics.

[2]  Balth. van der Pol,et al.  VII. Forced oscillations in a circuit with non-linear resistance. (Reception with reactive triode) , 1927 .

[3]  Per Martin-Löf,et al.  The Definition of Random Sequences , 1966, Inf. Control..

[4]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[5]  H Thienpont,et al.  Physical random bit generation from chaotic solitary laser diode. , 2014, Optics express.

[6]  P. Hövel,et al.  Loss of coherence in dynamical networks: spatial chaos and chimera states. , 2011, Physical review letters.

[7]  Adilson E. Motter,et al.  Nonlinear dynamics: Spontaneous synchrony breaking , 2010, 1003.2465.

[8]  S. Boccaletti,et al.  Synchronization of chaotic systems , 2001 .

[9]  W. Kinzel,et al.  Synchronization of unidirectional time delay chaotic networks and the greatest common divisor , 2010, 1012.0990.

[10]  J. Yorke,et al.  Period Three Implies Chaos , 1975 .

[11]  D. Ruelle,et al.  Ergodic theory of chaos and strange attractors , 1985 .

[12]  Rajarshi Roy,et al.  Using synchronization for prediction of high-dimensional chaotic dynamics. , 2008, Physical review letters.

[13]  Laurent Larger,et al.  Routes to chaos and multiple time scale dynamics in broadband bandpass nonlinear delay electro-optic oscillators. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Caitlin R. S. Williams,et al.  Fast physical random number generator using amplified spontaneous emission. , 2010, Optics express.

[15]  Mark J Panaggio,et al.  Chimera states on a flat torus. , 2012, Physical review letters.

[16]  S. M. Ulam,et al.  On Combination of Stochastic and Deterministic Processes , 1947 .

[17]  Carlo R Laing,et al.  Chimeras in networks of planar oscillators. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  E. Ott,et al.  Network synchronization of groups. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Francesco Sorrentino,et al.  Synchronization of dynamical hypernetworks: dimensionality reduction through simultaneous block-diagonalization of matrices. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  M. Golubitsky,et al.  The Symmetry Perspective: From Equilibrium to Chaos in Phase Space and Physical Space , 2002 .

[21]  James Theiler,et al.  Generalized redundancies for time series analysis , 1995 .

[22]  Kenichi Arai,et al.  Noise amplification by chaotic dynamics in a delayed feedback laser system and its application to nondeterministic random bit generation. , 2012, Chaos.

[23]  R. W. Gammon,et al.  Experimental evidence for microscopic chaos , 1998, Nature.

[24]  E. A. Martens.  Chimeras in a network of three oscillator populations with varying network topology. , 2010, Chaos.

[25]  I Kanter,et al.  Ultrahigh-speed random number generation based on a chaotic semiconductor laser. , 2009, Physical review letters.

[26]  H. Weinfurter,et al.  A fast and compact quantum random number generator , 1999, quant-ph/9912118.

[27]  Laurent Larger,et al.  Virtual chimera states for delayed-feedback systems. , 2013, Physical review letters.

[28]  T. Carroll,et al.  MASTER STABILITY FUNCTIONS FOR SYNCHRONIZED COUPLED SYSTEMS , 1999 .

[29]  Philipp Hövel,et al.  Transition from spatial coherence to incoherence in coupled chaotic systems. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  A note on Verhulst's logistic equation and related logistic maps , 2009, 0910.1560.

[31]  L. Mandel,et al.  Optical Coherence and Quantum Optics , 1995 .

[32]  Jun Muramatsu,et al.  Theory of fast nondeterministic physical random-bit generation with chaotic lasers. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  I. Kanter,et al.  An optical ultrafast random bit generator , 2010 .

[34]  Ingo Fischer,et al.  Fast Random Bit Generation Using a Chaotic Laser: Approaching the Information Theoretic Limit , 2013, IEEE Journal of Quantum Electronics.

[35]  Atsushi Uchida,et al.  Tb/s physical random bit generation with bandwidth-enhanced chaos in three-cascaded semiconductor lasers. , 2015, Optics express.

[36]  Seth A. Myers,et al.  Spontaneous synchrony in power-grid networks , 2013, Nature Physics.

[37]  R. Roy,et al.  Experimental observation of chimeras in coupled-map lattices , 2012, Nature Physics.

[38]  J. D. Farmer,et al.  Chaotic attractors of an infinite-dimensional dynamical system , 1982 .

[39]  S. Strogatz,et al.  Solvable model for chimera states of coupled oscillators. , 2008, Physical review letters.

[40]  A. Sen,et al.  Chimera states: the existence criteria revisited. , 2013, Physical review letters.

[41]  J. Danckaert,et al.  Synchronization properties of network motifs: influence of coupling delay and symmetry. , 2008, Chaos.

[42]  C. Jarzynski.  Diverse phenomena, common themes , 2015, Nature Physics.

[43]  T. Yamazaki,et al.  Performance of Random Number Generators Using Noise-Based Superluminescent Diode and Chaos-Based Semiconductor Lasers , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[44]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[45]  J. Kurths,et al.  Hierarchical synchronization in complex networks with heterogeneous degrees. , 2006, Chaos.

[46]  Yoshiki Kuramoto,et al.  Rotating spiral waves with phase-randomized core in nonlocally coupled oscillators. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Y. Kuramoto,et al.  Coexistence of Coherence and Incoherence in Nonlocally Coupled Phase Oscillators , 2002, cond-mat/0210694.

[48]  S. Strogatz,et al.  Chimera states for coupled oscillators. , 2004, Physical review letters.

[49]  Raymond Kapral,et al.  Spatial and temporal structure in systems of coupled nonlinear oscillators , 1984 .

[50]  Tohru Ikeguchi,et al.  Estimation of entropy rate in a fast physical random-bit generator using a chaotic semiconductor laser with intrinsic noise. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[51]  Y. Pesin.  CHARACTERISTIC LYAPUNOV EXPONENTS AND SMOOTH ERGODIC THEORY , 1977 .

[52]  D. Andrieux,et al.  Thermodynamic time asymmetry in non-equilibrium fluctuations , 2007, 0710.3646.

[53]  Cohen,et al.  Computing the Kolmogorov entropy from time signals of dissipative and conservative dynamical systems. , 1985, Physical review. A, General physics.

[54]  Carlo R. Laing,et al.  The dynamics of chimera states in heterogeneous Kuramoto networks , 2009 .

[55]  O. Hallatschek,et al.  Chimera states in mechanical oscillator networks , 2013, Proceedings of the National Academy of Sciences.

[56]  Erik A Martens,et al.  Bistable chimera attractors on a triangular network of oscillator populations. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  Johnson,et al.  Three coupled oscillators as a universal probe of synchronization stability in coupled oscillator arrays , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[58]  Rajarshi Roy,et al.  Scalable parallel physical random number generator based on a superluminescent LED. , 2011, Optics letters.

[59]  K. Kaneko.  Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements , 1990 .

[60]  Adonis Bogris,et al.  Chaos-based communications at high bit rates using commercial fibre-optic links , 2006, SPIE/OSA/IEEE Asia Communications and Photonics.

[61]  Adilson E Motter,et al.  Robustness of optimal synchronization in real networks. , 2011, Physical review letters.

[62]  E. Todeva.  Networks , 2007 .

[63]  Bhargava Ravoori,et al.  Synchronization of Chaotic Optoelectronic Oscillators: Adaptive Techniques and the Design of Optimal Networks , 2011 .

[64]  K. Judd.  Networked dynamical systems with linear coupling: synchronisation patterns, coherence and other behaviours. , 2013, Chaos.

[65]  M. Tinkham.  Group Theory and Quantum Mechanics , 1964 .

[66]  J. F. Dynes,et al.  A high speed , postprocessing free , quantum random number generator , 2008 .

[67]  Erik A Martens,et al.  Solvable model of spiral wave chimeras. , 2009, Physical review letters.

[68]  Laurent Larger,et al.  Laser chimeras as a paradigm for multistable patterns in complex systems , 2014, Nature Communications.

[69]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[70]  Benny Pinkas,et al.  Analysis of the Linux random number generator , 2006, 2006 IEEE Symposium on Security and Privacy (S&P'06).

[71]  E. Ott,et al.  Low dimensional behavior of large systems of globally coupled oscillators. , 2008, Chaos.

[72]  A. Vulpiani,et al.  Predictability: a way to characterize complexity , 2001, nlin/0101029.

[73]  James Theiler,et al.  Estimating fractal dimension , 1990 .

[74]  A. Uchida,et al.  Fast physical random bit generation with chaotic semiconductor lasers , 2008 .

[75]  M. Wahl,et al.  An ultrafast quantum random number generator with provably bounded output bias based on photon arrival time measurements , 2011 .

[76]  Ulrich Parlitz,et al.  Comparison of Different Methods for Computing Lyapunov Exponents , 1990 .

[77]  J. Sethna.  Statistical Mechanics: Entropy, Order Parameters, and Complexity , 2021 .

[78]  Joos Vandewalle,et al.  Cluster synchronization in oscillatory networks. , 2008, Chaos.

[79]  Katharina Krischer,et al.  Coexistence of synchrony and incoherence in oscillatory media under nonlinear global coupling. , 2013, Chaos.

[80]  K. Kaneko.  Overview of coupled map lattices. , 1992, Chaos.

[81]  David P Rosin,et al.  Ultrafast physical generation of random numbers using hybrid Boolean networks. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[82]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[83]  Francesco Sorrentino,et al.  Cluster synchronization and isolated desynchronization in complex networks with symmetries , 2013, Nature Communications.

[84]  Elaine B. Barker,et al.  A Statistical Test Suite for Random and Pseudorandom Number Generators for Cryptographic Applications , 2000 .

[85]  M. Golubitsky,et al.  Singularities and groups in bifurcation theory , 1985 .

[86]  Eckehard Schöll,et al.  Control of synchronization patterns in neural-like Boolean networks. , 2012, Physical review letters.

[87]  P Gaspard,et al.  Entropy production and time asymmetry in nonequilibrium fluctuations. , 2007, Physical review letters.

[88]  Ingo Fischer,et al.  Dynamics of a semiconductor laser with polarization-rotated feedback and its utilization for random bit generation. , 2011, Optics letters.

[89]  P. Gaspard,et al.  Noise, chaos, and (ε,τ)-entropy per unit time , 1993 .

[90]  金子 邦彦.  Theory and applications of coupled map lattices , 1993 .

[91]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[92]  C. Laing.  Chimeras in networks with purely local coupling. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[93]  Juan M R Parrondo,et al.  Estimating dissipation from single stationary trajectories. , 2010, Physical review letters.

[94]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[95]  R. Goodman,et al.  Representations and Invariants of the Classical Groups , 1998 .

[96]  Caitlin R. S. Williams,et al.  Synchronization states and multistability in a ring of periodic oscillators: experimentally variable coupling delays. , 2013, Chaos.

[97]  Ian Stewart,et al.  Coupled cells with internal symmetry: I. Wreath products , 1996 .

[98]  Caitlin R. S. Williams,et al.  OPTOELECTRONIC EXPERIMENTS ON RANDOM BIT GENERATORS AND COUPLED DYNAMICAL SYSTEMS , 2013 .

[99]  Robert M. May,et al.  Stability and Complexity in Model Ecosystems , 2019, IEEE Transactions on Systems, Man, and Cybernetics.

[100]  K. Kaneko.  Period-Doubling of Kink-Antikink Patterns, Quasiperiodicity in Antiferro-Like Structures and Spatial Intermittency in Coupled Logistic Lattice*) -- Towards a Prelude of a "Field Theory of Chaos"-- , 1984 .

[101]  K. Showalter,et al.  Chimera and phase-cluster states in populations of coupled chemical oscillators , 2012, Nature Physics.

[102]  Adam B. Cohen,et al.  Synchronization and prediction of chaotic dynamics on networks of optoelectronic oscillators , 2011 .

[103]  William Stein,et al.  SAGE: Software for Algebra and Geometry Experimentation , 2006 .

[104]  E. Lutz,et al.  Experimental verification of Landauer’s principle linking information and thermodynamics , 2012, Nature.

[105]  James W. Anderson,et al.  On Automorphism Groups of Networks , 2007, 0705.3215.

[106]  Daniel J. Gauthier,et al.  Precise Monte Carlo simulation of single-photon detectors , 2013, Defense, Security, and Sensing.

[107]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[108]  L. Appeltant,et al.  Information processing using a single dynamical node as complex system , 2011, Nature communications.

[109]  Eckehard Schöll,et al.  Cluster and group synchronization in delay-coupled networks. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[110]  R. Dong,et al.  A generator for unique quantum random numbers based on vacuum states , 2010 .

[111]  Carlo R. Laing,et al.  Fronts and bumps in spatially extended Kuramoto networks , 2011 .

[112]  Laurent Larger,et al.  Complexity in electro-optic delay dynamics: modelling, design and applications , 2013, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[113]  J. E. Littlewood,et al.  On Non‐Linear Differential Equations of the Second Order: I. the Equation y¨ − k(1‐y2)y˙ + y = bλk cos(λl + α), k Large , 1945 .

[114]  H. Touchette.  The large deviation approach to statistical mechanics , 2008, 0804.0327.

[115]  Edward Ott,et al.  Complex dynamics and synchronization of delayed-feedback nonlinear oscillators , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[116]  F. Vallentin.  Symmetry in semidefinite programs , 2007, 0706.4233.

[117]  Rajarshi Roy,et al.  Harvesting entropy and quantifying the transition from noise to chaos in a photon-counting feedback loop , 2015, Proceedings of the National Academy of Sciences.

[118]  B. Sagan.  The Symmetric Group , 2001 .

[119]  Fatihcan M Atay,et al.  Clustered chimera states in delay-coupled oscillator systems. , 2008, Physical review letters.

[120]  Eckehard Schöll,et al.  Experimental observations of group synchrony in a system of chaotic optoelectronic oscillators. , 2013, Physical review letters.

[121]  Katharina Krischer,et al.  Clustering as a prerequisite for chimera states in globally coupled systems. , 2014, Physical review letters.

[122]  Liang Huang,et al.  Topological control of synchronous patterns in systems of networked chaotic oscillators , 2013 .

[123]  Rubén J. Sánchez-García,et al.  Spectral characteristics of network redundancy. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[124]  Olbrich,et al.  Chaos or noise: difficulties of a distinction , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.