On-chip photonic decision maker using spontaneous mode switching in a ring laser

Efficient and accurate decision making is gaining increased importance with the rapid expansion of information communication technologies including artificial intelligence. Here, we propose and experimentally demonstrate an on-chip, integrated photonic decision maker based on a ring laser. The ring laser exhibits spontaneous switching between clockwise and counter-clockwise oscillatory dynamics; we utilize such nature to solve a multi-armed bandit problem. The spontaneous switching dynamics provides efficient exploration to find the accurate decision. On-line decision making is experimentally demonstrated including autonomous adaptation to an uncertain environment. This study paves the way for directly utilizing the fluctuating physics inherent in ring lasers, or integrated photonics technologies in general, for achieving or accelerating intelligent functionality.

[1]  Song-Ju Kim,et al.  Memory Effect on Adaptive Decision Making with a Chaotic Semiconductor Laser , 2018, Complex..

[2]  Demosthenis Teneketzis,et al.  Multi-Armed Bandit Problems , 2008 .

[3]  Bhavin J. Shastri,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2016, Scientific Reports.

[4]  L. Appeltant,et al.  Information processing using a single dynamical node as complex system , 2011, Nature communications.

[5]  A. N. Tait,et al.  Microring Weight Banks for Neuromorphic Silicon Photonics , 2018, 2018 Conference on Lasers and Electro-Optics (CLEO).

[6]  Atsushi Uchida,et al.  Optical Communication with Chaotic Lasers: Applications of Nonlinear Dynamics and Synchronization , 1994 .

[7]  Yi Luo,et al.  All-optical machine learning using diffractive deep neural networks , 2018, Science.

[8]  Doina Precup,et al.  Algorithms for multi-armed bandit problems , 2014, ArXiv.

[9]  Wassim Jouini,et al.  Multi-armed bandit based policies for cognitive radio's decision making issues , 2009, 2009 3rd International Conference on Signals, Circuits and Systems (SCS).

[10]  H. Vincent Poor,et al.  Cognitive Medium Access: Exploration, Exploitation, and Competition , 2007, IEEE Transactions on Mobile Computing.

[11]  R. Johnsen,et al.  Theory and Experiment , 2010 .

[12]  Jan Danckaert,et al.  Semiconductor ring laser subject to delayed optical feedback: Bifurcations and stability , 2012 .

[13]  Kenichi Arai,et al.  Chaos laser chips with delayed optical feedback using a passive ring waveguide. , 2011, Optics express.

[14]  Atsushi Uchida,et al.  Optical communication with chaotic lasers , 2011 .

[15]  Ferdinand Peper,et al.  Massively parallel computing on an organic molecular layer , 2010, ArXiv.

[16]  P. Prucnal,et al.  NEUROMORPHIC PHOTONICS , 2017 .

[17]  P. Daukantas Optics in Oceanography: Snapshots from the Field , 2018, Optics and Photonics News.

[18]  Mikio Hasegawa,et al.  Scalable photonic reinforcement learning by time-division multiplexing of laser chaos , 2018, Scientific Reports.

[19]  Song-Ju Kim,et al.  Ultrafast photonic reinforcement learning based on laser chaos , 2017, Scientific Reports.

[20]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[21]  Bee-Chung Chen,et al.  Explore/Exploit Schemes for Web Content Optimization , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[22]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[23]  M Alonzo,et al.  All-Optical Reinforcement Learning In Solitonic X-Junctions , 2018, Scientific Reports.

[24]  Marc Sorel,et al.  Operating regimes of GaAs-AlGaAs semiconductor ring lasers: experiment and model , 2003 .

[25]  Jeffrey S. Vetter,et al.  Architectures for the Post-Moore Era , 2017, IEEE Micro.

[26]  Makoto Naruse,et al.  Single Photon in Hierarchical Architecture for Physical Decision Making: Photon Intelligence , 2016 .

[27]  J. Danckaert,et al.  Exploring multistability in semiconductor ring lasers: theory and experiment. , 2009, Physical review letters.

[28]  Nikolay I. Zheludev,et al.  All-Optical Implementation of the Ant Colony Optimization Algorithm , 2016, Scientific Reports.

[29]  Song-Ju Kim,et al.  Single-photon decision maker , 2015, Scientific Reports.

[30]  M. W. Johnson,et al.  Quantum annealing with manufactured spins , 2011, Nature.

[31]  Song-Ju Kim,et al.  Tug-of-war model for the two-bandit problem: Nonlocally-correlated parallel exploration via resource conservation , 2010, Biosyst..

[32]  Marc Sorel,et al.  Unidirectional bistability in semiconductor waveguide ring lasers , 2002 .

[33]  Ken-ichi Kawarabayashi,et al.  A coherent Ising machine for 2000-node optimization problems , 2016, Science.

[34]  M. Smit,et al.  A fast low-power optical memory based on coupled micro-ring lasers , 2004, Nature.

[35]  Ferdinand Peper,et al.  The End of Moore’s Law: Opportunities for Natural Computing? , 2017, New Generation Computing.

[36]  Andrew S. Cassidy,et al.  Convolutional networks for fast, energy-efficient neuromorphic computing , 2016, Proceedings of the National Academy of Sciences.

[37]  M. C. Soriano,et al.  Advances in photonic reservoir computing , 2017 .

[38]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[39]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[40]  A. Uchida,et al.  Random optical pulse generation with bistable semiconductor ring lasers. , 2011, Optics express.

[41]  Keith D. Kastella,et al.  Foundations and Applications of Sensor Management , 2010 .

[42]  Song-Ju Kim,et al.  Efficient decision-making by volume-conserving physical object , 2014, ArXiv.

[43]  Ellen Zhou,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2017, Scientific Reports.

[44]  内田 淳史 Optical communication with chaotic lasers : applications of nonlinear dynamics and synchronization , 2012 .

[45]  J. Danckaert,et al.  Topological insight into the non-arrhenius mode hopping of semiconductor ring lasers. , 2008, Physical review letters.

[46]  Geert Morthier,et al.  An ultra-small, low-power all-optical flip-flop memory on a silicon chip , 2010, 2010 Conference on Optical Fiber Communication (OFC/NFOEC), collocated National Fiber Optic Engineers Conference.

[47]  C. Mirasso,et al.  Bistability and All-Optical Switching in Semiconductor Ring Lasers , 2007, 2007 9th International Conference on Transparent Optical Networks.

[48]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).