Generative adversarial network based on chaotic time series

Generative adversarial networks (GANs) are becoming increasingly important in the artificial construction of natural images and related functionalities, wherein two types of networks called generators and discriminators evolve through adversarial mechanisms. Using deep convolutional neural networks and related techniques, high-resolution and highly realistic scenes, human faces, etc. have been generated. GANs generally require large amounts of genuine training data sets, as well as vast amounts of pseudorandom numbers. In this study, we utilized chaotic time series generated experimentally by semiconductor lasers for the latent variables of a GAN, whereby the inherent nature of chaos could be reflected or transformed into the generated output data. We show that the similarity in proximity, which describes the robustness of the generated images with respect to minute changes in the input latent variables, is enhanced, while the versatility overall is not severely degraded. Furthermore, we demonstrate that the surrogate chaos time series eliminates the signature of the generated images that is originally observed corresponding to the negative autocorrelation inherent in the chaos sequence. We also address the effects of utilizing chaotic time series to retrieve images from the trained generator.

[1]  David A. Wagner,et al.  Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples , 2018, ICML.

[2]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos with Student Solutions Manual , 2016 .

[3]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[4]  Raymond G. Beausoleil,et al.  Large-scale integrated photonics for high-performance interconnects , 2011, IEEE Photonics Conference 2012.

[5]  Hugo Thienpont,et al.  Deterministic polarization chaos from a laser diode , 2012, Nature Photonics.

[6]  I. Kanter,et al.  An optical ultrafast random bit generator , 2010 .

[7]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[8]  R. Soref,et al.  The Past, Present, and Future of Silicon Photonics , 2006, IEEE Journal of Selected Topics in Quantum Electronics.

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Jeff Donahue,et al.  Large Scale GAN Training for High Fidelity Natural Image Synthesis , 2018, ICLR.

[11]  Atsushi Uchida,et al.  Laser dynamical reservoir computing with consistency: an approach of a chaos mask signal. , 2016, Optics express.

[12]  N. C. MacDonald,et al.  Chaos in MEMS, parameter estimation and its potential application , 1998 .

[13]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[14]  Kenta Oono,et al.  Chainer : a Next-Generation Open Source Framework for Deep Learning , 2015 .

[15]  Makoto Naruse,et al.  On-chip photonic decision maker using spontaneous mode switching in a ring laser , 2019, Scientific Reports.

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  内田 淳史 Optical communication with chaotic lasers : applications of nonlinear dynamics and synchronization , 2012 .

[18]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[19]  Cuomo,et al.  Circuit implementation of synchronized chaos with applications to communications. , 1993, Physical review letters.

[20]  Junji Ohtsubo,et al.  Semiconductor Lasers : Stability , Instability and Chaos , 2013 .

[21]  L Pesquera,et al.  Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. , 2012, Optics express.

[22]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[23]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Edward E. Eyler,et al.  Higher-order correlation on polarization beats in Markovian stochastic fields , 2001 .

[25]  A. Uchida,et al.  Fast physical random bit generation with chaotic semiconductor lasers , 2008 .

[26]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[27]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[28]  Timo Aila,et al.  A Style-Based Generator Architecture for Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jonathon Shlens,et al.  Conditional Image Synthesis with Auxiliary Classifier GANs , 2016, ICML.

[30]  Haijun Tang,et al.  Controlling correlations in the Rydberg-dressing six-wave mixing process , 2017 .

[31]  Shakir Mohamed,et al.  Variational Approaches for Auto-Encoding Generative Adversarial Networks , 2017, ArXiv.

[32]  Mikio Hasegawa,et al.  Scalable photonic reinforcement learning by time-division multiplexing of laser chaos , 2018, Scientific Reports.

[33]  Song-Ju Kim,et al.  Ultrafast photonic reinforcement learning based on laser chaos , 2017, Scientific Reports.

[34]  K. Alan Shore,et al.  Physics and applications of laser diode chaos , 2015 .

[35]  Atsushi Uchida,et al.  Optical Communication with Chaotic Lasers: Applications of Nonlinear Dynamics and Synchronization , 1994 .

[36]  Daniel Brunner,et al.  Parallel photonic information processing at gigabyte per second data rates using transient states , 2013, Nature Communications.

[37]  M.J. Hasler,et al.  Electrical circuits with chaotic behavior , 1987, Proceedings of the IEEE.

[38]  Min Xiao,et al.  Controlling the dynamic instability of three-level atoms inside an optical ring cavity , 2004 .