Electromagnetic wave-based extreme deep learning with nonlinear time-Floquet entanglement

Wave-based analog signal processing holds the promise of extremely fast, on-the-fly, power-efficient data processing, occurring as a wave propagates through an artificially engineered medium. Yet, due to the fundamentally weak non-linearities of traditional wave materials, such analog processors have been so far largely confined to simple linear projections such as image edge detection or matrix multiplications. Complex neuromorphic computing tasks, which inherently require strong non-linearities, have so far remained out-of-reach of wave-based solutions, with a few attempts that implemented non-linearities on the digital front, or used weak and inflexible non-linear sensors, restraining the learning performance. Here, we tackle this issue by demonstrating the relevance of Time-Floquet physics to induce a strong non-linear entanglement between signal inputs at different frequencies, enabling a power-efficient and versatile wave platform for analog extreme deep learning involving a single, uniformly modulated dielectric layer and a scattering medium. We prove the efficiency of the method for extreme learning machines and reservoir computing to solve a range of challenging learning tasks, from forecasting chaotic time series to the simultaneous classification of distinct datasets. Our results open the way for wave-based machine learning with high energy efficiency, speed and scalability.

[1]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[2]  Xingyuan Xu,et al.  Photonic perceptron based on a Kerr microcomb for high-speed, scalable, optical neural networks , 2020, 2020 International Topical Meeting on Microwave Photonics (MWP).

[3]  R. Fleury,et al.  Parallel Analog Computing Based on a 2×2 Multiple-Input Multiple-Output Metasurface Processor With Asymmetric Response , 2021 .

[4]  Qiangfei Xia,et al.  Reservoir Computing Using Diffusive Memristors , 2019, Adv. Intell. Syst..

[5]  S. Fan,et al.  Nonreciprocity in Bianisotropic Systems with Uniform Time Modulation. , 2020, Physical review letters.

[6]  Eduard Alarcón,et al.  Digital Metasurface Based on Graphene: An Application to Beam Steering in Terahertz Plasmonic Antennas , 2019, IEEE Transactions on Nanotechnology.

[7]  Ali Momeni,et al.  Self-biased tri-state power-multiplexed digital metasurface operating at microwave frequencies. , 2020, Optics express.

[8]  T. Hashimoto,et al.  Scalable reservoir computing on coherent linear photonic processor , 2021, Communications Physics.

[9]  P. Rakich,et al.  Strong THz and Infrared Optical Forces on a Suspended Single-Layer Graphene Sheet , 2014, 1406.2246.

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Ali Momeni,et al.  Reciprocal Metasurfaces for On-Axis Reflective Optical Computing , 2021, IEEE Transactions on Antennas and Propagation.

[12]  H. Mosallaei,et al.  Electrically tunable harmonics in time-modulated metasurfaces for wavefront engineering , 2018, New Journal of Physics.

[13]  Andrea Alù,et al.  Magnetic-free non-reciprocity and isolation based on parametrically modulated coupled-resonator loops , 2014, Nature Physics.

[14]  Gordon Wetzstein,et al.  Inference in artificial intelligence with deep optics and photonics , 2020, Nature.

[15]  N. Engheta,et al.  Metamaterials: Physics and Engineering Explorations , 2006 .

[16]  Erez Hasman,et al.  Dielectric gradient metasurface optical elements , 2014, Science.

[17]  G. Lo,et al.  An optical neural chip for implementing complex-valued neural network , 2021, Nature Communications.

[18]  Laurent Larger,et al.  Reinforcement Learning in a large scale photonic Recurrent Neural Network , 2017, Optica.

[19]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[20]  Geert Morthier,et al.  Experimental demonstration of reservoir computing on a silicon photonics chip , 2014, Nature Communications.

[21]  P. Bahr,et al.  Sampling: Theory and Applications , 2020, Applied and Numerical Harmonic Analysis.

[22]  Eduard Alarcón,et al.  Reprogrammable Graphene-based Metasurface Mirror with Adaptive Focal Point for THz Imaging , 2019, Scientific Reports.

[23]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[24]  Iu,et al.  All-optical neural network with nonlinear activation functions: supplementary material , 2019 .

[25]  Ali Momeni,et al.  Generalized Optical Signal Processing Based on Multioperator Metasurfaces Synthesized by Susceptibility Tensors , 2018, Physical Review Applied.

[27]  Huaqiang Wu,et al.  Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing , 2021, Nature Communications.

[28]  Laurent Larger,et al.  Tutorial: Photonic Neural Networks in Delay Systems , 2018, Journal of Applied Physics.

[29]  Giulia Marcucci,et al.  Photonic extreme learning machine by free-space optical propagation , 2021, Photonics Research.

[30]  Ali Momeni,et al.  An Information Theory-Inspired Strategy for Design of Re-programmable Encrypted Graphene-based Coding Metasurfaces at Terahertz Frequencies , 2018, Scientific Reports.

[31]  Nader Engheta,et al.  A single inverse-designed photonic structure that performs parallel computing , 2021, Nature communications.

[32]  Andrea Alù,et al.  Floquet topological insulators for sound , 2015, Nature Communications.

[33]  Jonathan Dong,et al.  Scaling Up Echo-State Networks With Multiple Light Scattering , 2016, 2018 IEEE Statistical Signal Processing Workshop (SSP).

[34]  Seung Hwan Lee,et al.  Temporal data classification and forecasting using a memristor-based reservoir computing system , 2019, Nature Electronics.

[35]  N. Engheta,et al.  Inverse-designed metastructures that solve equations , 2019, Science.

[36]  Romain Fleury,et al.  Topological analog signal processing , 2019, Nature Communications.

[37]  Ali Momeni,et al.  Asymmetric Spatial Power Dividers Using Phase–Amplitude Metasurfaces Driven by Huygens Principle , 2019, ACS Omega.

[38]  J. Feldmann,et al.  All-optical spiking neurosynaptic networks with self-learning capabilities , 2019, Nature.

[39]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[40]  R. Fleury,et al.  Switchable and Simultaneous Spatiotemporal Analog Computing with Computational Graphene-based Multilayers , 2021, Carbon.

[41]  Romain Fleury,et al.  Parametric amplification and bidirectional invisibility in PT-symmetric time-Floquet systems , 2017, 1711.08152.

[42]  Farzad Zangeneh-Nejad,et al.  Analogue computing with metamaterials , 2020, Nature Reviews Materials.

[43]  Shanhui Fan,et al.  Wave physics as an analog recurrent neural network , 2019, Science Advances.

[44]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[45]  H. Mosallaei,et al.  Time-varying metamaterials based on graphene-wrapped microwires: Modeling and potential applications , 2018 .

[46]  Ryan Hamerly,et al.  Large-Scale Optical Neural Networks based on Photoelectric Multiplication , 2018, Physical Review X.

[47]  Seung Hwan Lee,et al.  Reservoir computing using dynamic memristors for temporal information processing , 2017, Nature Communications.

[48]  Jian Xu,et al.  Performing optical logic operations by a diffractive neural network , 2020, Light: Science & Applications.

[49]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[50]  A. Alú,et al.  Space-time gradient metasurfaces , 2015, 1506.00690.

[51]  Yi Luo,et al.  All-optical machine learning using diffractive deep neural networks , 2018, Science.

[52]  W. Porod,et al.  Nanoscale neural network using non-linear spin-wave interference , 2020, Nature Communications.

[53]  Giulia Marcucci,et al.  Theory of neuromorphic computing by waves: machine learning by rogue waves, dispersive shocks, and solitons , 2019, Physical review letters.

[54]  Andrea Alù,et al.  Machine-learning reprogrammable metasurface imager , 2019, Nature Communications.

[55]  Romain Fleury,et al.  Nonreciprocal Gain in Non-Hermitian Time-Floquet Systems. , 2017, Physical review letters.

[56]  Andrea Alù,et al.  Performing Mathematical Operations with Metamaterials , 2014, Science.

[57]  Dirk Englund,et al.  Deep learning with coherent nanophotonic circuits , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[58]  Atef Z. Elsherbeni,et al.  The Finite-Difference Time-Domain Method for Electromagnetics with MATLAB® Simulations , 2015 .

[59]  R. Luebbers,et al.  The Finite Difference Time Domain Method for Electromagnetics , 1993 .

[60]  Ali Momeni,et al.  Parallel integro-differential equation solving via multi-channel reciprocal bianisotropic metasurface augmented by normal susceptibilities , 2019, New Journal of Physics.