Michelson interferometric methods for full optical complex convolution

Dynamic real-time optical processing has significant potential for accelerating specific tensor algebra. Here we present the first demonstration of simultaneous amplitude and phase modulation of an optical two-dimension signal in the Fourier plane of a thin lens. Two spatial light modulators (SLMs) arranged in a Michelson interferometer modulate the amplitude and the phase while being simultaneously in the focal plane of two Fourier lenses. The lenses frame an interferometer in a 4f-system enabling full modulation in the Fourier domain of a telescope. Main sources of phase noise and losses are discussed such as native to SLMs non-linear inter-pixel crosstalk, variability in modulation efficiency as a function of projected mask parameters, and Fresnel’s optics limitations. Such a system is of extreme utility in rapidly progressing fields of optical computing, hardware acceleration, encryption, and machine learning, where neglecting phase modulation can lead to impractical bit-error rates.

[1]  V. Sorger,et al.  Optical and Electrical Memories for Analog Optical Computing , 2023, IEEE Journal of Selected Topics in Quantum Electronics.

[2]  V. Sorger,et al.  PhotoFourier: A Photonic Joint Transform Correlator-Based Neural Network Accelerator , 2022, 2023 IEEE International Symposium on High-Performance Computer Architecture (HPCA).

[3]  V. Sorger,et al.  Bistable All‐Optical Devices Based on Nonlinear Epsilon‐Near‐Zero (ENZ) Materials , 2022, Laser & Photonics Reviews.

[4]  V. Sorger,et al.  Reducing Latency in Sensing for Optical Convolutional Neural Network , 2022, 2022 IEEE Photonics Conference (IPC).

[5]  V. Sorger,et al.  High-density Integrated Photonic Tensor Processing Unit with a Matrix Multiply Compile , 2022, 2022 IEEE Photonics Conference (IPC).

[6]  Bicky A. Marquez,et al.  Multi-Level Encoding and Decoding in a Scalable Photonic Tensor Processor With a Photonic General Matrix Multiply (GeMM) Compiler , 2022, IEEE Journal of Selected Topics in Quantum Electronics.

[7]  V. Sorger,et al.  High-speed secure optical hashing for transformational computing (Conference Presentation) , 2022, Optics and Photonics for Information Processing XVI.

[8]  V. Sorger,et al.  High-performance opto-electronics with emerging materials , 2022, NanoScience + Engineering.

[9]  V. Sorger,et al.  High‐Throughput Multichannel Parallelized Diffraction Convolutional Neural Network Accelerator , 2022, Laser & Photonics Reviews.

[10]  Mario Miscuglio,et al.  Batch processing and data streaming Fourier-based convolutional neural network accelerator , 2022, NanoScience + Engineering.

[11]  V. Sorger,et al.  Reconfigurable application-specific photonic integrated circuit for solving partial differential equations , 2022, Nanophotonics.

[12]  V. Sorger,et al.  Self-powered broadband photodetector based on MoS2/Sb2Te3 heterojunctions: a promising approach for highly sensitive detection , 2022, Nanophotonics.

[13]  Joel K. W. Yang,et al.  Programmable chalcogenide-based all-optical deep neural networks , 2022, Nanophotonics.

[14]  Xingzhao Liu,et al.  Training optronic convolutional neural networks on an optical system through backpropagation algorithms. , 2022, Optics express.

[15]  V. Sorger,et al.  Waveguide Integrated MoTe2 Photodetector with High speed and energy efficient , 2022, 2022 Conference on Lasers and Electro-Optics (CLEO).

[16]  V. Sorger,et al.  4-bit Ultra Low-loss Cascaded Nonvolatile Photonic Memories Using Broadband Transparent Phase change materials , 2022, 2022 Conference on Lasers and Electro-Optics (CLEO).

[17]  V. Sorger,et al.  Electrical programmable multilevel nonvolatile photonic random-access memory , 2022, Light, science & applications.

[18]  Songde Liu,et al.  Ultracompact meta-imagers for arbitrary all-optical convolution , 2022, Light, science & applications.

[19]  A. Babakhani,et al.  PIC-based joint transform correlator CNN , 2022, AI and Optical Data Sciences III.

[20]  V. Sorger,et al.  20Gbps high-gain BW-product TMD slot-detector on PIC , 2022, 2D Photonic Materials and Devices V.

[21]  V. Sorger,et al.  Photonic Tensor Core with Photonic Compute-in-Memory , 2022, 2022 Optical Fiber Communications Conference and Exhibition (OFC).

[22]  Yichen Shen,et al.  Photonic matrix multiplication lights up photonic accelerator and beyond , 2022, Light: Science & Applications.

[23]  Volker J. Sorger,et al.  Emerging Devices and Packaging Strategies for Electronic-Photonic AI Accelerators , 2021, ArXiv.

[24]  V. Sorger,et al.  100 GHz micrometer-compact broadband monolithic ITO Mach–Zehnder interferometer modulator enabling 3500 times higher packing density , 2021, 2112.10926.

[25]  Joshua Robertson,et al.  Ultrafast neuromorphic photonic image processing with a VCSEL neuron , 2021, Scientific Reports.

[26]  V. Sorger,et al.  Self-driven highly responsive PN junction InSe heterostructure near-infrared light detector , 2021, 2D Photonic Materials and Devices V.

[27]  P. Prucnal,et al.  Silicon microring synapses enable photonic deep learning beyond 9-bit precision , 2021, Optica.

[28]  V. Sorger,et al.  Training on System for Opto-Electrical Neural Network , 2022, Imaging and Applied Optics Congress 2022 (3D, AOA, COSI, ISA, pcAOP).

[29]  V. Sorger,et al.  Design and Testing of Integrated Photonic Chip for Convolution Neural Network , 2022, Imaging and Applied Optics Congress 2022 (3D, AOA, COSI, ISA, pcAOP).

[30]  V. Sorger,et al.  Electrical Programmable Low-loss high cyclable Nonvolatile Photonic Random-Access Memory , 2022 .

[31]  V. Sorger,et al.  Electrical Pulse Driven Multi-Level Nonvolatile Photonic Memories Using Broadband Transparent Phase Change Materials , 2022 .

[32]  Joshua Robertson,et al.  Photonic neuromorphic computing using vertical cavity semiconductor lasers , 2021, ArXiv.

[33]  V. Sorger,et al.  An ITO - Graphene heterojunction integrated absorption modulator on Si-photonics for neuromorphic nonlinear activation , 2021, APL Photonics.

[34]  D. Brunner,et al.  Two-color optically addressed spatial light modulator as a generic spatiotemporal system. , 2021, Chaos.

[35]  V. Sorger,et al.  Compact Plasmonic Enhanced MoTe2 Photodetector based on Engineering Gain-Bandwidth-Product Scaling Laws , 2021, 2021 26th Microoptics Conference (MOC).

[36]  V. Sorger,et al.  1fJ/bit Coupling-based ITO Monolithic Modulator in Integrated Photonics , 2021, 2021 26th Microoptics Conference (MOC).

[37]  Ahmed B. Ayoub,et al.  High speed, complex wavefront shaping using the digital micro-mirror device , 2021, Scientific Reports.

[38]  V. Sorger,et al.  Highly Accurate, Reliable and Non-Contaminating Two-Dimensional Material Transfer System , 2021, 2021 26th Microoptics Conference (MOC).

[39]  V. Sorger,et al.  Strain-Induced Spatially Resolved Charge Transport in 2H-MoTe2 , 2021, ACS Applied Electronic Materials.

[40]  T. Itoh,et al.  Approximate analog computing with metatronic circuits , 2021, Communications Physics.

[41]  Jianhong Wu,et al.  Holographic near-eye display based on complex amplitude modulation with band-limited zone plates. , 2021, Optics express.

[42]  V. Sorger,et al.  Effect of Strain in WS2 Monolayer Integrated Excitonic Photodetector , 2021, 2021 Conference on Lasers and Electro-Optics (CLEO).

[43]  V. Sorger,et al.  Performance Analysis of Integrated Electro-Optic Phase Modulators Based on Emerging Materials , 2021, IEEE Journal of Selected Topics in Quantum Electronics.

[44]  S. Mitatha,et al.  Optical Hash Function for High Speed and High Security Algorithm using Ring Resonator System , 2021, 2021 7th International Conference on Engineering, Applied Sciences and Technology (ICEAST).

[45]  Ray T. Chen,et al.  Towards lab-on-chip ultrasensitive ethanol detection using photonic crystal waveguide operating in the mid-infrared , 2021, Nanophotonics.

[46]  Gordon Wetzstein,et al.  High-quality holographic displays using double SLMs and camera-in-the-loop optimization , 2021, AR, VR, MR.

[47]  V. Sorger,et al.  Symmetry perception with spiking neural networks , 2021, Scientific Reports.

[48]  W. Matusik,et al.  Towards real-time photorealistic 3D holography with deep neural networks , 2021, Nature.

[49]  D. Faccio,et al.  Polarization entanglement-enabled quantum holography , 2021, Nature Physics.

[50]  K. Kreutz-Delgado,et al.  A Competitive Edge: Can FPGAs Beat GPUs at DCNN Inference Acceleration in Resource-Limited Edge Computing Applications? , 2021, ArXiv.

[51]  G. Wetzstein,et al.  Optimizing image quality for holographic near-eye displays with Michelson Holography , 2021, Optica.

[52]  Aydogan Ozcan,et al.  Ensemble learning of diffractive optical networks , 2020, Light: Science & Applications.

[53]  Ray T. Chen,et al.  Heterogeneously integrated ITO plasmonic Mach–Zehnder interferometric modulator on SOI , 2020, Scientific reports.

[54]  A. Babakhani,et al.  Electronic Bottleneck Suppression in Next‐Generation Networks with Integrated Photonic Digital‐to‐Analog Converters , 2019, Advanced Photonics Research.

[55]  V. Sorger,et al.  Complex Exponential Neural Network for Optical System , 2021, Photonics in Switching and Computing 2021.

[56]  Bhavin J. Shastri,et al.  Photonics for artificial intelligence and neuromorphic computing , 2020, Nature Photonics.

[57]  V. Sorger,et al.  GHz-Fast Multiplexed OAM Generation and Detection , 2020 .

[58]  Mario Miscuglio,et al.  Electro-Optical Hybrid Fourier Neural Network with Amplitude-Only Modulation , 2020 .

[59]  V. Sorger,et al.  Efficient MoTe2 Slot-enhanced Photodetector based on Engineering Gain-Bandwidth-Product Scaling Laws , 2020 .

[60]  V. Sorger,et al.  Massively parallel amplitude-only Fourier neural network , 2020, AI and Optical Data Sciences II.

[61]  Ray T. Chen,et al.  Broadband Sub-λ GHz ITO Plasmonic Mach-Zehnder Modulator in Silicon Photonics , 2020 .

[62]  Tarek El-Ghazawi,et al.  Analog Computing with Metatronic Circuits , 2020, ArXiv.

[63]  Tarek El-Ghazawi,et al.  A Design Methodology for Post-Moore’s Law Accelerators: The Case of a Photonic Neuromorphic Processor , 2020, 2020 IEEE 31st International Conference on Application-specific Systems, Architectures and Processors (ASAP).

[64]  V. Sorger,et al.  2D Material Based Electro-Absorption Modulator in Si Photonics , 2020, 2020 Conference on Lasers and Electro-Optics (CLEO).

[65]  V. Sorger,et al.  WS2 Monolayer Integrated Photodetector , 2020, 2020 Conference on Lasers and Electro-Optics (CLEO).

[66]  Mario Miscuglio,et al.  GSST-Based Photonic Memory Multilevel Perceptron , 2020, 2020 Conference on Lasers and Electro-Optics (CLEO).

[67]  Puneet Gupta,et al.  Million-Channel Parallelism Fourier-Optic Convolutional Filter and Neural Network Processor , 2020, 2020 Conference on Lasers and Electro-Optics (CLEO).

[68]  S. Min,et al.  Michelson-interferometric-configuration-based incoherent digital holography with a geometric phase shifter. , 2020, Applied optics.

[69]  S. Solares,et al.  Strain-engineered high-responsivity MoTe2 photodetector for silicon photonic integrated circuits , 2019, Nature Photonics.

[70]  Yifei Zhang,et al.  Intelligent edge processing with photonic multilevel memory , 2020 .

[71]  Dawei Zhang,et al.  Optical image compression and encryption transmission-based ondeep learning and ghost imaging , 2019, Applied Physics B.

[72]  V. Sorger,et al.  Graphene/Al2O3/Graphene heterojunction for Light emitting tunneling diode , 2019, Frontiers in Optics + Laser Science APS/DLS.

[73]  Antonio J. Peña,et al.  Performance Evaluation of cuDNN Convolution Algorithms on NVIDIA Volta GPUs , 2019, IEEE Access.

[74]  Shuangchun Wen,et al.  Optical edge detection based on high-efficiency dielectric metasurface , 2019, Proceedings of the National Academy of Sciences.

[75]  Mario Miscuglio,et al.  All-optical nonlinear activation function for photonic neural networks [Invited] , 2018, Optical Materials Express.

[76]  Yuanyuan Zhou,et al.  Multiple-image encryption based on double random phase encoding and compressive sensing by using a measurement array preprocessed with orthogonal-basis matrices , 2018, Optics & Laser Technology.

[77]  Yi Luo,et al.  All-optical machine learning using diffractive deep neural networks , 2018, Science.

[78]  John T. Daly,et al.  Multiplication with Fourier Optics Simulating 16-Bit Modular Multiplication , 2018, 2018 IEEE International Conference on Rebooting Computing (ICRC).

[79]  T. Poon,et al.  Optical cryptography with biometrics for multi-depth objects , 2017, Scientific Reports.

[80]  P. Prucnal,et al.  Neuromorphic photonic networks using silicon photonic weight banks , 2017, Scientific Reports.

[81]  H. Howie Huang,et al.  Performance Analysis of GPU-Based Convolutional Neural Networks , 2016, 2016 45th International Conference on Parallel Processing (ICPP).

[82]  Sarah Rothstein,et al.  Diffraction Fourier Optics And Imaging , 2016 .

[83]  Peter Schelkens,et al.  Compression of digital holographic data: an overview , 2015, SPIE Optical Engineering + Applications.

[84]  Andrew Forbes,et al.  Controlling the evolution of nondiffracting speckle by complex amplitude modulation on a phase-only spatial light modulator , 2012 .

[85]  Li-Hua Gong,et al.  Novel optical image encryption scheme based on fractional Mellin transform , 2011 .

[86]  Ran Tao,et al.  Image encryption based on the multiple-parameter discrete fractional Fourier transform and chaos function , 2010 .

[87]  Aloka Sinha,et al.  Chaos-based secure communication system using logistic map , 2010 .

[88]  Ayman Alfalou,et al.  Optical image compression and encryption methods , 2009 .

[89]  Weimin Jin,et al.  Optical image encryption based on multichannel fractional Fourier transform and double random phase encoding technique , 2007 .

[90]  Ichirou Yamaguchi,et al.  Effects of quantization in phase-shifting digital holography. , 2005, Applied optics.

[91]  Jingjuan Zhang,et al.  Double random-phase encoding in the Fresnel domain. , 2004, Optics letters.

[92]  G. Situ,et al.  A cascaded iterative Fourier transform algorithm for optical security applications , 2003, physics/0309062.

[93]  Bahram Javidi,et al.  Efficient compression of fresnel fields for Internet transmission of three-dimensional images. , 2003, Applied optics.

[94]  John T. Sheridan,et al.  Optical image encryption by random shifting in fractional Fourier domains. , 2003, Optics letters.

[95]  Bahram Javidi,et al.  Compression of digital holograms for three-dimensional object reconstruction and recognition. , 2002, Applied optics.

[96]  D. Brady,et al.  Adaptive optical networks using photorefractive crystals. , 1988, Applied optics.

[97]  J. Goodman.  Introduction to Fourier optics , 1969 .