Referenceless characterisation of complex media using physics-informed neural networks

In this work, we present a method to characterise the transmission matrices of complex scattering media using a physics-informed, multi-plane neural network (MPNN) without the requirement of a known optical reference field. We use this method to accurately measure the transmission matrix of a commercial multi-mode fiber without the problems of output-phase ambiguity and dark spots, leading to upto 58% improvement in focusing efficiency compared with phase-stepping holography. We demonstrate how our method is significantly more noise-robust than phase-stepping holography and show how it can be generalised to characterise a cascade of transmission matrices, allowing one to control the propagation of light between independent scattering media. This work presents an essential tool for accurate light control through complex media, with applications ranging from classical optical networks, biomedical imaging, to quantum information processing.

[1]  D. Jennings,et al.  Unveiling the non-Abelian statistics of $D(S_3)$ anyons via photonic simulation , 2023, 2304.05286.

[2]  S. Gigan,et al.  Online learning of the transfer matrix of dynamic scattering media: wavefront shaping meets multidimensional time series , 2022, Optica.

[3]  Gerwin Osnabrugge,et al.  Wavefront shaping for forward scattering. , 2022, Optics express.

[4]  J. Bertolotti,et al.  Imaging in complex media , 2022, Nature Physics.

[5]  Yuncai Wang,et al.  Learning to transmit images through optical speckle of a multimode fiber with high fidelity , 2022, Applied Physics Letters.

[6]  M. Tyler,et al.  Simultaneously Sorting Overlapping Quantum States of Light. , 2022, Physical review letters.

[7]  S. Gigan,et al.  Physics-based neural network for non-invasive control of coherent light in scattering media. , 2022, Optics express.

[8]  Natalia Herrera Valencia,et al.  Inverse-Design of High-Dimensional Quantum Optical Circuits in a Complex Medium , 2022, Frontiers in Optics + Laser Science 2023 (FiO, LS).

[9]  Yang Du,et al.  Near perfect focusing through multimode fibres. , 2022, Optics express.

[10]  Yaniv Eliezer,et al.  Harnessing disorder for photonic device applications , 2022, Applied Physics Reviews.

[11]  Yuchi Chen,et al.  Phase-shifting algorithms with known and unknown phase shifts: comparison and hybrid. , 2022, Optics Express.

[12]  L. Leuzzi,et al.  Speckle spatial-correlations accelerate optical transmission matrix retrieval: the smoothed Gerchberg-Saxton single-iteration algorithm , 2021, Photonics Research.

[13]  Mikael Mazur,et al.  Hermite-Gaussian mode multiplexer supporting 1035 modes , 2021, 2021 Optical Fiber Communications Conference and Exhibition (OFC).

[14]  D. Fan,et al.  Diffractive Deep Neural Network for Optical Orbital Angular Momentum Multiplexing and Demultiplexing , 2021, IEEE Journal of Selected Topics in Quantum Electronics.

[15]  Logan G. Wright,et al.  Deep physical neural networks trained with backpropagation , 2021, Nature.

[16]  R. Fickler,et al.  High-Dimensional Two-Photon Interference Effects in Spatial Modes. , 2021, Physical review letters.

[17]  D. Psaltis,et al.  Scalable optical learning operator , 2020, Nature Computational Science.

[18]  Gordon Wetzstein,et al.  Inference in artificial intelligence with deep optics and photonics , 2020, Nature.

[19]  Zhaohui Li,et al.  Generalizing the Gerchberg–Saxton algorithm for retrieving complex optical transmission matrices , 2020, Photonics Research.

[20]  Fabio Crameri,et al.  The misuse of colour in science communication , 2020, Nature Communications.

[21]  Maxime W. Matthès,et al.  Learning and Avoiding Disorder in Multimode Fibers , 2020, 2010.14813.

[22]  Anthony Laing,et al.  Rapid characterisation of linear-optical networks via PhaseLift. , 2020, 2010.00517.

[23]  Shuhui Li,et al.  Compressively sampling the optical transmission matrix of a multimode fibre , 2020, Light: Science & Applications.

[24]  Manoj Kumar Sharma,et al.  3PointTM: Faster Measurement of High-Dimensional Transmission Matrices , 2020, ECCV.

[25]  George S. D. Gordon,et al.  Coherent Imaging Through Multicore Fibres With Applications in Endoscopy , 2019, Journal of Lightwave Technology.

[26]  Will McCutcheon,et al.  Unscrambling entanglement through a complex medium , 2019, Nature Physics.

[27]  R. Fickler,et al.  Near-perfect measuring of full-field transverse-spatial modes of light. , 2019, Optics express.

[28]  Alexander J. Macfaden,et al.  Full-field quantitative phase and polarisation-resolved imaging through an optical fibre bundle , 2019, Optics express.

[29]  Davide Pierangeli,et al.  Programming multi-level quantum gates in disordered computing reservoirs via machine learning , 2019, Optics express.

[30]  Daniele Faccio,et al.  Transmission of natural scene images through a multimode fibre , 2019, Nature Communications.

[31]  M. Hofer,et al.  Manipulating the transmission matrix of scattering media for nonlinear imaging beyond the memory effect. , 2019, Optics letters.

[32]  Julien de Rosny,et al.  Optical complex media as universal reconfigurable linear operators , 2019, Optica.

[33]  Timothy D. Wilkinson,et al.  Characterizing Optical Fiber Transmission Matrices Using Metasurface Reflector Stacks for Lensless Imaging without Distal Access , 2019, Physical Review X.

[34]  Sylvain Gigan,et al.  Programmable linear quantum networks with a multimode fibre , 2019, Nature Photonics.

[35]  D. S. Bradshaw,et al.  Photonics , 2023, 2023 International Conference on Electrical Engineering and Photonics (EExPolytech).

[36]  Timothy D. Wilkinson,et al.  Quantitative phase and polarisation endoscopy applied to detection of early oesophageal tumourigenesis , 2018, 1811.03977.

[37]  Lei Tian,et al.  Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media , 2018, Optica.

[38]  Tomáš Čižmár,et al.  Robustness of Light-Transport Processes to Bending Deformations in Graded-Index Multimode Waveguides. , 2018, Physical review letters.

[39]  Johannes D. Seelig,et al.  Light scattering control in transmission and reflection with neural networks. , 2018, Optics express.

[40]  Navid Borhani,et al.  Learning to see through multimode fibers , 2018, Optica.

[41]  Demetri Psaltis,et al.  Multimode optical fiber transmission with a deep learning network , 2018, Light: Science & Applications.

[42]  Yi Luo,et al.  All-optical machine learning using diffractive deep neural networks , 2018, Science.

[43]  Nicolas K. Fontaine,et al.  Laguerre-Gaussian mode sorter , 2018, Nature Communications.

[44]  Haoshuo Chen,et al.  Design of High Order Mode-Multiplexers using Multiplane Light Conversion , 2017, 2017 European Conference on Optical Communication (ECOC).

[45]  Raj Rao Nadakuditi,et al.  Mode control in a multimode fiber through acquiring its transmission matrix from a reference-less optical system. , 2017, Optics letters.

[46]  S. Gigan,et al.  Light fields in complex media: Mesoscopic scattering meets wave control , 2017, 1702.05395.

[47]  Raj Rao Nadakuditi,et al.  Controlling Light Transmission Through Highly Scattering Media Using Semi-Definite Programming as a Phase Retrieval Computation Method , 2016, Scientific Reports.

[48]  M Jang,et al.  Optical Phase Conjugation with Less Than a Photon per Degree of Freedom. , 2016, Physical review letters.

[49]  Nicolò Spagnolo,et al.  Learning an unknown transformation via a genetic approach , 2016, Scientific Reports.

[50]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[51]  Philip Walther,et al.  On unitary reconstruction of linear optical networks , 2015, 1512.04769.

[52]  Barry C. Sanders,et al.  Accurate and precise characterization of linear optical interferometers , 2015, 1508.00283.

[53]  Tomáš Čižmár,et al.  Seeing through chaos in multimode fibres , 2015, Nature Photonics.

[54]  Wonjun Choi,et al.  Transmission matrix of a scattering medium and its applications in biophotonics. , 2015, Optics express.

[55]  Brian J. Smith,et al.  Two-photon quantum walk in a multimode fiber , 2015, Science Advances.

[56]  YongKeun Park,et al.  Measuring large optical reflection matrices of turbid media , 2015, 1503.01901.

[57]  Florent Krzakala,et al.  Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques. , 2015, Optics express.

[58]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[59]  C. Prada,et al.  Full transmission and reflection of waves propagating through a maze of disorder. , 2014, Physical review letters.

[60]  Jochen Schröder,et al.  110x110 optical mode transfer matrix inversion. , 2014, Optics express.

[61]  Zahid Yaqoob,et al.  Measurement of the time-resolved reflection matrix for enhancing light energy delivery into a scattering medium. , 2013, Physical review letters.

[62]  Hasan Yılmaz,et al.  Optimal control of light propagation through multiple-scattering media in the presence of noise. , 2013, Biomedical optics express.

[63]  B. C. Thomsen,et al.  Degenerate Mode-Group Division Multiplexing , 2012, Journal of Lightwave Technology.

[64]  Moonseok Kim,et al.  Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber. , 2012, Physical review letters.

[65]  Andrew G. White,et al.  Direct characterization of linear-optical networks. , 2012, Optics express.

[66]  Sundeep Rangan,et al.  Compressive Phase Retrieval via Generalized Approximate Message Passing , 2014, IEEE Transactions on Signal Processing.

[67]  J. O'Brien,et al.  Super-stable tomography of any linear optical device , 2012, 1208.2868.

[68]  T. Heinosaari,et al.  Quantum Tomography under Prior Information , 2011, 1109.5478.

[69]  Tomáš Čižmár,et al.  Shaping the light transmission through a multimode optical fibre: complex transformation analysis and applications in biophotonics. , 2011, Optics express.

[70]  S. Popoff,et al.  Controlling light through optical disordered media: transmission matrix approach , 2011, 1107.5285.

[71]  Silvio Bianchi,et al.  Hologram transmission through multi-mode optical fibers. , 2011, Optics express.

[72]  T. G. Euser,et al.  Fiber transport of spatially entangled photons , 2010, OPTO.

[73]  Sylvain Gigan,et al.  Image transmission through an opaque material. , 2010, Nature communications.

[74]  S. Popoff,et al.  Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media. , 2009, Physical review letters.

[75]  T. Hashimoto,et al.  New Optical Waveguide Design Based on Wavefront Matching Method , 2007, Journal of Lightwave Technology.

[76]  A. Mosk,et al.  Phase control algorithms for focusing light through turbid media , 2007, 0710.3295.

[77]  A. Mosk,et al.  Focusing coherent light through opaque strongly scattering media. , 2007, Optics letters.

[78]  E. Cuche,et al.  Spatial filtering for zero-order and twin-image elimination in digital off-axis holography. , 2000, Applied optics.

[79]  I. Yamaguchi,et al.  Phase-shifting digital holography. , 1997, Optics letters.

[80]  A. Peres.  Construction of unitary matrices from observable transition probabilities , 1989 .

[81]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[82]  D Psaltis,et al.  Optical implementation of the Hopfield model. , 1985, Applied optics.

[83]  D. J. Brangaccio,et al.  Digital wavefront measuring interferometer for testing optical surfaces and lenses. , 1974, Applied optics.

[84]  A. Wills,et al.  Physics-informed machine learning , 2021, Nature Reviews Physics.

[85]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[86]  Avid,et al.  Comparison of nematic liquid-crystal and DMD based spatial light modulation in complex photonics , 2017 .

[87]  Yong-Bin Parka,et al.  Measuring large optical reflection matrices of turbid media , 2015 .

[88]  C. Boncelet.  Image Noise Models , 2009 .

[89]  Y Surrel,et al.  Additive noise effect in digital phase detection. , 1997, Applied optics.

[90]  Y Surrel,et al.  Design of algorithms for phase measurements by the use of phase stepping. , 1996, Applied optics.