Time-averaged image projection through a multimode fiber.

Many disciplines, ranging from lithography to opto-genetics, require high-fidelity image projection. However, not all optical systems can display all types of images with equal ease. Therefore, the image projection quality is dependent on the type of image. In some circumstances, this can lead to a catastrophic loss of intensity or image quality. For complex optical systems, it may not be known in advance which types of images pose a problem. Here we show a new method called Time-Averaged image Projection (TAP), allowing us to mitigate these limitations by taking the entire image projection system into account despite its complexity and building the desired intensity distribution up from multiple illumination patterns. Using a complex optical setup, consisting of a wavefront shaper and a multimode optical fiber illuminated by coherent light, we succeeded to suppress any speckle-related background. Further, we can display independent images at multiple distances simultaneously, and alter the effective sharpness depth through the algorithm. Our results demonstrate that TAP can significantly enhance the image projection quality in multiple ways. We anticipate that our results will greatly complement any application in which the response to light irradiation is relatively slow (one microsecond with current technology) and where high-fidelity spatial distribution of optical power is required.

[1]  K. Dholakia,et al.  Exploiting multimode waveguides for pure fibre-based imaging , 2012, Nature Communications.

[2]  Tomáš Čižmár,et al.  Shaping the light transmission through a multimode optical fibre: complex transformation analysis and applications in biophotonics. , 2011, Optics express.

[3]  Sylvain Gigan,et al.  Deterministic control of broadband light through a multiply scattering medium via the multispectral transmission matrix , 2014, Scientific Reports.

[4]  K. Dholakia,et al.  In situ wavefront correction and its application to micromanipulation , 2010 .

[5]  Tomáš Čižmár,et al.  Compact multimode fiber beam-shaping system based on GPU accelerated digital holography. , 2015, Optics letters.

[6]  Jonghee Yoon,et al.  Measuring optical transmission matrices by wavefront shaping. , 2015, Optics express.

[7]  Tomáš Čižmár,et al.  High-fidelity multimode fibre-based endoscopy for deep brain in vivo imaging , 2018, Light: Science & Applications.

[8]  Silvio Bianchi,et al.  Hologram transmission through multi-mode optical fibers. , 2011, Optics express.

[9]  Wonjun Choi,et al.  Transmission matrix of a scattering medium and its applications in biophotonics. , 2015, Optics express.

[10]  A. Mosk,et al.  Exploiting disorder for perfect focusing , 2009, 0910.0873.

[11]  Monika Ritsch-Marte,et al.  Speeding up liquid crystal SLMs using overdrive with phase change reduction. , 2013, Optics express.

[12]  Timothy D. Wilkinson,et al.  Characterizing Optical Fiber Transmission Matrices Using Metasurface Reflector Stacks for Lensless Imaging without Distal Access , 2019, Physical Review X.

[13]  Leslie J. Allen,et al.  Phase retrieval from series of images obtained by defocus variation , 2001 .

[14]  G. Lerosey,et al.  Controlling waves in space and time for imaging and focusing in complex media , 2012, Nature Photonics.

[15]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[17]  Alexander Jesacher,et al.  Colour hologram projection with an SLM by exploiting its full phase modulation range. , 2014, Optics express.

[18]  Demetri Psaltis,et al.  Multimode optical fiber transmission with a deep learning network , 2018, Light: Science & Applications.

[19]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[20]  A. Ozcan,et al.  Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution , 2010, Optics express.

[21]  S. Bernet,et al.  What spatial light modulators can do for optical microscopy , 2011 .

[22]  Florent Krzakala,et al.  Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques. , 2015, Optics express.

[23]  T Čižmár,et al.  GPU accelerated toolbox for real-time beam-shaping in multimode fibres. , 2014, Optics express.

[24]  Silvio Bianchi,et al.  A multi-mode fiber probe for holographic micromanipulation and microscopy. , 2012, Lab on a chip.

[25]  Allard Mosk,et al.  Viewpoint: The information age in optics: Measuring the transmission matrix , 2010 .

[26]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[27]  Shuhui Li,et al.  Compressively sampling the optical transmission matrix of a multimode fibre , 2020, Light: Science & Applications.

[28]  S. A. Goorden,et al.  Superpixel-based spatial amplitude and phase modulation using a digital micromirror device. , 2014, Optics express.

[29]  Rong-De Lu,et al.  Tailoring light with a digital micromirror device , 2015 .

[30]  Valentina Emiliani,et al.  Recent advances in patterned photostimulation for optogenetics , 2017 .

[31]  M. Volgushev,et al.  Advantages and Limitations of the Use of Optogenetic Approach in Studying Fast-Scale Spike Encoding , 2015, PloS one.

[32]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[33]  A. Mosk,et al.  Focusing coherent light through opaque strongly scattering media. , 2007, Optics letters.

[34]  Sylvain Gigan,et al.  Image transmission through an opaque material. , 2010, Nature communications.

[35]  Larissa Juschkin,et al.  A phase retrieval algorithm based on three-dimensionally translated diffraction patterns , 2015 .

[36]  Stefan Witte,et al.  High-speed multi-wavelength Fresnel diffraction imaging. , 2014, Optics express.

[37]  Demetri Psaltis,et al.  Actor neural networks for the robust control of partially measured nonlinear systems showcased for image propagation through diffuse media , 2020, Nature Machine Intelligence.

[38]  Don Coppersmith Rapid Multiplication of Rectangular Matrices , 1982, SIAM J. Comput..

[39]  Czech Republic,et al.  Observing distant objects with a multimode fiber-based holographic endoscope , 2020, APL Photonics.

[40]  Yoshihiko Kuroki,et al.  A psychophysical study of improvements in motion‐image quality by using high frame rates , 2007 .

[41]  Vicente Durán,et al.  Image transmission through dynamic scattering media by single-pixel photodetection. , 2014, Optics express.

[42]  Yongkeun Park,et al.  Digital optical phase conjugation for delivering two-dimensional images through turbid media , 2013, Scientific Reports.