Deep optical imaging within complex scattering media

Optical imaging has had a central role in elucidating the underlying biological and physiological mechanisms in living specimens owing to its high spatial resolution, molecular specificity and minimal invasiveness. However, its working depth for in vivo imaging is extremely shallow, and thus reactions occurring deep inside living specimens remain out of reach. This problem originates primarily from multiple light scattering caused by the inhomogeneity of tissue obscuring the desired image information. Adaptive optical microscopy, which minimizes the effect of sample-induced aberrations, has to date been the most effective approach to addressing this problem, but its performance has plateaued because it can suppress only lower-order perturbations. To achieve an imaging depth beyond this conventional limit, there is increasing interest in exploiting the physics governing multiple light scattering. New approaches have emerged based on the deterministic measurement and/or control of multiple-scattered waves, rather than their stochastic and statistical treatment. In this Review, we provide an overview of recent developments in this area, with a focus on approaches that achieve a microscopic spatial resolution while remaining useful for in vivo imaging, and discuss their present limitations and future prospects. Optical microscopy is limited to shallow in vivo imaging depths owing to the exponential extinction of single-scattered waves by multiple light scattering. In this Review, we survey methodologies for deep optical imaging that maintain microscopic resolution by making deterministic use of multiple-scattered waves. Optical microscopy is an indispensable tool in biology and medicine owing to its high spatial resolution, molecular specificity and minimal invasiveness, but it is limited to the interrogation of superficial layers for in vivo imaging. The intensity of single-scattered waves used in conventional imaging decreases exponentially with depth; thus, the imaging depth limits are set by the detector dynamic range and the efficiency of the gating operations. Approaches that make deterministic use of the abundant multiple-scattered (MS) waves have been proposed to enable deep optical imaging while maintaining the microscopic spatial resolving power. Recording and controlling the wavefront of MS waves enables a complex scattering layer to be converted into a focusing lens, leading to the development of an ultrathin endoscope. Acousto-optic interactions and wavefront sensing and/or control are integrated to exploit the large penetration depth of ultrasound and high spatial resolution of optical imaging. Reflection-matrix approaches that record and process all MS waves enable the correction of sample-induced aberrations, exploitation of multiple scattering signals and suppression of multiple scattering noise, allowing for imaging at depths greater than those accessible with conventional confocal and adaptive optics microscopy.

[1]  Puxiang Lai,et al.  Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media , 2014, Nature Photonics.

[2]  Demetri Psaltis,et al.  Bend translation in multimode fiber imaging. , 2017, Optics express.

[3]  Moonseok Kim,et al.  Synthetic aperture microscopy for high resolution imaging through a turbid medium. , 2011, Optics letters.

[4]  Yongkeun Park,et al.  Subwavelength light focusing using random nanoparticles , 2013, Nature Photonics.

[5]  I. Freund Looking through walls and around corners , 1990 .

[6]  C Dunsby,et al.  TOPICAL REVIEW: Techniques for depth-resolved imaging through turbid media including coherence-gated imaging , 2003 .

[7]  Christopher Dunsby,et al.  Ultrasound-mediated optical tomography: a review of current methods , 2011, Interface Focus.

[8]  Silvio Bianchi,et al.  A multi-mode fiber probe for holographic micromanipulation and microscopy. , 2012, Lab on a chip.

[9]  Nathan D. Shemonski,et al.  Computational high-resolution optical imaging of the living human retina , 2015, Nature Photonics.

[10]  Changhuei Yang,et al.  Translation correlations in anisotropically scattering media , 2014, 1411.7157.

[11]  G. Lerosey,et al.  Time reversal of wideband microwaves , 2006 .

[12]  Sylvain Gigan,et al.  Controlling light in complex media beyond the acoustic diffraction-limit using the acousto-optic transmission matrix , 2017, Nature Communications.

[13]  W. Webb,et al.  Live tissue intrinsic emission microscopy using multiphoton-excited native fluorescence and second harmonic generation , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[14]  D. Conkey,et al.  High-speed scattering medium characterization with application to focusing light through turbid media. , 2012, Optics express.

[15]  Martin J. Booth,et al.  Adaptive optical microscopy: the ongoing quest for a perfect image , 2014, Light: Science & Applications.

[16]  S. Gigan,et al.  Light fields in complex media: Mesoscopic scattering meets wave control , 2017, 1702.05395.

[17]  Mathias Fink,et al.  Eigenmodes of the time reversal operator: a solution to selective focusing in multiple-target media , 1994 .

[18]  Ioannis N. Papadopoulos,et al.  The generalized optical memory effect , 2017, 1705.01373.

[19]  Eric Akkermans,et al.  Mesoscopic Physics of Electrons and Photons: Dephasing , 2007 .

[20]  Yaron Silberberg,et al.  Focusing light by wavefront shaping through disorder and nonlinearity , 2016, 1607.08105.

[21]  Ke Si,et al.  Fluorescence imaging beyond the ballistic regime by ultrasound pulse guided digital phase conjugation , 2012, Nature Photonics.

[22]  Loic A. Royer,et al.  Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction , 2018, Nature Methods.

[23]  Florent Krzakala,et al.  Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques. , 2015, Optics express.

[24]  V. Ntziachristos,et al.  Concurrent MRI and diffuse optical tomography of breast after indocyanine green enhancement. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[25]  AMIR PORAT,et al.  Widefield lensless imaging through a fiber bundle via speckle correlations. , 2016, Optics express.

[26]  S. Gigan,et al.  Characterization of the angular memory effect of scattered light in biological tissues. , 2015, Optics express.

[27]  S. Hell Far-Field Optical Nanoscopy , 2007, Science.

[28]  Tomáš Čižmár,et al.  Shaping the light transmission through a multimode optical fibre: complex transformation analysis and applications in biophotonics. , 2011, Optics express.

[29]  Ioannis N. Papadopoulos,et al.  Scattering compensation by focus scanning holographic aberration probing (F-SHARP) , 2017 .

[30]  S. Hell,et al.  Fluorescence microscopy with diffraction resolution barrier broken by stimulated emission. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Lihong V. Wang,et al.  Dark-Field Confocal Photoacoustic Microscopy , 2009 .

[32]  A. Mosk,et al.  Exploiting disorder for perfect focusing , 2009, 0910.0873.

[33]  W. Choi,et al.  Removal of back-reflection noise at ultrathin imaging probes by the single-core illumination and wide-field detection , 2017, Scientific Reports.

[34]  Sungsam Kang,et al.  Label-free neuroimaging in vivo using synchronous angular scanning microscopy with single-scattering accumulation algorithm , 2019, Nature Communications.

[35]  Lihong V Wang,et al.  Focusing light through biological tissue and tissue-mimicking phantoms up to 9.6 cm in thickness with digital optical phase conjugation , 2016, Journal of biomedical optics.

[36]  M. Fink,et al.  Time reversal of ultrasonic fields. I. Basic principles , 1992, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[37]  Ulugbek Kamilov,et al.  Efficient and accurate inversion of multiple scattering with deep learning , 2018, Optics express.

[38]  J. Fujimoto,et al.  Optical Coherence Tomography , 1991 .

[39]  M. Fink,et al.  Exploiting the time-reversal operator for adaptive optics, selective focusing and scattering pattern analysis , 2011, 2012 Conference on Lasers and Electro-Optics (CLEO).

[40]  Sungsam Kang,et al.  Focusing of light energy inside a scattering medium by controlling the time-gated multiple light scattering , 2017 .

[41]  Yan Liu,et al.  Focusing light inside dynamic scattering media with millisecond digital optical phase conjugation. , 2017, Optica.

[42]  Mathias Fink,et al.  Smart optical coherence tomography for ultra-deep imaging through highly scattering media , 2015, Science Advances.

[43]  Lyubov V Amitonova,et al.  Rotational memory effect of a multimode fiber. , 2015, Optics express.

[44]  M. Vorontsov,et al.  The principles of adaptive optics , 1985 .

[45]  Michael S Feld,et al.  Overcoming the diffraction limit using multiple light scattering in a highly disordered medium. , 2011, Physical review letters.

[46]  Jungho Moon,et al.  Toward a miniature endomicroscope: pixelation-free and diffraction-limited imaging through a fiber bundle. , 2014, Optics letters.

[47]  L V Wang,et al.  Theoretical and experimental studies of ultrasound-modulated optical tomography in biological tissue. , 2000, Applied optics.

[48]  A. Ozcan,et al.  On the use of deep learning for computational imaging , 2019, NanoScience + Engineering.

[49]  S. Gigan,et al.  Focusing light through dynamical samples using fast continuous wavefront optimization. , 2017, Optics letters.

[50]  D. Psaltis,et al.  OPTICAL PHASE CONJUGATION FOR TURBIDITY SUPPRESSION IN BIOLOGICAL SAMPLES. , 2008, Nature photonics.

[51]  C. Beenakker Random-matrix theory of quantum transport , 1996, cond-mat/9612179.

[52]  G. Lerosey,et al.  Time reversal of electromagnetic waves. , 2004, Physical review letters.

[53]  M. Fink Time reversed acoustics , 1997 .

[54]  Zahid Yaqoob,et al.  Measurement of the time-resolved reflection matrix for enhancing light energy delivery into a scattering medium. , 2013, Physical review letters.

[55]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[56]  K. Dholakia,et al.  Exploiting multimode waveguides for pure fibre-based imaging , 2012, Nature Communications.

[57]  Arnaud Derode,et al.  Random matrix theory applied to acoustic backscattering and imaging in complex media. , 2009, Physical review letters.

[58]  B E Bouma,et al.  Ultrahigh-resolution full-field optical coherence microscopy using InGaAs camera. , 2006, Optics express.

[59]  B. Bouma,et al.  Handbook of Optical Coherence Tomography , 2001 .

[60]  H Saint-Jalmes,et al.  Full-field optical coherence microscopy. , 1998, Optics letters.

[61]  J R Fienup,et al.  Reconstruction of an object from the modulus of its Fourier transform. , 1978, Optics letters.

[62]  Lihong V. Wang,et al.  Time-reversed ultrasonically encoded optical focusing into scattering media , 2010, Nature photonics.

[63]  Ke Si,et al.  Breaking the spatial resolution barrier via iterative sound-light interaction in deep tissue microscopy , 2012, Scientific Reports.

[64]  Kunal K. Ghosh,et al.  Advances in light microscopy for neuroscience. , 2009, Annual review of neuroscience.

[65]  J. Fujimoto,et al.  Optical coherence microscopy in scattering media. , 1994, Optics letters.

[66]  Feng,et al.  Memory effects in propagation of optical waves through disordered media. , 1988, Physical review letters.

[67]  M. Fink,et al.  Controlling light in scattering media non-invasively using the photoacoustic transmission matrix , 2013, 1305.6246.

[68]  Eric Betzig,et al.  Adaptive optics via pupil segmentation for high-resolution imaging in biological tissues , 2010, Nature Methods.

[69]  K. Wagner,et al.  Focusing and scanning through scattering media in microseconds , 2019, Optica.

[70]  Kathryn E. Luker,et al.  Optical Imaging: Current Applications and Future Directions , 2007, Journal of Nuclear Medicine.

[71]  Tomáš Čižmár,et al.  Seeing through chaos in multimode fibres , 2015, Nature Photonics.

[72]  K Bahlmann,et al.  Three-photon excitation in fluorescence microscopy. , 1996, Journal of biomedical optics.

[73]  Anne Sentenac,et al.  Optical phase conjugation (OPC)-assisted isotropic focusing. , 2013, Optics express.

[74]  Demetri Psaltis,et al.  Calibration-free imaging through a multicore fiber using speckle scanning microscopy. , 2016, Optics letters.

[75]  Ying Min Wang,et al.  Speckle-scale focusing in the diffusive regime with time-reversal of variance-encoded light (TROVE) , 2013, Nature Photonics.

[76]  G. Feng,et al.  Imaging Neuronal Subsets in Transgenic Mice Expressing Multiple Spectral Variants of GFP , 2000, Neuron.

[77]  Roux,et al.  Robust Acoustic Time Reversal with High-Order Multiple Scattering. , 1995, Physical review letters.

[78]  Allard Mosk,et al.  Viewpoint: The information age in optics: Measuring the transmission matrix , 2010 .

[79]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[80]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[81]  Sylvain Gigan,et al.  Image transmission through an opaque material. , 2010, Nature communications.

[82]  Ivo Micha Vellekoop,et al.  The generalized optical memory effect , 2017 .

[83]  Demetri Psaltis,et al.  Two-photon imaging through a multimode fiber. , 2015, Optics express.

[84]  Meng Cui,et al.  High-resolution in vivo imaging of mouse brain through the intact skull , 2015, Proceedings of the National Academy of Sciences.

[85]  Yan Liu,et al.  Focusing light inside scattering media with magnetic-particle-guided wavefront shaping. , 2017, Optica.

[86]  Dominique Pagnoux,et al.  Shaping the light amplified in a multimode fiber , 2016, Light: Science & Applications.

[87]  Yaron Silberberg,et al.  Nonlinear scanning laser microscopy by third harmonic generation , 1997 .

[88]  J. Detre,et al.  Diffuse optical measurement of blood flow, blood oxygenation, and metabolism in a human brain during sensorimotor cortex activation. , 2004, Optics letters.

[89]  Michael Unser,et al.  Learning approach to optical tomography , 2015, 1502.01914.

[90]  O. N. Dorokhov On the coexistence of localized and extended electronic states in the metallic phase , 1984 .

[91]  Shay Ohayon,et al.  Minimally invasive multimode optical fiber microendoscope for deep brain fluorescence imaging. , 2018, Biomedical optics express.

[92]  J. Bertolotti,et al.  Non-invasive imaging through opaque scattering layers , 2012, Nature.

[93]  A. Mosk,et al.  Focusing coherent light through opaque strongly scattering media. , 2007, Optics letters.

[94]  R R Alfano,et al.  Transmitted photon intensity through biological tissues within various time windows. , 1994, Optics letters.

[95]  A. Mosk,et al.  Focusing and scanning microscopy with propagating surface plasmons. , 2013, Physical review letters.

[96]  W. Choi,et al.  Optical Imaging With the Use of a Scattering Lens , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[97]  W. Choi,et al.  Far-field control of focusing plasmonic waves through disordered nanoholes. , 2014, Optics letters.

[98]  S. Popoff,et al.  Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media. , 2009, Physical review letters.

[99]  Rafael Piestun,et al.  Super-resolution photoacoustic imaging through a scattering wall. , 2015, Nature communications.

[100]  Ying Min Wang,et al.  Deep-tissue focal fluorescence imaging with digitally time-reversed ultrasound-encoded light , 2012, Nature Communications.

[101]  W. Choi,et al.  Relation between transmission eigenchannels and single-channel optimizing modes in a disordered medium. , 2013, Optics letters.

[102]  Sungsam Kang,et al.  Imaging deep within a scattering medium using collective accumulation of single-scattered waves , 2015, Nature Photonics.

[103]  M. Fink,et al.  Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations , 2014, Nature Photonics.

[104]  W. Denk,et al.  Two-photon laser scanning fluorescence microscopy. , 1990, Science.

[105]  O. Katz,et al.  Looking around corners and through thin turbid layers in real time with scattered incoherent light , 2012, Nature Photonics.

[106]  Feng,et al.  Correlations and fluctuations of coherent wave transmission through disordered media. , 1988, Physical review letters.

[107]  A. Mosk,et al.  Universal optimal transmission of light through disordered materials. , 2008, Physical review letters.

[108]  R Di Leonardo,et al.  Focusing and imaging with increased numerical apertures through multimode fibers with micro-fabricated optics. , 2013, Optics letters.

[109]  Demetri Psaltis,et al.  Multimode optical fiber transmission with a deep learning network , 2018, Light: Science & Applications.

[110]  Huabei Jiang,et al.  Current and future clinical applications for optical imaging of cancer: from intraoperative surgical guidance to cancer screening. , 2011, Seminars in oncology.

[111]  Gerwin Osnabrugge,et al.  Blind focusing through strongly scattering media using wavefront shaping with nonlinear feedback. , 2019, Optics express.

[112]  W. Choi,et al.  Maximal energy transport through disordered media with the implementation of transmission eigenchannels , 2012, Nature Photonics.

[113]  Martin O Culjat,et al.  A review of tissue substitutes for ultrasound imaging. , 2010, Ultrasound in medicine & biology.

[114]  E. Papagiakoumou,et al.  Functional patterned multiphoton excitation deep inside scattering tissue , 2013, Nature Photonics.

[115]  E. G. van Putten,et al.  Scattering lens resolves sub-100 nm structures with visible light. , 2011, Physical review letters.

[116]  V. Ntziachristos Going deeper than microscopy: the optical imaging frontier in biology , 2010, Nature Methods.

[117]  Etienne Cuche,et al.  Numerical parametric lens for shifting, magnification, and complete aberration compensation in digital holographic microscopy. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[118]  Sungsam Kang,et al.  High-resolution adaptive optical imaging within thick scattering media using closed-loop accumulation of single scattering , 2017, Nature Communications.

[119]  Lihong V. Wang,et al.  Photoacoustic Tomography: In Vivo Imaging from Organelles to Organs , 2012, Science.

[120]  Changhuei Yang,et al.  Iterative Time-Reversed Ultrasonically Encoded Light Focusing in Backscattering Mode , 2014, Scientific Reports.

[121]  Lihong V. Wang,et al.  Prospects of photoacoustic tomography. , 2008, Medical physics.

[122]  W. Choi,et al.  Control of randomly scattered surface plasmon polaritons for multiple-input and multiple-output plasmonic switching devices , 2017, Nature Communications.

[123]  Changhuei Yang,et al.  Guidestar-assisted wavefront-shaping methods for focusing light into biological tissue , 2015, Nature Photonics.

[124]  Carlas S. Smith,et al.  Anisoplanatic adaptive optics in parallelized laser scanning microscopy. , 2018, Optics express.

[125]  I. Vellekoop Feedback-based wavefront shaping. , 2015, Optics express.

[126]  Michael Unser,et al.  Convolutional Neural Networks for Inverse Problems in Imaging: A Review , 2017, IEEE Signal Processing Magazine.

[127]  Kishan Dholakia,et al.  Wide-field multiphoton imaging through scattering media without correction , 2017, Science Advances.

[128]  Mathias Fink,et al.  Multiple scattering limit in optical microscopy , 2017, 1709.03386.

[129]  D. Psaltis,et al.  Imaging blood cells through scattering biological tissue using speckle scanning microscopy. , 2013, Optics express.

[130]  Laurent Daudet,et al.  Intensity-only measurement of partially uncontrollable transmission matrix: demonstration with wave-field shaping in a microwave cavity. , 2016, Optics express.

[131]  Roarke Horstmeyer,et al.  Scattering correlations of time-gated light , 2017 .

[132]  Guoan Zheng,et al.  Characterization of spatially varying aberrations for wide field-of-view microscopy. , 2013, Optics express.

[133]  Lihong V. Wang Ultrasound-Mediated Biophotonic Imaging: A Review of Acousto-Optical Tomography and Photo-Acoustic Tomography , 2004, Disease markers.

[134]  G. Lerosey,et al.  Controlling waves in space and time for imaging and focusing in complex media , 2012, Nature Photonics.

[135]  Ioannis N. Papadopoulos,et al.  Digital confocal microscopy through a multimode fiber. , 2015, Optics express.

[136]  Adeel Ahmad,et al.  Computational adaptive optics for broadband optical interferometric tomography of biological tissue , 2012, Proceedings of the National Academy of Sciences.

[137]  Ivan Vishniakou,et al.  Light scattering control with neural networks in transmission and reflection , 2018 .

[138]  Tomáš Čižmár,et al.  Robustness of Light-Transport Processes to Bending Deformations in Graded-Index Multimode Waveguides. , 2018, Physical review letters.

[139]  Edward S Boyden,et al.  Wide-field three-photon excitation in biological samples , 2016, Light: Science & Applications.

[140]  Rafael Piestun,et al.  Single multimode fiber endoscope. , 2017, Optics express.

[141]  Joshua Brake,et al.  Focusing through dynamic tissue with millisecond digital optical phase conjugation. , 2015, Optica.

[142]  Demetri Psaltis,et al.  Dynamic bending compensation while focusing through a multimode fiber. , 2013, Optics express.

[143]  Moonseok Kim,et al.  Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber. , 2012, Physical review letters.

[144]  Tomáš Čižmár,et al.  High-fidelity multimode fibre-based endoscopy for deep brain in vivo imaging , 2018, Light: Science & Applications.