Lensless digital holographic microscopy and its applications in biomedicine and environmental monitoring.

Optical compound microscope has been a major tool in biomedical imaging for centuries. Its performance relies on relatively complicated, bulky and expensive lenses and alignment mechanics. In contrast, the lensless microscope digitally reconstructs microscopic images of specimens without using any lenses, as a result of which it can be made much smaller, lighter and lower-cost. Furthermore, the limited space-bandwidth product of objective lenses in a conventional microscope can be significantly surpassed by a lensless microscope. Such lensless imaging designs have enabled high-resolution and high-throughput imaging of specimens using compact, portable and cost-effective devices to potentially address various point-of-care, global-health and telemedicine related challenges. In this review, we discuss the operation principles and the methods behind lensless digital holographic on-chip microscopy. We also go over various applications that are enabled by cost-effective and compact implementations of lensless microscopy, including some recent work on air quality monitoring, which utilized machine learning for high-throughput and accurate quantification of particulate matter in air. Finally, we conclude with a brief future outlook of this computational imaging technology.

[1]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[2]  W. Brown Synthetic Aperture Radar , 1967, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Aydogan Ozcan,et al.  Wide-field computational color imaging using pixel super-resolved on-chip microscopy. , 2013, Optics express.

[4]  Aydogan Ozcan,et al.  Lens-free computational imaging of capillary morphogenesis within three-dimensional substrates , 2012, Journal of biomedical optics.

[5]  L. Tian,et al.  Transport of Intensity phase-amplitude imaging with higher order intensity derivatives. , 2010, Optics express.

[6]  James R. Fienup,et al.  Phase-retrieval stagnation problems and solutions , 1986 .

[7]  Aydogan Ozcan,et al.  Wide-field imaging of birefringent synovial fluid crystals using lens-free polarized microscopy for gout diagnosis , 2016, Scientific Reports.

[8]  László Orzó,et al.  Special multicolor illumination and numerical tilt correction in volumetric digital holographic microscopy. , 2014, Optics express.

[9]  Aydogan Ozcan,et al.  Computational On-Chip Imaging of Nanoparticles and Biomolecules using Ultraviolet Light , 2017, Scientific Reports.

[10]  Hongying Zhu,et al.  Optofluidic Tomography on a Chip. , 2011, Applied physics letters.

[11]  A. E. Cetin,et al.  Lensfree optofluidic plasmonic sensor for real-time and label-free monitoring of molecular binding events over a wide field-of-view , 2014, Scientific Reports.

[12]  Xiaodong Li,et al.  Solving Quadratic Equations via PhaseLift When There Are About as Many Equations as Unknowns , 2012, Found. Comput. Math..

[13]  Derek K. Tseng,et al.  Compact and light-weight automated semen analysis platform using lensfree on-chip microscopy. , 2010, Analytical chemistry.

[14]  Aydogan Ozcan,et al.  Lensless Imaging and Sensing. , 2016, Annual review of biomedical engineering.

[15]  A. Ozcan,et al.  Synthetic aperture-based on-chip microscopy , 2015, Light: Science & Applications.

[16]  Aydogan Ozcan,et al.  Wide-field lensless fluorescent microscopy using a tapered fiber-optic faceplate on a chip. , 2011, The Analyst.

[17]  Yibo Zhang,et al.  Wide-field pathology imaging using on-chip microscopy , 2015, Virchows Archiv.

[18]  Christof Asbach,et al.  A thermal precipitator for the deposition of airborne nanoparticles onto living cells—Rationale and development , 2013 .

[19]  Yibo Zhang,et al.  Sparsity-based multi-height phase recovery in holographic microscopy , 2016, Scientific Reports.

[20]  David Bardell,et al.  The Biologists' Forum: The invention of the microscope , 2004 .

[21]  Aydogan Ozcan,et al.  Lensfree super-resolution holographic microscopy using wetting films on a chip , 2011, Optics express.

[22]  Aydogan Ozcan,et al.  Lensfree Fluorescent On-Chip Imaging of Transgenic Caenorhabditis elegans Over an Ultra-Wide Field-of-View , 2011, PloS one.

[23]  Aydogan Ozcan,et al.  Field-Portable Pixel Super-Resolution Colour Microscope , 2013, PloS one.

[24]  Timothy V. Larson,et al.  Emissions from an International Airport Increase Particle Number Concentrations 4-fold at 10 km Downwind , 2014, Environmental science & technology.

[25]  Zachary S. Ballard,et al.  Air quality monitoring using mobile microscopy and machine learning , 2017, Light: Science & Applications.

[26]  D Harrison UK equivalence programme for monitoring of particulate matter - final report for - Department for the Environment, Food and Rural Affairs, Welsh Assembly Government, Scottish Executive, Department of Environment for Northern Ireland , 2006 .

[27]  A. Ozcan,et al.  Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution , 2010, Optics express.

[28]  Kurt Straif,et al.  The carcinogenicity of outdoor air pollution. , 2013, The Lancet. Oncology.

[29]  J. Goodman Introduction to Fourier optics , 1969 .

[30]  Aydogan Ozcan,et al.  High-throughput lens-free blood analysis on a chip. , 2010, Analytical chemistry.

[31]  Aydogan Ozcan,et al.  Sperm Trajectories Form Chiral Ribbons , 2013, Scientific Reports.

[32]  Aydogan Ozcan,et al.  Imaging without lenses: achievements and remaining challenges of wide-field on-chip microscopy , 2012, Nature Methods.

[33]  Yibo Zhang,et al.  Computational out-of-focus imaging increases the space–bandwidth product in lens-based coherent microscopy , 2016 .

[34]  J. M. Hirst AN AUTOMATIC VOLUMETRIC SPORE TRAP , 1952 .

[35]  Sameera S. Ponda,et al.  Phase and amplitude imaging from noisy images by Kalman filtering. , 2011, Optics express.

[37]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  László Orzó,et al.  In-line color digital holographic microscope for water quality measurements , 2010, Laser Applications in Life Sciences.

[39]  Daniel L Marks,et al.  Compressive holography. , 2009, Optics express.

[40]  Yibo Zhang,et al.  Phase recovery and holographic image reconstruction using deep learning in neural networks , 2017, Light: Science & Applications.

[41]  Derek Tseng,et al.  Compact, light-weight and cost-effective microscope based on lensless incoherent holography for telemedicine applications. , 2010, Lab on a chip.

[42]  Derek Tseng,et al.  Multi-angle lensless digital holography for depth resolved imaging on a chip. , 2010, Optics express.

[43]  M. Born Principles of Optics : Electromagnetic theory of propagation , 1970 .

[44]  Wei Luo,et al.  Propagation phasor approach for holographic image reconstruction , 2016, Scientific Reports.

[45]  J. Walkup,et al.  Statistical optics , 1986, IEEE Journal of Quantum Electronics.

[46]  Demetri Psaltis,et al.  Resolution enhancement in nonlinear scanning microscopy through post-detection digital computation , 2014 .

[47]  K. Nugent,et al.  Phase retrieval with the transport-of-intensity equation: matrix solution with use of Zernike polynomials , 1995 .

[48]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[49]  Hongying Zhu,et al.  Holographic opto-fluidic microscopy , 2010, Optics express.

[50]  A. Devaney Nonuniqueness in the inverse scattering problem , 1978 .

[51]  Aydogan Ozcan,et al.  On-Chip Cytometry using Plasmonic Nanoparticle Enhanced Lensfree Holography , 2013, Scientific Reports.

[52]  M. Schmid Principles Of Optics Electromagnetic Theory Of Propagation Interference And Diffraction Of Light , 2016 .

[53]  W. Bishara,et al.  Lens-free optical tomographic microscope with a large imaging volume on a chip , 2011, Proceedings of the National Academy of Sciences.

[54]  Leslie J. Allen,et al.  Phase retrieval from series of images obtained by defocus variation , 2001 .

[55]  Aydogan Ozcan,et al.  Wide-field optical detection of nanoparticles using on-chip microscopy and self-assembled nanolenses , 2013, Nature Photonics.

[56]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[57]  Aydogan Ozcan,et al.  Color and monochrome lensless on-chip imaging of Caenorhabditis elegans over a wide field-of-view. , 2010, Lab on a chip.

[58]  Joseph Rosen,et al.  In-line FINCH super resolution digital holographic fluorescence microscopy using a high efficiency transmission liquid crystal GRIN lens. , 2013, Optics letters.

[59]  Aydogan Ozcan,et al.  Increased space-bandwidth product in pixel super-resolved lensfree on-chip microscopy , 2013, Scientific Reports.

[60]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[61]  Yuanying Chen,et al.  Rapid evolution of piRNA clusters in the Drosophila melanogaster ovary , 2023, bioRxiv.

[62]  Aydogan Ozcan,et al.  High-throughput analysis of horse sperms' 3D swimming patterns using computational on-chip imaging. , 2016, Animal reproduction science.

[63]  Aydogan Ozcan,et al.  Enhanced light collection in fluorescence microscopy using self-assembled micro-reflectors , 2015, Scientific Reports.

[64]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[65]  Adrian Stern,et al.  Compressive multiple view projection incoherent holography. , 2011, Optics express.

[66]  M. Gustafsson Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy , 2000, Journal of microscopy.

[67]  Aydogan Ozcan,et al.  High-throughput lensfree 3D tracking of human sperms reveals rare statistics of helical trajectories , 2012, Proceedings of the National Academy of Sciences.

[68]  Michael Unser,et al.  Proximity operators for phase retrieval. , 2016, Applied optics.

[69]  A. Ozcan,et al.  Holographic pixel super-resolution in portable lensless on-chip microscopy using a fiber-optic array. , 2011, Lab on a chip.

[70]  Siddharth Garg,et al.  CompAct , 2019, ACM Transactions on Embedded Computing Systems.

[71]  László Orzó,et al.  Multicolor digital holographic microscope (DHM) for biological purposes , 2010, BiOS.

[72]  Aydogan Ozcan,et al.  Unconventional methods of imaging: computational microscopy and compact implementations , 2016, Reports on progress in physics. Physical Society.

[73]  Aydogan Ozcan,et al.  Optoelectronic tweezers integrated with lensfree holographic microscopy for wide-field interactive cell and particle manipulation on a chip. , 2013, Lab on a chip.

[74]  M Paturzo,et al.  Optofluidic holographic microscopy with custom field of view (FoV) using a linear array detector. , 2015, Lab on a chip.

[75]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[76]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[77]  Farnoud Kazemzadeh,et al.  Bayesian-based aberration correction and numerical diffraction for improved lensfree on-chip microscopy of biological specimens. , 2015, Optics letters.

[78]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[79]  Hongying Zhu,et al.  Optofluidic fluorescent imaging cytometry on a cell phone. , 2011, Analytical chemistry.

[80]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[81]  Matthias Born,et al.  Principles of Optics: Electromagnetic Theory of Propa-gation, Interference and Di raction of Light , 1999 .

[82]  Yibo Zhang,et al.  Color calibration and fusion of lens-free and mobile-phone microscopy images for high-resolution and accurate color reproduction , 2016, Scientific Reports.

[83]  Aydogan Ozcan,et al.  High-throughput and label-free single nanoparticle sizing based on time-resolved on-chip microscopy. , 2015, ACS nano.

[84]  Derek K. Tseng,et al.  Detection of waterborne parasites using field-portable and cost-effective lensfree microscopy. , 2010, Lab on a chip.

[85]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[86]  A. Ozcan,et al.  Spectral Demultiplexing in Holographic and Fluorescent On-chip Microscopy , 2014, Scientific Reports.

[87]  Laura Waller,et al.  Partially coherent phase imaging with simultaneous source recovery. , 2015, Biomedical optics express.

[88]  T. Latychevskaia,et al.  Solution to the twin image problem in holography. , 2006, Physical review letters.

[89]  Yibo Zhang,et al.  Wide-field computational imaging of pathology slides using lens-free on-chip microscopy , 2014, Science Translational Medicine.

[90]  A. Chambolle Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[91]  Bahram Javidi,et al.  Overview of compressive sensing techniques applied in holography [Invited]. , 2013, Applied optics.

[92]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[93]  A. Ozcan,et al.  Lensfree sensing on a microfluidic chip using plasmonic nanoapertures. , 2010, Applied physics letters.

[94]  Derek Tseng,et al.  Combined reflection and transmission microscope for telemedicine applications in field settings. , 2011, Lab on a chip.

[95]  A. Ozcan,et al.  Pixel super-resolution using wavelength scanning , 2015, Light: Science & Applications.

[96]  Aydogan Ozcan,et al.  Handheld high-throughput plasmonic biosensor using computational on-chip imaging , 2014, Light: Science & Applications.

[97]  Aydogan Ozcan,et al.  Field-portable wide-field microscopy of dense samples using multi-height pixel super-resolution based lensfree imaging. , 2012, Lab on a chip.

[98]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[99]  Aydogan Ozcan,et al.  Computational Sensing Using Low-Cost and Mobile Plasmonic Readers Designed by Machine Learning. , 2017, ACS nano.

[100]  Yibo Zhang,et al.  Demosaiced pixel super-resolution for multiplexed holographic color imaging , 2016, Scientific Reports.

[101]  A. Ozcan,et al.  Lensfree holographic imaging for on-chip cytometry and diagnostics. , 2009, Lab on a chip.

[102]  Stefan Sinzinger,et al.  An imaging spectrometer employing tunable hyperchromatic microlenses , 2016, Light, science & applications.

[103]  Aydogan Ozcan,et al.  High throughput on-chip analysis of high-energy charged particle tracks using lensfree imaging , 2015 .

[104]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[105]  Leslie H. Gesell,et al.  Theory of the synthetic aperture microscope , 1995, Optics + Photonics.

[106]  Aydogan Ozcan,et al.  Field-portable lensfree tomographic microscope. , 2011, Lab on a Chip.

[107]  Veit Elser Phase retrieval by iterated projections. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[108]  Aydogan Ozcan,et al.  Lensless wide-field fluorescent imaging on a chip using compressive decoding of sparse objects , 2010, Optics express.

[109]  K. Nugent,et al.  Phase retrieval with the transport-of-intensity equation. II. Orthogonal series solution for nonuniform illumination , 1996 .

[110]  Aydogan Ozcan,et al.  Mobile phones democratize and cultivate next-generation imaging, diagnostics and measurement tools. , 2014, Lab on a chip.

[111]  Bahram Javidi,et al.  An overview of compressive sensing techniques applied in holography , 2013 .

[112]  Subhransu Maji,et al.  Automatic Image Annotation using Deep Learning Representations , 2015, ICMR.

[113]  Laura Waller,et al.  Sparse ACEKF for phase reconstruction. , 2013, Optics express.

[114]  Michael Elad,et al.  Multiframe demosaicing and super-resolution of color images , 2006, IEEE Transactions on Image Processing.

[115]  Gediminas Mainelis,et al.  Collection of Airborne Microorganisms by Electrostatic Precipitation , 1999 .

[116]  A. Ozcan,et al.  High-Throughput Quantification of Nanoparticle Degradation Using Computational Microscopy and Its Application to Drug Delivery Nanocapsules , 2017 .

[117]  A. Ozcan,et al.  Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy , 2012, Optics Express.

[118]  Daniel L Marks,et al.  Interferometric Synthetic Aperture Microscopy , 2007, OFC/NFOEC 2008 - 2008 Conference on Optical Fiber Communication/National Fiber Optic Engineers Conference.

[119]  Yi Cui,et al.  Transparent air filter for high-efficiency PM2.5 capture , 2015, Nature Communications.

[120]  Derek Tseng,et al.  Lensfree microscopy on a cellphone. , 2010, Lab on a chip.

[121]  Aydogan Ozcan,et al.  Tunable Vapor-Condensed Nanolenses , 2014, ACS nano.

[122]  Yibo Zhang,et al.  Deep Learning Microscopy , 2017, ArXiv.

[123]  James H. Vincent,et al.  Aerosol Instrumentation in Occupational Hygiene: An Historical Perspective , 1998 .

[124]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).