A deep learning-enabled portable imaging flow cytometer for cost-effective, high-throughput, and label-free analysis of natural water samples

We report a deep learning-enabled field-portable and cost-effective imaging flow cytometer that automatically captures phase-contrast color images of the contents of a continuously flowing water sample at a throughput of 100 mL/h. The device is based on partially coherent lens-free holographic microscopy and acquires the diffraction patterns of flowing micro-objects inside a microfluidic channel. These holographic diffraction patterns are reconstructed in real time using a deep learning-based phase-recovery and image-reconstruction method to produce a color image of each micro-object without the use of external labeling. Motion blur is eliminated by simultaneously illuminating the sample with red, green, and blue light-emitting diodes that are pulsed. Operated by a laptop computer, this portable device measures 15.5 cm × 15 cm × 12.5 cm, weighs 1 kg, and compared to standard imaging flow cytometers, it provides extreme reductions of cost, size and weight while also providing a high volumetric throughput over a large object size range. We demonstrated the capabilities of this device by measuring ocean samples at the Los Angeles coastline and obtaining images of its micro- and nanoplankton composition. Furthermore, we measured the concentration of a potentially toxic alga (Pseudo-nitzschia) in six public beaches in Los Angeles and achieved good agreement with measurements conducted by the California Department of Public Health. The cost-effectiveness, compactness, and simplicity of this computational platform might lead to the creation of a network of imaging flow cytometers for large-scale and continuous monitoring of the ocean microbiome, including its plankton composition.Bio-analysis: Rapidly spotting toxicity in a drop of the oceanA portable device that combines holographic imaging with artificial intelligence can rapidly detect potentially harmful algae in ocean water. Aydogan Ozcan, Zoltan Gorocs and colleagues from the University of California Los Angeles in the United States developed an inexpensive flow cytometer that pumps water samples containing tiny marine organisms, past an LED chip pulsing red, blue, and green light simultaneously. Deep learning algorithms trained to recognize background signals automatically analyze the holographic interference patterns created by the marine organisms and rapidly generate color images with microscale resolution. Sample throughput is boosted 10-fold over conventional imaging flow cytometry by avoiding the use of lenses. Using a lightweight and inexpensive prototype, the team monitored plankton levels at six public beaches and detected a likely toxic organism, the algae Pseudo-nitzschia, at levels matching those from public health laboratories.

[1]  R. Wayne Litaker,et al.  Ocean warming since 1982 has expanded the niche of toxic algal blooms in the North Atlantic and North Pacific oceans , 2017, Proceedings of the National Academy of Sciences.

[2]  C. Leaw,et al.  MORPHOLOGY AND MOLECULAR CHARACTERIZATION OF PSEUDO‐NITZSCHIA (BACILLARIOPHYCEAE) FROM MALAYSIAN BORNEO, INCLUDING THE NEW SPECIES PSEUDO‐NITZSCHIA CIRCUMPORA SP. NOV , 2012, Journal of phycology.

[3]  Yibo Zhang,et al.  Extended depth-of-field in holographic image reconstruction using deep learning based auto-focusing and phase-recovery , 2018, Optica.

[4]  James R. Fienup,et al.  Phase-retrieval stagnation problems and solutions , 1986 .

[5]  N. Poulton,et al.  Imaging flow cytometry for phytoplankton analysis. , 2017, Methods.

[6]  Catherine Yourassowsky,et al.  High throughput holographic imaging-in-flow for the analysis of a wide plankton size range. , 2014, Optics express.

[7]  W Xu,et al.  Digital in-line holography for biological applications , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[8]  C. R. Booth,et al.  Holographic motion pictures of microscopic plankton. , 1978, Applied optics.

[9]  Aydogan Ozcan,et al.  A robust holographic autofocusing criterion based on edge sparsity: comparison of Gini index and Tamura coefficient for holographic autofocusing based on the edge sparsity of the complex optical wavefront , 2017, BiOS.

[10]  M. T. Maldonado,et al.  The effect of Fe and Cu on growth and domoic acid production by Pseudo-nitzschia multiseries and Pseudo‐nitzschia australis , 2002 .

[11]  D.W. Pfitsch,et al.  Development of a free-drifting submersible digital holographic imaging system , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[12]  D. D. Lefebvre,et al.  Algal blooms: proactive strategy. , 2014, Science.

[13]  U. Riebesell,et al.  Influence of ocean acidification on plankton community structure during a winter-to-summer succession: An imaging approach indicates that copepods can benefit from elevated CO2 via indirect food web effects , 2017, PloS one.

[14]  Daniel G. Baden,et al.  Brevetoxicosis: Red tides and marine mammal mortalities , 2005, Nature.

[15]  Victor Smetacek,et al.  On Phytoplankton Trends , 2008, Science.

[16]  A. Ozcan,et al.  Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution , 2010, Optics express.

[17]  Catherine Yourassowsky,et al.  Imaging‐in‐Flow: Digital holographic microscopy as a novel tool to detect and classify nanoplanktonic organisms , 2014 .

[18]  M. Thyssen,et al.  Combining laser diffraction, flow cytometry and optical microscopy to characterize a nanophytoplankton bloom in the northwestern Mediterranean , 2017 .

[19]  D. Kamykowski,et al.  The diurnal vertical migration of motile phytoplankton through temperature gradients1 , 1977 .

[20]  J. Jokela,et al.  An automated platform for phytoplankton ecology and aquatic ecosystem monitoring. , 2011, Environmental science & technology.

[21]  Marten Scheffer,et al.  Chaos in a long-term experiment with a plankton community , 2008, Nature.

[22]  B. Reguera,et al.  Thin layers of Pseudo‐nitzschia spp. and the fate of Dinophysis acuminata during an upwelling‐downwelling cycle in a Galician RÃa , 2008 .

[23]  A. Ozcan,et al.  Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy , 2012, Optics Express.

[24]  Aydogan Ozcan,et al.  Giga-Pixel Lensfree Holographic Microscopy and Tomography Using Color Image Sensors , 2012, PloS one.

[25]  László Orzó,et al.  Special multicolor illumination and numerical tilt correction in volumetric digital holographic microscopy. , 2014, Optics express.

[26]  Aydogan Ozcan,et al.  Edge sparsity criterion for robust holographic autofocusing. , 2017, Optics letters.

[27]  Yibo Zhang,et al.  Phase recovery and holographic image reconstruction using deep learning in neural networks , 2017, Light: Science & Applications.

[28]  F. G. Figueiras,et al.  Evidence of in situ diel vertical migration of a red-tide microplankton species in Ría de Vigo (NW Spain) , 1995 .

[29]  R. Olson,et al.  A submersible imaging‐in‐flow instrument to analyze nano‐and microplankton: Imaging FlowCytobot , 2007 .

[30]  Janet K. Thompson,et al.  A cold phase of the East Pacific triggers new phytoplankton blooms in San Francisco Bay , 2007, Proceedings of the National Academy of Sciences.

[31]  N. Poulton,et al.  FlowCam: Quantification and Classification of Phytoplankton by Imaging Flow Cytometry. , 2016, Methods in molecular biology.

[32]  Christopher B. Field,et al.  Biospheric Primary Production During an ENSO Transition , 2001, Science.

[33]  D. Vaulot,et al.  Estimating microbial populations by flow cytometry: Comparison between instruments , 2016 .

[34]  A. Ozcan,et al.  Synthetic aperture-based on-chip microscopy , 2015, Light: Science & Applications.

[35]  Manfred H. Jericho,et al.  Development and deployment of a point‐source digital inline holographic microscope for the study of plankton and particles to a depth of 6000 m , 2013 .

[36]  G. Pedrini,et al.  Phase retrieval using multiple illumination wavelengths. , 2008, Optics letters.

[37]  R. Olson,et al.  Imaging FlowCytobot modified for high throughput by in‐line acoustic focusing of sample particles , 2017 .

[38]  Wei Luo,et al.  Propagation phasor approach for holographic image reconstruction , 2016, Scientific Reports.

[39]  James M. Sullivan,et al.  Coastal thin layer dynamics: Consequences to biology and optics , 2010 .

[40]  Natasha S. Barteneva,et al.  Imaging Flow Cytometry , 2016, Methods in Molecular Biology.

[41]  L. Artigas,et al.  High-resolution analysis of a North Sea phytoplankton community structure based on in situ flow cytometry observations and potential implication for remote sensing , 2015 .

[42]  A. Ozcan,et al.  Pixel super-resolution using wavelength scanning , 2015, Light: Science & Applications.

[43]  J. Rodenburg,et al.  Movable aperture lensless transmission microscopy: a novel phase retrieval algorithm. , 2004, Physical review letters.

[44]  B. Trask,et al.  Analysis of phytoplankton by flow cytometry. , 2005, Cytometry.

[45]  Robert J. Olson,et al.  An automated submersible flow cytometer for analyzing pico- and nanophytoplankton: FlowCytobot , 2003 .

[46]  J. Randerson,et al.  Primary production of the biosphere: integrating terrestrial and oceanic components , 1998, Science.

[47]  Hongying Zhu,et al.  Holographic opto-fluidic microscopy , 2010, Optics express.

[48]  A. Ozcan,et al.  On-Chip Biomedical Imaging , 2013, IEEE Reviews in Biomedical Engineering.