Computational cytometer based on magnetically modulated coherent imaging and deep learning

Detecting rare cells within blood has numerous applications in disease diagnostics. Existing rare cell detection techniques are typically hindered by their high cost and low throughput. Here, we present a computational cytometer based on magnetically modulated lensless speckle imaging, which introduces oscillatory motion to the magnetic-bead-conjugated rare cells of interest through a periodic magnetic force and uses lensless time-resolved holographic speckle imaging to rapidly detect the target cells in three dimensions (3D). In addition to using cell-specific antibodies to magnetically label target cells, detection specificity is further enhanced through a deep-learning-based classifier that is based on a densely connected pseudo-3D convolutional neural network (P3D CNN), which automatically detects rare cells of interest based on their spatio-temporal features under a controlled magnetic force. To demonstrate the performance of this technique, we built a high-throughput, compact and cost-effective prototype for detecting MCF7 cancer cells spiked in whole blood samples. Through serial dilution experiments, we quantified the limit of detection (LoD) as 10 cells per millilitre of whole blood, which could be further improved through multiplexing parallel imaging channels within the same instrument. This compact, cost-effective and high-throughput computational cytometer can potentially be used for rare cell detection and quantification in bodily fluids for a variety of biomedical applications.Deep Learning Cytometry: Magnetically modulating rare cells for high-throughput detectionRare cells of medical significance can be detected in blood by a high-throughput imaging technique that analyzes movements of magnetically-labelled target cells using deep-learning. Analysis of magnetically-modulated light interference using an artificial neural network enhances the ability of the system to specifically and sensitively detect the tagged cells as they respond to a periodically changing magnetic field. Researchers in the USA, led by Aydogan Ozcan at the University of California, Los Angeles, demonstrated the technique using rare cancer cells added to blood. They achieved a detection limit as low as ten cells per milliliter. The optical system uses a holographic process called speckle imaging, which is much more compact and achieves higher throughput than traditional methods. It holds significant potential for the rapid analysis of blood and other bodily fluids to diagnose and monitor disease.

[1]  Minseok S Kim,et al.  Highly efficient assay of circulating tumor cells by selective sedimentation with a density gradient medium and microfiltration from whole blood. , 2012, Analytical chemistry.

[2]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[3]  Yibo Zhang,et al.  Deep learning-based super-resolution in coherent imaging systems , 2018, Scientific Reports.

[4]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[5]  Maciej Zborowski,et al.  Rare cell separation and analysis by magnetic sorting. , 2011, Analytical chemistry.

[6]  Yibo Zhang,et al.  Phase recovery and holographic image reconstruction using deep learning in neural networks , 2017, Light: Science & Applications.

[7]  A. Ozcan,et al.  Pixel super-resolution using wavelength scanning , 2015, Light: Science & Applications.

[8]  Ana M Soto,et al.  The microenvironment determines the breast cancer cells' phenotype: organization of MCF7 cells in 3D cultures , 2010, BMC Cancer.

[9]  Shuai Li,et al.  Lensless computational imaging through deep learning , 2017, ArXiv.

[10]  Aydogan Ozcan,et al.  Increased space-bandwidth product in pixel super-resolved lensfree on-chip microscopy , 2013, Scientific Reports.

[11]  Loic A. Royer,et al.  Content-aware image restoration: pushing the limits of fluorescence microscopy , 2018, Nature Methods.

[12]  Mark M Davis,et al.  Isolating highly enriched populations of circulating epithelial cells and other rare cells from blood using a magnetic sweeper device , 2009, Proceedings of the National Academy of Sciences.

[13]  André A. Adams,et al.  Microsystems for the capture of low-abundance cells. , 2010, Annual review of analytical chemistry.

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  S. Digumarthy,et al.  Isolation of rare circulating tumour cells in cancer patients by microchip technology , 2007, Nature.

[16]  Yibo Zhang,et al.  Extended depth-of-field in holographic image reconstruction using deep learning based auto-focusing and phase-recovery , 2018, Optica.

[17]  Anna Papst,et al.  Introduction To Magnetism And Magnetic Materials , 2016 .

[18]  Andrea Cossarizza,et al.  Rare Cells: Focus on Detection and Clinical Relevance , 2017 .

[19]  Aydogan Ozcan,et al.  Label-Free Bioaerosol Sensing Using Mobile Microscopy and Deep Learning , 2018, ACS Photonics.

[20]  Wei Wei,et al.  Biomimetic Immuno‐Magnetosomes for High‐Performance Enrichment of Circulating Tumor Cells , 2016, Advanced materials.

[21]  Nam-Trung Nguyen,et al.  Rare cell isolation and analysis in microfluidics. , 2014, Lab on a chip.

[22]  David Issadore,et al.  Issadore Micro-Hall Detector Ultrasensitive Clinical Enumeration of Rare Cells ex Vivo Using a , 2012 .

[23]  Nam Yong Lee,et al.  Rapid and label-free identification of individual bacterial pathogens exploiting three-dimensional quantitative phase imaging and deep learning , 2019, bioRxiv.

[24]  Ulrich H. von Andrian,et al.  Immunosurveillance by Hematopoietic Progenitor Cells Trafficking through Blood, Lymph, and Peripheral Tissues , 2007, Cell.

[25]  Jeffrey N. Anker,et al.  Characterization and Applications of Modulated Optical Nanoprobes (MOONs) , 2003 .

[26]  Rita Strack,et al.  Imaging: AI transforms image reconstruction , 2018, Nature Methods.

[27]  J. Emery,et al.  The Aarhus statement: improving design and reporting of studies on early cancer diagnosis , 2012, British Journal of Cancer.

[28]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[29]  Susana Campuzano,et al.  Micromachine-enabled capture and isolation of cancer cells in complex media. , 2011, Angewandte Chemie.

[30]  Yibo Zhang,et al.  Wide-field computational imaging of pathology slides using lens-free on-chip microscopy , 2014, Science Translational Medicine.

[31]  Clare Whitehead,et al.  A Reappraisal of Circulating Fetal Cell Noninvasive Prenatal Testing. , 2019, Trends in biotechnology.

[32]  Rodrigo Hernández Vera,et al.  Formation of precisely composed cancer cell clusters using a cell assembly generator (CAGE) for studying paracrine signaling at single-cell resolution. , 2019, Lab on a chip.

[33]  Vittorio Bianco,et al.  A deep learning-enabled portable imaging flow cytometer for cost-effective, high-throughput, and label-free analysis of natural water samples , 2018, Light: Science & Applications.

[34]  A. Ozcan,et al.  Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy , 2012, Optics Express.

[35]  Aiguo Wu,et al.  Improved SERS-Active Nanoparticles with Various Shapes for CTC Detection without Enrichment Process with Supersensitivity and High Specificity. , 2016, ACS applied materials & interfaces.

[36]  Eirini Arvaniti,et al.  Sensitive detection of rare disease-associated cell subsets via representation learning , 2016, Nature Communications.

[37]  Yvonne A. Evrard,et al.  Promise and limits of the CellSearch platform for evaluating pharmacodynamics in circulating tumor cells. , 2016, Seminars in oncology.

[38]  Wu Liu,et al.  Rare cell chemiluminescence detection based on aptamer-specific capture in microfluidic channels. , 2011, Biosensors & bioelectronics.

[39]  Aydogan Ozcan,et al.  Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram , 2018, Light: Science & Applications.

[40]  Loic A. Royer,et al.  Content-Aware Image Restoration: Pushing the Limits of Fluorescence Microscopy , 2018, bioRxiv.

[41]  Aaron J Mackey,et al.  Getting More from Less , 2002, Molecular & Cellular Proteomics.

[42]  M. Natan,et al.  Surface-enhanced Raman scattering tags for rapid and homogeneous detection of circulating tumor cells in the presence of human whole blood. , 2008, Journal of the American Chemical Society.

[43]  Jayadeva,et al.  Discovery of rare cells from voluminous single cell expression data , 2018, Nature Communications.

[44]  Anurag Gupta,et al.  Deep neural network improves fracture detection by clinicians , 2018, Proceedings of the National Academy of Sciences.

[45]  Yuanjin Zhao,et al.  Aptamer‐Functionalized Barcode Particles for the Capture and Detection of Multiple Types of Circulating Tumor Cells , 2014, Advanced materials.

[46]  Lei Tian,et al.  Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media , 2018, Optica.

[47]  Aydogan Ozcan,et al.  Wide-field imaging of birefringent synovial fluid crystals using lens-free polarized microscopy for gout diagnosis , 2016, Scientific Reports.

[48]  David J. Beebe,et al.  Circulating Tumor Cells: Getting More from Less , 2012, Science Translational Medicine.

[49]  Joshua Balsam,et al.  Cell streak imaging cytometry for rare cell detection. , 2015, Biosensors & bioelectronics.

[50]  K. Hajian‐Tilaki,et al.  Receiver Operating Characteristic (ROC) Curve Analysis for Medical Diagnostic Test Evaluation. , 2013, Caspian journal of internal medicine.

[51]  Yibo Zhang,et al.  Deep Learning Microscopy , 2017, ArXiv.

[52]  Tao Mei,et al.  Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[53]  Yibo Zhang,et al.  Deep learning enhanced mobile-phone microscopy , 2017, ACS Photonics.

[54]  P. Lakhani,et al.  Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. , 2017, Radiology.

[55]  J. Goodman Introduction to Fourier optics , 1969 .

[56]  Wei-Hua Huang,et al.  Biotin-triggered decomposable immunomagnetic beads for capture and release of circulating tumor cells. , 2015, ACS applied materials & interfaces.

[57]  A. Wu,et al.  Current detection technologies for circulating tumor cells. , 2017, Chemical Society reviews.

[58]  Aydogan Ozcan,et al.  Edge sparsity criterion for robust holographic autofocusing. , 2017, Optics letters.

[59]  Aydogan Ozcan,et al.  A robust holographic autofocusing criterion based on edge sparsity: comparison of Gini index and Tamura coefficient for holographic autofocusing based on the edge sparsity of the complex optical wavefront , 2017, BiOS.

[60]  A. Ozcan,et al.  Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning , 2018, Nature Biomedical Engineering.

[61]  Ki-Ho Han,et al.  Electrical Detection Method for Circulating Tumor Cells Using Graphene Nanoplates. , 2015, Analytical chemistry.

[62]  Yang Yang,et al.  DNA-Oriented Shaping of Cell Features for the Detection of Rare Disseminated Tumor Cells. , 2018, Analytical chemistry.

[63]  Yibo Zhang,et al.  PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning , 2018, Light: Science & Applications.

[64]  A. Ozcan,et al.  Synthetic aperture-based on-chip microscopy , 2015, Light: Science & Applications.

[65]  Robert S. Kerbel,et al.  The multifaceted circulating endothelial cell in cancer: towards marker and target identification , 2006, Nature Reviews Cancer.

[66]  Qinghua Feng,et al.  An automated high-throughput counting method for screening circulating tumor cells in peripheral blood. , 2013, Analytical chemistry.

[67]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[68]  Eric J Topol,et al.  High-performance medicine: the convergence of human and artificial intelligence , 2019, Nature Medicine.

[69]  A. Ozcan,et al.  Deep learning enables cross-modality super-resolution in fluorescence microscopy , 2018, Nature Methods.

[70]  Petra Bacher,et al.  Flow‐cytometric analysis of rare antigen‐specific T cells , 2013, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[71]  Raoul Kopelman,et al.  Aspherical magnetically modulated optical nanoprobes (MagMOONs) , 2003 .

[72]  Aydogan Ozcan,et al.  High-throughput lensfree 3D tracking of human sperms reveals rare statistics of helical trajectories , 2012, Proceedings of the National Academy of Sciences.

[73]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[74]  Vittorio Bianco,et al.  Motility-based label-free detection of parasites in bodily fluids using holographic speckle analysis and deep learning , 2018, Light: Science & Applications.

[75]  Xi Wang,et al.  Evaluating Two-Stream CNN for Video Classification , 2015, ICMR.