Deep-learning-based three-dimensional label-free tracking and analysis of immunological synapses of CAR-T cells

The immunological synapse (IS) is a cell-cell junction between a T cell and a professional antigen-presenting cell. Since the IS formation is a critical step for the initiation of an antigen-specific immune response, various live-cell imaging techniques, most of which rely on fluorescence microscopy, have been used to study the dynamics of IS. However, the inherent limitations associated with the fluorescence-based imaging, such as photo-bleaching and photo-toxicity, prevent the long-term assessment of dynamic changes of IS with high frequency. Here, we propose and experimentally validate a label-free, volumetric, and automated assessment method for IS dynamics using a combinational approach of optical diffraction tomography and deep learning-based segmentation. The proposed method enables an automatic and quantitative spatiotemporal analysis of IS kinetics of morphological and biochemical parameters associated with IS dynamics, providing a new option for immunological research.

[1]  Michael Loran Dustin,et al.  Supramolecular attack particles are autonomous killing entities released from cytotoxic T cells , 2020, Science.

[2]  W. Webb,et al.  Live tissue intrinsic emission microscopy using multiphoton-excited native fluorescence and second harmonic generation , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[3]  J. Trapani,et al.  Chimeric antigen receptor T cells form nonclassical and potent immune synapses driving rapid cytotoxicity , 2018, Proceedings of the National Academy of Sciences.

[4]  Xin Yang,et al.  Pyramid Network with Online Hard Example Mining for Accurate Left Atrium Segmentation , 2018, STACOM@MICCAI.

[5]  Michael W. Davidson,et al.  Actin Depletion Initiates Events Leading to Granule Secretion at the Immunological Synapse , 2015, Immunity.

[6]  S. Uchida Image processing and recognition for biological images , 2013, Development, growth & differentiation.

[7]  YongKeun Park,et al.  Measurements of morphological and biophysical alterations in individual neuron cells associated with early neurotoxic effects in Parkinson's disease , 2017, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[8]  YongKeun Park,et al.  Simultaneous 3D visualization and position tracking of optically trapped particles using optical diffraction tomography , 2015 .

[9]  Fabian Rudolf,et al.  Accurate cell segmentation in microscopy images using membrane patterns , 2014, Bioinform..

[10]  D. Davis,et al.  The immune synapse clears and excludes molecules above a size threshold , 2014, Nature Communications.

[11]  YongKeun Park,et al.  Time-multiplexed structured illumination using a DMD for optical diffraction tomography. , 2017, Optics letters.

[12]  H. Calderon,et al.  Engineering and Design of Chimeric Antigen Receptors , 2018, Molecular therapy. Methods & clinical development.

[13]  Seungwoo Shin,et al.  Generalized quantification of three-dimensional resolution in optical diffraction tomography using the projection of maximal spatial bandwidths. , 2018, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  Yongkeun Park,et al.  Refractive index maps and membrane dynamics of human red blood cells parasitized by Plasmodium falciparum , 2008, Proceedings of the National Academy of Sciences.

[15]  Jong Chul Ye,et al.  Comparative study of iterative reconstruction algorithms for missing cone problems in optical diffraction tomography. , 2015, Optics express.

[16]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Ying S Hu,et al.  Superresolution imaging reveals nanometer- and micrometer-scale spatial distributions of T-cell receptors in lymph nodes , 2016, Proceedings of the National Academy of Sciences.

[18]  Weiyang Jin,et al.  Cytotoxic T Cells Use Mechanical Force to Potentiate Target Cell Killing , 2016, Cell.

[19]  M. Huse,et al.  Mechanical Communication at the Immunological Synapse. , 2017, Trends in cell biology.

[20]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[21]  W. R. Wiley,et al.  Three-Dimensional Vibrational Imaging by Coherent Anti-Stokes Raman Scattering , 1999 .

[22]  Im,et al.  Correlative three-dimensional fluorescence and refractive index tomography : bridging the gap between molecular specificity and quantitative bioimaging , 2017 .

[23]  Michael Loran Dustin,et al.  The immunological synapse , 2002, Arthritis research.

[24]  YongKeun Park,et al.  Identification of non-activated lymphocytes using three-dimensional refractive index tomography and machine learning , 2017, Scientific Reports.

[25]  YongKeun Park,et al.  Three-dimensional label-free imaging and analysis of Pinus pollen grains using optical diffraction tomography , 2018, Scientific Reports.

[26]  C. Depeursinge,et al.  Quantitative phase imaging in biomedicine , 2012, 2012 Conference on Lasers and Electro-Optics (CLEO).

[27]  Jeffrey R. Whiteaker,et al.  Phosphoproteomic analysis of chimeric antigen receptor signaling reveals kinetic and quantitative differences that affect cell function , 2018, Science Signaling.

[28]  C. Black,et al.  Interfacial actin protrusions mechanically enhance killing by cytotoxic T cells , 2019, Science Immunology.

[29]  M. Gustafsson,et al.  Three-dimensional resolution doubling in wide-field fluorescence microscopy by structured illumination. , 2008, Biophysical journal.

[30]  YongKeun Park,et al.  Active illumination using a digital micromirror device for quantitative phase imaging. , 2015, Optics letters.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Michel Sadelain,et al.  The pharmacology of second-generation chimeric antigen receptors , 2015, Nature Reviews Drug Discovery.

[33]  M. Moser Faculty Opinions recommendation of Polarized release of T-cell-receptor-enriched microvesicles at the immunological synapse. , 2014 .

[34]  Mortazavi,et al.  Supporting Online Material Materials and Methods Figs. S1 to S13 Tables S1 to S3 References Label-free Biomedical Imaging with High Sensitivity by Stimulated Raman Scattering Microscopy , 2022 .

[35]  Ron Kikinis,et al.  Automatic Optimization of Segmentation Algorithms Through Simultaneous Truth and Performance Level Estimation (STAPLE) , 2004, MICCAI.

[36]  Atsushi Matsuda,et al.  Strategic and practical guidelines for successful structured illumination microscopy , 2017, Nature Protocols.

[37]  A. Devaney Inverse-scattering theory within the Rytov approximation. , 1981, Optics letters.

[38]  Cordelia Schmid,et al.  IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2004, Washington, DC, USA, June 27 - July 2, 2004 , 2004, CVPR Workshops.

[39]  M. Neil,et al.  Remodelling of Cortical Actin Where Lytic Granules Dock at Natural Killer Cell Immune Synapses Revealed by Super-Resolution Microscopy , 2011, PLoS biology.

[40]  Min Xu,et al.  Learn to segment single cells with deep distance estimator and deep cell detector , 2018, Comput. Biol. Medicine.

[41]  YongKeun Park,et al.  Super-resolution three-dimensional fluorescence and optical diffraction tomography of live cells using structured illumination generated by a digital micromirror device , 2018, Scientific Reports.

[42]  Kyoohyun Kim,et al.  Three-dimensional label-free imaging and quantification of lipid droplets in live hepatocytes , 2016, Scientific Reports.

[43]  J. Orange,et al.  Quantitative Imaging Approaches to Study the CAR Immunological Synapse. , 2017, Molecular therapy : the journal of the American Society of Gene Therapy.

[44]  D. Goulding,et al.  The Size of the Synaptic Cleft and Distinct Distributions of Filamentous Actin, Ezrin, CD43, and CD45 at Activating and Inhibitory Human NK Cell Immune Synapses 12 , 2003, The Journal of Immunology.

[45]  MaYi,et al.  Segmentation of Natural Images by Texture and Boundary Compression , 2011 .

[46]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[47]  Yu Cao,et al.  Switch-mediated activation and retargeting of CAR-T cells for B-cell malignancies , 2016, Proceedings of the National Academy of Sciences.

[48]  V. Lauer New approach to optical diffraction tomography yielding a vector equation of diffraction tomography and a novel tomographic microscope , 2002, Journal of microscopy.

[49]  Tayeb Mohamadi,et al.  A comparative study of Image Region-Based Segmentation Algorithms , 2013 .

[50]  Stavroula Skylaki,et al.  Challenges in long-term imaging and quantification of single-cell dynamics , 2016, Nature Biotechnology.

[51]  Wesley R. Legant,et al.  Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution , 2014, Science.

[52]  Colin R. F. Monks,et al.  Three-dimensional segregation of supramolecular activation clusters in T cells , 1998, Nature.

[53]  Hossein Mobahi,et al.  Segmentation of Natural Images by Texture and Boundary Compression , 2011, International Journal of Computer Vision.

[54]  R. Barer,et al.  Refractometry of Living Cells , 1952, Nature.

[55]  Jonathan Bailleul,et al.  Tomographic diffractive microscopy with isotropic resolution , 2017 .

[56]  YongKeun Park,et al.  Tomographic active optical trapping of arbitrarily shaped objects by exploiting 3D refractive index maps , 2017, Nature communications.

[57]  Yongkeun Park,et al.  Three-dimensional label-free imaging and quantification of migrating cells during wound healing. , 2020, Biomedical optics express.

[58]  K R Wilson,et al.  Third harmonic generation microscopy. , 1998, Optics express.

[59]  Kyoohyun Kim,et al.  Optical diffraction tomography techniques for the study of cell pathophysiology , 2016, 1603.00592.

[60]  Wolfgang Hübner,et al.  Open-source image reconstruction of super-resolution structured illumination microscopy data in ImageJ , 2016, Nature Communications.

[61]  E. Wolf Three-dimensional structure determination of semi-transparent objects from holographic data , 1969 .

[62]  Valarie A. Barr,et al.  Imaging techniques for assaying lymphocyte activation in action , 2010, Nature Reviews Immunology.

[63]  Yi-Hsin Hsu,et al.  Immunological Synapse Predicts Effectiveness of Chimeric Antigen Receptor Cells , 2018, Molecular therapy : the journal of the American Society of Gene Therapy.

[64]  Yuichiro Hayashi,et al.  Hierarchical 3D fully convolutional networks for multi-organ segmentation , 2017, ArXiv.