Graph-based description of tertiary lymphoid organs at single-cell level

Our aim is to complement observer-dependent approaches of immune cell evaluation in microscopy images with reproducible measures for spatial composition of lymphocytic infiltrates. Analyzing such patterns of inflammation is becoming increasingly important for therapeutic decisions, for example in transplantation medicine or cancer immunology. We developed a graph-based assessment of lymphocyte clustering in full whole slide images. Based on cell coordinates detected in the full image, a Delaunay triangulation and distance criteria are used to build neighborhood graphs. The composition of nodes and edges are used for classification, e.g. using a support vector machine. We describe the variability of these infiltrates on CD3/CD20 duplex staining in renal biopsies of long-term functioning allografts, in breast cancer cases, and in lung tissue of cystic fibrosis patients. The assessment includes automated cell detection, identification of regions of interest, and classification of lymphocytic clusters according to their degree of organization. We propose a neighborhood feature which considers the occurrence of edges with a certain type in the graph to distinguish between phenotypically different immune infiltrates. Our work addresses a medical need and provides a scalable framework that can be easily adjusted to the requirements of different research questions.

[1]  Daniel Racoceanu,et al.  Spatial interaction analysis with graph based mathematical morphology for histopathology , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[2]  Germain Forestier,et al.  Detection of lobular structures in normal breast tissue , 2016, Comput. Biol. Medicine.

[3]  Su-Jin Shin,et al.  Tertiary lymphoid structures: prognostic significance and relationship with tumour-infiltrating lymphocytes in triple-negative breast cancer , 2015, Journal of Clinical Pathology.

[4]  Tilo Beyer,et al.  Cell transmembrane receptors determine tissue pattern stability. , 2008, Physical review letters.

[5]  Simon A. Jones,et al.  Ectopic lymphoid-like structures in infection, cancer and autoimmunity , 2014, Nature Reviews Immunology.

[6]  R. Pabst,et al.  Is the bronchus-associated lymphoid tissue (BALT) an integral structure of the lung in normal mammals, including humans? , 1990, American journal of respiratory cell and molecular biology.

[7]  J. Anitha,et al.  Modified Genetic Algorithm approaches for classification of abnormal Magnetic Resonance Brain tumour images , 2019, Appl. Soft Comput..

[8]  Nina Linder,et al.  Exploring the spatial dimension of estrogen and progesterone signaling: detection of nuclear labeling in lobular epithelial cells in normal mammary glands adjacent to breast cancer , 2014, Diagnostic Pathology.

[9]  L. Touqui,et al.  Bacteria-driven peribronchial lymphoid neogenesis in bronchiectasis and cystic fibrosis , 2017, European Respiratory Journal.

[10]  K. Leslie,et al.  Pleuropulmonary pathology in patients with rheumatic disease. , 2012, Archives of pathology & laboratory medicine.

[11]  Mengjie Zhang,et al.  Evolving Deep Convolutional Neural Networks for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[12]  Nilanjan Dey,et al.  Classification and Clustering in Biomedical Signal Processing , 2016 .

[13]  M. Gaxiola,et al.  Inducible bronchus-associated lymphoid tissue (iBALT) in patients with pulmonary complications of rheumatoid arthritis. , 2006, The Journal of clinical investigation.

[14]  Antonio Criminisi,et al.  Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes , 2009 .

[15]  Q. Wang,et al.  Characterisation of Tertiary Lymphoid Organs in Explanted Rejected Donor Kidneys , 2016, Immunological investigations.

[16]  A. Barabasi,et al.  Network biology: understanding the cell's functional organization , 2004, Nature Reviews Genetics.

[17]  R. Pabst,et al.  Bronchus-associated lymphoid tissue: an entry site for antigens for successful mucosal vaccinations? , 2010, American journal of respiratory cell and molecular biology.

[18]  T. Nielsen,et al.  The evaluation of tumor-infiltrating lymphocytes (TILs) in breast cancer: recommendations by an International TILs Working Group 2014. , 2015, Annals of oncology : official journal of the European Society for Medical Oncology.

[19]  T. Muthukumar,et al.  The Banff 2015 Kidney Meeting Report: Current Challenges in Rejection Classification and Prospects for Adopting Molecular Pathology , 2016, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[20]  Kenji Suzuki,et al.  Pixel-Based Machine Learning in Medical Imaging , 2012, Int. J. Biomed. Imaging.

[21]  Michael Meyer-Hermann,et al.  Germinal Center Dynamics Revealed by Multiphoton Microscopy with a Photoactivatable Fluorescent Reporter , 2010, Cell.

[22]  Nicolas Brieu,et al.  Slide-specific models for segmentation of differently stained digital histopathology whole slide images , 2016, SPIE Medical Imaging.

[23]  N. Ruddle,et al.  Follicular dendritic cells, conduits, lymphatic vessels, and high endothelial venules in tertiary lymphoid organs: Parallels with lymph node stroma , 2012, Front. Immun..

[24]  J. Cyster,et al.  Germinal-center organization and cellular dynamics. , 2007, Immunity.

[25]  E. Aikawa,et al.  Cardiovascular calcification: artificial intelligence and big data accelerate mechanistic discovery , 2018, Nature Reviews Cardiology.

[26]  Germain Forestier,et al.  Crowdsourcing of Histological Image Labeling and Object Delineation by Medical Students , 2019, IEEE Transactions on Medical Imaging.

[27]  L. Pape,et al.  Chemokine CXCL13 as a New Systemic Biomarker for B-Cell Involvement in Acute T Cell-Mediated Kidney Allograft Rejection , 2019, International journal of molecular sciences.

[28]  Ina Koch,et al.  CD30 cell graphs of Hodgkin lymphoma are not scale-free - an image analysis approach , 2015, Bioinform..

[29]  H. Müller-Hermelink,et al.  Immunohistochemical analysis of proliferating and antigen-presenting cells in rheumatoid synovial tissue , 2004, Rheumatology International.

[30]  M. Meyer-Hermann,et al.  Mechanisms of organogenesis of primary lymphoid follicles. , 2006, International immunology.

[31]  K. Mekeel,et al.  Impact of Subclinical Inflammation on the Development of Interstitial Fibrosis and Tubular Atrophy in Kidney Transplant Recipients , 2010, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[32]  J. Bourhis,et al.  Cellular Composition and Contribution of Tertiary Lymphoid Structures to Tumor Immune Infiltration and Modulation by Radiation Therapy , 2018, Front. Oncol..

[33]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[34]  B. Barnes,et al.  Role of Tertiary Lymphoid Structures (TLS) in Anti-Tumor Immunity: Potential Tumor-Induced Cytokines/Chemokines that Regulate TLS Formation in Epithelial-Derived Cancers , 2014, Cancers.

[35]  Cigdem Demir,et al.  Augmented cell-graphs for automated cancer diagnosis , 2005, ECCB/JBI.

[36]  Nilanjan Dey,et al.  A Survey of Data Mining and Deep Learning in Bioinformatics , 2018, Journal of Medical Systems.

[37]  H. Lee,et al.  Presence of tertiary lymphoid structures determines the level of tumor-infiltrating lymphocytes in primary breast cancer and metastasis , 2018, Modern Pathology.

[38]  O. Thaunat Pathophysiologic Significance of B-Cell Clusters in Chronically Rejected Grafts , 2011, Transplantation.

[39]  G. Wieczorek,et al.  Blockade of CD40–CD154 pathway interactions suppresses ectopic lymphoid structures and inhibits pathology in the NOD/ShiLtJ mouse model of Sjögren’s syndrome , 2019, Annals of the rheumatic diseases.

[40]  A. Schwarz,et al.  Infiltrates in Protocol Biopsies from Renal Allografts , 2007, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[41]  Thomas Filleron,et al.  Human solid tumors contain high endothelial venules: association with T- and B-lymphocyte infiltration and favorable prognosis in breast cancer. , 2011, Cancer research.

[42]  Cigdem Demir,et al.  The cell graphs of cancer , 2004, ISMB/ECCB.

[43]  R. Pabst Is BALT a major component of the human lung immune system? , 1992, Immunology today.

[44]  H. Hammad,et al.  Tertiary lymphoid organs in infection and autoimmunity , 2012, Trends in Immunology.

[45]  Antonio Córdoba,et al.  Complex Networks Evolutionary Dynamics Using Genetic Algorithms , 2012, Int. J. Bifurc. Chaos.

[46]  C. Pilette,et al.  Lung lymphoid neogenesis in cystic fibrosis: a model of adaptive responses to bacteria? , 2017, European Respiratory Journal.

[47]  C. Sautès-Fridman,et al.  Tertiary lymphoid structures, drivers of the anti‐tumor responses in human cancers , 2016, Immunological reviews.

[48]  M. Stegall,et al.  Fibrosis with inflammation at one year predicts transplant functional decline. , 2010, Journal of the American Society of Nephrology : JASN.

[49]  Dagmar Iber,et al.  An analysis of B cell selection mechanisms in germinal centers. , 2006, Mathematical medicine and biology : a journal of the IMA.

[50]  G. Jhangri,et al.  Scoring Total Inflammation Is Superior to the Current Banff Inflammation Score in Predicting Outcome and the Degree of Molecular Disturbance in Renal Allografts , 2009, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[51]  Hao Wu,et al.  An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine , 2011, Knowl. Based Syst..

[52]  Yoshihiro Hirohashi,et al.  Segmental HOG: new descriptor for glomerulus detection in kidney microscopy image , 2015, BMC Bioinformatics.

[53]  Nicolas Loménie,et al.  Point set morphological filtering and semantic spatial configuration modeling: Application to microscopic image and bio-structure analysis , 2012, Pattern Recognit..

[54]  F. Meyer,et al.  Germinal center analysis with the tools of mathematical morphology on graphs. , 1993, Cytometry.