Eosinophils Instance Object Segmentation on Whole Slide Imaging Using Multi-label Circle Representation

Eosinophilic esophagitis (EoE) is a chronic and relapsing disease characterized by esophageal inflammation. Symptoms of EoE include difficulty swallowing, food impaction, and chest pain which significantly impact the quality of life, resulting in nutritional impairments, social limitations, and psychological distress. The diagnosis of EoE is typically performed with a threshold (15 to 20) of eosinophils (Eos) per high-power field (HPF). Since the current counting process of Eos is a resource-intensive process for human pathologists, automatic methods are desired. Circle representation has been shown as a more precise, yet less complicated, representation for automatic instance cell segmentation such as CircleSnake approach. However, the CircleSnake was designed as a single-label model, which is not able to deal with multi-label scenarios. In this paper, we propose the multi-label CircleSnake model for instance segmentation on Eos. It extends the original CircleSnake model from a single-label design to a multi-label model, allowing segmentation of multiple object types. Experimental results illustrate the CircleSnake model's superiority over the traditional Mask R-CNN model and DeepSnake model in terms of average precision (AP) in identifying and segmenting eosinophils, thereby enabling enhanced characterization of EoE. This automated approach holds promise for streamlining the assessment process and improving diagnostic accuracy in EoE analysis. The source code has been made publicly available at https://github.com/yilinliu610730/EoE.

[1]  A. Bredenoord,et al.  Performance of an Artificial Intelligence Model for Recognition and Quantitation of Histologic Features of Eosinophilic Esophagitis on Biopsy Samples. , 2023, Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc.

[2]  Ethan H. Nguyen,et al.  CircleSnake: Instance Segmentation with Circle Representation , 2022, MLMI@MICCAI.

[3]  Long Lan,et al.  Object-oriented Domain Adaptation for Cell Detection on Pathology Image , 2022, 2022 IEEE 5th International Conference on Information Systems and Computer Aided Education (ICISCAE).

[4]  K. Ravi,et al.  Development and technical validation of an artificial intelligence model for quantitative analysis of histopathologic features of eosinophilic esophagitis , 2022, Journal of pathology informatics.

[5]  Swapna Saturi Review on Machine Learning Techniques for Medical Data Classification and Disease Diagnosis , 2022, Regenerative Engineering and Translational Medicine.

[6]  Garrett A. Osswald,et al.  A Deep Multi-Label Segmentation Network For Eosinophilic Esophagitis Whole Slide Biopsy Diagnostics , 2022, 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[7]  Garrett A. Osswald,et al.  Harnessing artificial intelligence to infer novel spatial biomarkers for the diagnosis of eosinophilic esophagitis , 2022, Frontiers in Medicine.

[8]  Yuankai Huo,et al.  Eosinophilic esophagitis multi-label feature recognition on whole slide imaging using transfer learning , 2022, Medical Imaging.

[9]  Ethan H. Nguyen,et al.  Circle Representation for Medical Object Detection , 2021, IEEE Transactions on Medical Imaging.

[10]  Weijian Chen,et al.  Eosinophil Detection with Modified YOLOv3 Model in Large Pathology Image , 2021, 2021 International Conference on Computer Information Science and Artificial Intelligence (CISAI).

[11]  C. Moskaluk,et al.  DEEP LEARNING TISSUE ANALYSIS DIAGNOSES AND PREDICTS TREATMENT RESPONSE IN EOSINOPHILIC ESOPHAGITIS , 2021, medRxiv.

[12]  R. Pai,et al.  Utilizing Deep Learning to Analyze Whole Slide Images of Colonic Biopsies for Associations Between Eosinophil Density and Clinicopathologic Features in Active Ulcerative Colitis. , 2021, Inflammatory bowel diseases.

[13]  Marc E. Rothenberg,et al.  PECNet: A Deep Multi-Label Segmentation Network for Eosinophilic Esophagitis Biopsy Diagnostics , 2021, ArXiv.

[14]  Garrett A. Osswald,et al.  Machine Learning Approach for Biopsy-Based Identification of Eosinophilic Esophagitis Reveals Importance of Global features , 2021, IEEE Open Journal of Engineering in Medicine and Biology.

[15]  Donald E. Brown,et al.  Advancing Eosinophilic Esophagitis Diagnosis and Phenotype Assessment with Deep Learning Computer Vision , 2021, BIOIMAGING.

[16]  H. Bao,et al.  Deep Snake for Real-Time Instance Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Yong Ren,et al.  Expert-level Diagnosis of Nasal Polyps Using Deep Learning on Whole-slide Imaging. , 2019, The Journal of allergy and clinical immunology.

[18]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[19]  Kelley E. Capocelli,et al.  Updated International Consensus Diagnostic Criteria for Eosinophilic Esophagitis: Proceedings of the AGREE Conference. , 2018, Gastroenterology.

[20]  M. Ortega-Villaizán,et al.  Nucleated red blood cells: Immune cell mediators of the antiviral response , 2018, PLoS pathogens.

[21]  Jeffrey M. Wilson,et al.  Diagnosis and Management of Eosinophilic Esophagitis. , 2018, Immunology and allergy clinics of North America.

[22]  E. Ochfeld,et al.  Eosinophilic esophagitis: a review , 2017 .

[23]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[24]  J. Woosley,et al.  A phenotypic analysis shows that eosinophilic esophagitis is a progressive fibrostenotic disease. , 2014, Gastrointestinal endoscopy.

[25]  M. Mearin,et al.  Management Guidelines of Eosinophilic Esophagitis in Childhood , 2014, Journal of pediatric gastroenterology and nutrition.

[26]  R. Fitzgerald Faculty Opinions recommendation of ACG clinical guideline: Evidenced based approach to the diagnosis and management of esophageal eosinophilia and eosinophilic esophagitis (EoE). , 2013 .

[27]  A. Schoepfer,et al.  Eosinophilic esophagitis: updated consensus recommendations for children and adults. , 2011, The Journal of allergy and clinical immunology.

[28]  A. Mansoor Modern Surgical Pathology , 2010 .

[29]  L. Peterson Clinical Hematology: Theory and Procedures , 1994 .

[30]  Hassan Najadat,et al.  A new approach for detecting eosinophils in the gastrointestinal tract and diagnosing eosinophilic colitis , 2021, Int. Arab J. Inf. Technol..

[31]  E. Montgomery,et al.  Biopsy interpretation of the gastrointestinal tract mucosa , 2006 .