Integrated digital pathology at scale: A solution for clinical diagnostics and cancer research at a large academic medical center

Abstract Objective Broad adoption of digital pathology (DP) is still lacking, and examples for DP connecting diagnostic, research, and educational use cases are missing. We blueprint a holistic DP solution at a large academic medical center ubiquitously integrated into clinical workflows; researchapplications including molecular, genetic, and tissue databases; and educational processes. Materials and Methods We built a vendor-agnostic, integrated viewer for reviewing, annotating, sharing, and quality assurance of digital slides in a clinical or research context. It is the first homegrown viewer cleared by New York State provisional approval in 2020 for primary diagnosis and remote sign-out during the COVID-19 (coronavirus disease 2019) pandemic. We further introduce an interconnected Honest Broker for BioInformatics Technology (HoBBIT) to systematically compile and share large-scale DP research datasets including anonymized images, redacted pathology reports, and clinical data of patients with consent. Results The solution has been operationally used over 3 years by 926 pathologists and researchers evaluating 288 903 digital slides. A total of 51% of these were reviewed within 1 month after scanning. Seamless integration of the viewer into 4 hospital systems clearly increases the adoption of DP. HoBBIT directly impacts the translation of knowledge in pathology into effective new health measures, including artificial intelligence–driven detection models for prostate cancer, basal cell carcinoma, and breast cancer metastases, developed and validated on thousands of cases. Conclusions We highlight major challenges and lessons learned when going digital to provide orientation for other pathologists. Building interconnected solutions will not only increase adoption of DP, but also facilitate next-generation computational pathology at scale for enhanced cancer research.

[1]  Thomas J. Fuchs,et al.  Overcoming an Annotation Hurdle: Digitizing Pen Annotations from Whole Slide Images , 2021, Journal of pathology informatics.

[2]  Jakob Nikolas Kather,et al.  Deep learning in cancer pathology: a new generation of clinical biomarkers , 2020, British Journal of Cancer.

[3]  A. Madabhushi,et al.  A prognostic model for overall survival of patients with early-stage non-small cell lung cancer: a multicentre, retrospective study , 2020, The Lancet. Digital health.

[4]  Yonghong He,et al.  Predict Ki-67 Positive Cells in H&E-Stained Images Using Deep Learning Independently From IHC-Stained Images , 2020, Frontiers in Molecular Biosciences.

[5]  Liron Pantanowitz,et al.  An artificial intelligence algorithm for prostate cancer diagnosis in whole slide images of core needle biopsies: a blinded clinical validation and deployment study. , 2020, The Lancet. Digital health.

[6]  Thomas J. Fuchs,et al.  Deep Interactive Learning: An Efficient Labeling Approach for Deep Learning-Based Osteosarcoma Treatment Response Assessment , 2020, MICCAI.

[7]  James Y. Zou,et al.  Integrating spatial gene expression and breast tumour morphology via deep learning , 2020, Nature Biomedical Engineering.

[8]  Bin Xu,et al.  Validation of a digital pathology system including remote review during the COVID-19 pandemic , 2020, Modern Pathology.

[9]  R. Feddersen,et al.  Digital Whole Slide Imaging Compared With Light Microscopy for Primary Diagnosis in Surgical Pathology: A Multicenter, Double-Blinded, Randomized Study of 2045 Cases. , 2020, Archives of pathology & laboratory medicine.

[10]  Ilaria Girolami,et al.  Current state of whole slide imaging use in cytopathology: Pros and pitfalls , 2020, Cytopathology : official journal of the British Society for Clinical Cytology.

[11]  J. Aneiros-Fernández,et al.  Complete Digital Pathology for Routine Histopathology Diagnosis in a Multicenter Hospital Network. , 2020, Archives of pathology & laboratory medicine.

[12]  W. Khalbuss,et al.  Whole slide imaging compared with light microscopy for primary diagnosis in surgical neuropathology: a validation study , 2020, Annals of Saudi medicine.

[13]  L. Pantanowitz,et al.  Diagnostic concordance between whole slide imaging and conventional light microscopy in cytopathology: A systematic review , 2020, Cancer cytopathology.

[14]  Morteza Babaie,et al.  Pan-cancer diagnostic consensus through searching archival histopathology images using artificial intelligence , 2019, npj Digital Medicine.

[15]  Thomas J. Fuchs,et al.  Deep Multi-Magnification Networks for Multi-Class Breast Cancer Image Segmentation , 2019, Comput. Medical Imaging Graph..

[16]  W. Dean Wallace,et al.  The California Telepathology Service: UCLA's Experience in Deploying a Regional Digital Pathology Subspecialty Consultation Network , 2019, Journal of pathology informatics.

[17]  A. Madabhushi,et al.  Artificial intelligence in digital pathology — new tools for diagnosis and precision oncology , 2019, Nature reviews. Clinical oncology.

[18]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[19]  Nikolas Stathonikos,et al.  Being fully digital: perspective of a Dutch academic pathology laboratory , 2019, Histopathology.

[20]  M. Friedlander,et al.  Accuracy of Intraoperative Frozen Section of Sentinel Lymph Nodes After Neoadjuvant Chemotherapy for Breast Carcinoma , 2019, The American journal of surgical pathology.

[21]  Yukako Yagi,et al.  Implementation of Digital Pathology Offers Clinical and Operational Increase in Efficiency and Cost Savings. , 2019, Archives of pathology & laboratory medicine.

[22]  T. Itoh,et al.  A validation study of whole slide imaging for primary diagnosis of lymphoma , 2019, Pathology international (Print).

[23]  M. Gurcan,et al.  Digital pathology and artificial intelligence. , 2019, The Lancet. Oncology.

[24]  Michalis Doukas,et al.  Towards Unsupervised Cancer Subtyping: Predicting Prognosis Using A Histologic Visual Dictionary , 2019, ArXiv.

[25]  Thomas J. Fuchs,et al.  Whole slide imaging equivalency and efficiency study: experience at a large academic center , 2019, Modern Pathology.

[26]  Tae-Yeong Kwak,et al.  Artificial Intelligence in Pathology , 2018, Journal of pathology and translational medicine.

[27]  Thomas J. Fuchs,et al.  VOCA: Cell Nuclei Detection In Histopathology Images By Vector Oriented Confidence Accumulation , 2018, MIDL.

[28]  Aleksandar Vodovnik,et al.  Complete Routine Remote Digital Pathology Services , 2018, Journal of pathology informatics.

[29]  Liron Pantanowitz,et al.  Validation of Remote Digital Frozen Sections for Cancer and Transplant Intraoperative Services , 2018, Journal of pathology informatics.

[30]  Ichiro Maeda,et al.  Whole‐slide imaging at primary pathological diagnosis: Validation of whole‐slide imaging‐based primary pathological diagnosis at twelve Japanese academic institutes , 2017, Pathology international.

[31]  Clive R. Taylor,et al.  Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology , 2017, The American journal of surgical pathology.

[32]  Yukako Yagi,et al.  Towards machine learned quality control: A benchmark for sharpness quantification in digital pathology , 2017, Comput. Medical Imaging Graph..

[33]  Darren Treanor,et al.  Future-proofing pathology: the case for clinical adoption of digital pathology , 2017, Journal of Clinical Pathology.

[34]  A. Evans,et al.  Implementation of Whole Slide Imaging for Clinical Purposes: Issues to Consider From the Perspective of Early Adopters. , 2017, Archives of pathology & laboratory medicine.

[35]  W. Alago,et al.  Robotic Telecytology for Remote Cytologic Evaluation without an On-site Cytotechnologist or Cytopathologist: A Tale of Implementation and Review of Constraints , 2017, Journal of pathology informatics.

[36]  Linda G. Shapiro,et al.  A Randomized Study Comparing Digital Imaging to Traditional Glass Slide Microscopy for Breast Biopsy and Cancer Diagnosis , 2017, Journal of pathology informatics.

[37]  Andrew J. Schaumberg,et al.  DeepScope: Nonintrusive Whole Slide Saliency Annotation and Prediction from Pathologists at the Microscope , 2016, bioRxiv.

[38]  Thomas J. Fuchs,et al.  Mitochondria-based Renal Cell Carcinoma Subtyping: Learning from Deep vs. Flat Feature Representations , 2016, MLHC.

[39]  Yee-Wah Tsang,et al.  Validation of digital pathology imaging for primary histopathological diagnosis , 2016, Histopathology.

[40]  Puay Hoon Tan,et al.  Enabling digital pathology in the diagnostic setting: navigating through the implementation journey in an academic medical centre , 2016, Journal of Clinical Pathology.

[41]  D. Milner,et al.  Implementation and Validation of Telepathology Triage at Cancer Referral Center in Rural Rwanda , 2016, Journal of global oncology.

[42]  Donavan T. Cheng,et al.  Memorial Sloan Kettering-Integrated Mutation Profiling of Actionable Cancer Targets (MSK-IMPACT): A Hybridization Capture-Based Next-Generation Sequencing Clinical Assay for Solid Tumor Molecular Oncology. , 2015, The Journal of molecular diagnostics : JMD.

[43]  Aleksandar Vodovnik,et al.  Distance reporting in digital pathology: A study on 950 cases , 2015, Journal of pathology informatics.

[44]  G. Paré,et al.  The Eastern Québec Telepathology Network: a three-year experience of clinical diagnostic services , 2014, Diagnostic Pathology.

[45]  Matteo Brunelli,et al.  iPathology cockpit diagnostic station: validation according to College of American Pathologists Pathology and Laboratory Quality Center recommendation at the Hospital Trust and University of Verona , 2014, Diagnostic Pathology.

[46]  Chen Zhou,et al.  A nationwide telepathology consultation and quality control program in China: implementation and result analysis , 2014, Diagnostic Pathology.

[47]  Joseph P Houghton,et al.  Concordance between digital pathology and light microscopy in general surgical pathology: a pilot study of 100 cases , 2014, Journal of Clinical Pathology.

[48]  Richard J. Cote,et al.  Intra-observer reproducibility of whole slide imaging for the primary diagnosis of breast needle biopsies , 2014, Journal of pathology informatics.

[49]  Thomas P. Buck,et al.  Validation of a whole slide imaging system for primary diagnosis in surgical pathology: A community hospital experience , 2014, Journal of pathology informatics.

[50]  Alexis B. Carter,et al.  Validating whole slide imaging for diagnostic purposes in pathology: guideline from the College of American Pathologists Pathology and Laboratory Quality Center. , 2013, Archives of pathology & laboratory medicine.

[51]  Benjamin E. Gross,et al.  Integrative Analysis of Complex Cancer Genomics and Clinical Profiles Using the cBioPortal , 2013, Science Signaling.

[52]  Walter H Henricks,et al.  Validation of whole slide imaging for primary diagnosis in surgical pathology. , 2013, Archives of pathology & laboratory medicine.

[53]  Mahadev Satyanarayanan,et al.  OpenSlide: A vendor-neutral software foundation for digital pathology , 2013, Journal of pathology informatics.

[54]  Liron Pantanowitz,et al.  Relationship between magnification and resolution in digital pathology systems , 2013, Journal of pathology informatics.

[55]  Shaimaa Al-Janabi,et al.  Whole slide images as a platform for initial diagnostics in histopathology in a medium-sized routine laboratory , 2012, Journal of Clinical Pathology.

[56]  W Scott Campbell,et al.  Concordance between whole-slide imaging and light microscopy for routine surgical pathology. , 2012, Human pathology.

[57]  Benjamin E. Gross,et al.  The cBio cancer genomics portal: an open platform for exploring multidimensional cancer genomics data. , 2012, Cancer discovery.

[58]  Liron Pantanowitz,et al.  Experience with multimodality telepathology at the University of Pittsburgh Medical Center , 2012, Journal of pathology informatics.

[59]  Anil V Parwani,et al.  Clinical examination and validation of primary diagnosis in anatomic pathology using whole slide digital images. , 2011, Archives of pathology & laboratory medicine.

[60]  L. Pantanowitz Digital images and the future of digital pathology , 2010, Journal of pathology informatics.

[61]  Mari Mino-Kenudson,et al.  Whole-slide imaging digital pathology as a platform for teleconsultation: a pilot study using paired subspecialist correlations. , 2009, Archives of pathology & laboratory medicine.

[62]  Yukako Yagi,et al.  Primary histologic diagnosis using automated whole slide imaging: a validation study , 2006, BMC clinical pathology.

[63]  Yukako Yagi,et al.  Digital imaging in pathology: the case for standardization , 2005, Journal of telemedicine and telecare.

[64]  J. Gilbertson,et al.  Evaluation of a deidentification (De-Id) software engine to share pathology reports and clinical documents for research. , 2004, American journal of clinical pathology.

[65]  Rebecca Randell,et al.  The Diagnostic Concordance of Whole Slide Imaging and Light Microscopy: A Systematic Review. , 2017, Archives of pathology & laboratory medicine.