Deep Learning within a DICOM WSI Viewer for Histopathology

Microscopy scanners and artificial intelligence (AI) techniques have facilitated remarkable advancements in biomedicine. Incorporating these advancements into clinical practice is, however, hampered by the variety of digital file formats used, which poses a significant challenge for data processing. Open-source and commercial software solutions have attempted to address proprietary formats, but they fall short of providing comprehensive access to vital clinical information beyond image pixel data. The proliferation of competing proprietary formats makes the lack of interoperability even worse. DICOM stands out as a standard that transcends internal image formats via metadata-driven image exchange in this context. DICOM defines imaging workflow information objects for images, patients’ studies, reports, etc. DICOM promises standards-based pathology imaging, but its clinical use is limited. No FDA-approved digital pathology system natively generates DICOM, and only one high-performance whole slide images (WSI) device has been approved for diagnostic use in Asia and Europe. In a recent series of Digital Pathology Connectathons, the interoperability of our solution was demonstrated by integrating DICOM digital pathology imaging, i.e., WSI, into PACs and enabling their visualisation. However, no system that incorporates state-of-the-art AI methods and directly applies them to DICOM images has been presented. In this paper, we present the first web viewer system that employs WSI DICOM images and AI models. This approach aims to bridge the gap by integrating AI methods with DICOM images in a seamless manner, marking a significant step towards more effective CAD WSI processing tasks. Within this innovative framework, convolutional neural networks, including well-known architectures such as AlexNet and VGG, have been successfully integrated and evaluated.

[1]  Azamossadat Hosseini,et al.  A mobile application based on efficient lightweight CNN model for classification of B-ALL cancer from non-cancerous cells: A design and implementation study , 2023, Informatics in Medicine Unlocked.

[2]  M. B. Andersen,et al.  Autonomous Chest Radiograph Reporting Using AI: Estimation of Clinical Impact. , 2023, Radiology.

[3]  Mohammad Ali Heravi,et al.  Deep learning: Applications, architectures, models, tools, and frameworks: A comprehensive survey , 2023, CAAI Transactions on Intelligence Technology.

[4]  A. Bouridane,et al.  Survey of Explainable AI Techniques in Healthcare , 2023, Sensors.

[5]  B. Lindequist,et al.  The vendor-agnostic EMPAIA platform for integrating AI applications into digital pathology infrastructures , 2022, Future Gener. Comput. Syst..

[6]  David B. A. Epstein,et al.  TIAToolbox as an end-to-end library for advanced tissue image analytics , 2022, Communications Medicine.

[7]  Lauren A. Fromont,et al.  Position of the AI for Health Imaging (AI4HI) network on metadata models for imaging biobanks , 2022, European Radiology Experimental.

[8]  Z. Chen,et al.  Artificial Intelligence in Anatomical Pathology: Building A Strong Foundation for Precision Medicine. , 2022, Human pathology.

[9]  Ichiro Mori Current Status of Whole Slide Image (WSI) Standardization in Japan , 2022, Acta Histochemica et Cytochemica.

[10]  D. Fotiadis,et al.  Data Ingestion for AI in Prostate Cancer , 2022, MIE.

[11]  T. Kiehl,et al.  The explainability paradox: Challenges for xAI in digital pathology , 2022, Future Gener. Comput. Syst..

[12]  C. Costa,et al.  DICOMization of Proprietary Files Obtained from Confocal, Whole-Slide, and FIB-SEM Microscope Scanners , 2022, Sensors.

[13]  E. Neri,et al.  CHAIMELEON Project: Creation of a Pan-European Repository of Health Imaging Data for the Development of AI-Powered Cancer Management Tools , 2022, Frontiers in Oncology.

[14]  M. Loda,et al.  Building Tools for Machine Learning and Artificial Intelligence in Cancer Research: Best Practices and a Case Study with the PathML Toolkit for Computational Pathology , 2021, Molecular Cancer Research.

[15]  S. Imoto,et al.  HEAL: an automated deep learning framework for cancer histopathology image analysis , 2021, Bioinform..

[16]  F. Asadi,et al.  Deep Convolutional Neural Network–Based Computer-Aided Detection System for COVID-19 Using Multiple Lung Scans: Design and Implementation Study , 2021, Journal of medical Internet research.

[17]  Samouil L. Farhi,et al.  MCMICRO: a scalable, modular image-processing pipeline for multiplexed tissue imaging , 2021, Nature Methods.

[18]  Gloria Bueno,et al.  Detection of Ki67 Hot-Spots of Invasive Breast Cancer Based on Convolutional Neural Networks Applied to Mutual Information of H&E and Ki67 Whole Slide Images , 2020, Applied Sciences.

[19]  Ming Y. Lu,et al.  Data-efficient and weakly supervised computational pathology on whole-slide images , 2020, Nature Biomedical Engineering.

[20]  Ganapathy Krishnamurthi,et al.  A generalized deep learning framework for whole-slide image segmentation and analysis , 2020, Scientific Reports.

[21]  Lijun Liu,et al.  An efficient architecture for medical high-resolution images transmission in mobile telemedicine systems , 2019, Comput. Methods Programs Biomed..

[22]  José Luis Espinosa-Aranda,et al.  Optimum web viewer application for DICOM whole slide image visualization in anatomical pathology , 2019, Comput. Methods Programs Biomed..

[23]  Raphaël Marée,et al.  Cytomine: Toward an Open and Collaborative Software Platform for Digital Pathology Bridged to Molecular Investigations , 2018, Proteomics. Clinical applications.

[24]  Liron Pantanowitz,et al.  Digital Imaging and Communications in Medicine Whole Slide Imaging Connectathon at Digital Pathology Association Pathology Visions 2017 , 2018, Journal of pathology informatics.

[25]  Oscar Déniz-Suárez,et al.  Automatic quantification of IHC stain in breast TMA using colour analysis , 2017, Comput. Medical Imaging Graph..

[26]  Ramakrishnan Mukundan,et al.  HER2 challenge contest: a detailed assessment of automated HER2 scoring algorithms in whole slide images of breast cancer tissues , 2017, Histopathology.

[27]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[28]  Pierre-Marie Martin,et al.  Ki-67: level of evidence and methodological considerations for its role in the clinical management of breast cancer: analytical and critical review , 2011, Breast Cancer Research and Treatment.

[29]  Christel Daniel-Le Bozec,et al.  Standardizing the use of whole slide images in digital pathology , 2011, Comput. Medical Imaging Graph..

[30]  Rajendra Singh,et al.  Standardization in digital pathology: Supplement 145 of the DICOM standards , 2011, Journal of pathology informatics.

[31]  Whole Slide Imaging: Current Applications and Future Directions , 2022 .

[32]  Chenxi Li,et al.  Clinical application of digital design combined with personalized three-dimensional printing technology in the treatment of deep oromaxillofacial-cervical tumors , 2021, Digital Medicine.

[33]  V. K. Bairagi,et al.  The Role of DICOM Technology in Telemedicine , 2011 .