Whole slide imaging equivalency and efficiency study: experience at a large academic center

Whole slide imaging is Food and Drug Administration-approved for primary diagnosis in the United States of America; however, relatively few pathology departments in the country have fully implemented an enterprise wide digital pathology system enabled for primary diagnosis. Digital pathology has significant potential to transform pathology practice with several published studies documenting some level of diagnostic equivalence between digital and conventional systems. However, whole slide imaging also has significant potential to disrupt pathology practice, due to the differences in efficiency of manipulating digital images vis-à-vis glass slides, and studies on the efficiency of actual digital pathology workload are lacking. Our randomized, equivalency and efficiency study aimed to replicate clinical workflow, comparing conventional microscopy to a complete digital pathology signout using whole slide images, evaluating the equivalency and efficiency of glass slide to whole slide image reporting, reflective of true pathology practice workloads in the clinical setting. All glass slides representing an entire day’s routine clinical signout workload for six different anatomic pathology subspecialties at Memorial Sloan Kettering Cancer Center were scanned on Leica Aperio AT2 at ×40 (0.25 µm/pixel). Integration of whole slide images for each accessioned case is through an interface between the Leica eSlide manager database and the laboratory information system, Cerner CoPathPlus. Pathologists utilized a standard institution computer workstation and viewed whole slide images through an internally developed, vendor agnostic whole slide image viewer, named the “MSK Slide Viewer”. Subspecialized pathologists first reported on glass slides from surgical pathology cases using routine clinical workflow. Glass slides were de-identified, scanned, and re-accessioned in the laboratory information system test environment. After a washout period of 13 weeks, pathologists reported the same clinical workload using whole slide image integrated within the laboratory information system. Intraobserver equivalency metrics included top-line diagnosis, margin status, lymphovascular and/or perineural invasion, pathology stage, and the need to order ancillary testing (i.e., recuts, immunohistochemistry). Turnaround time (efficiency) evaluation was defined by the start of each case when opened in the laboratory information system and when the case was completed for that day (i.e., case sent to signout queue or pending ancillary studies). Eight pathologists participated from the following subspecialties: bone and soft tissue, genitourinary, gastrointestinal, breast, gynecologic, and dermatopathology. Glass slides signouts comprised of 204 cases, encompassing 2091 glass slides; and digital signouts comprised of 199 cases, encompassing 2073 whole slide images. The median whole slide image file size was 1.54 GB; scan time/slide, 6 min 24 s; and scan area 32.1 × 18.52 mm. Overall diagnostic equivalency (e.g., top-line diagnosis) was 99.3% between digital and glass slide signout; however, signout using whole slide images showed a median overall 19% decrease in efficiency per case. No significant difference by reader, subspecialty, or specimen type was identified. Our experience is the most comprehensive study to date and shows high intraobserver whole slide image to glass slide equivalence in reporting of true clinical workflows and workloads. Efficiency needs to improve for digital pathology to gain more traction among pathologists.

[1]  Savitri Krishnamurthy,et al.  Multi-institutional comparison of whole slide digital imaging and optical microscopy for interpretation of hematoxylin-eosin-stained breast tissue sections. , 2013, Archives of pathology & laboratory medicine.

[2]  Anil V Parwani,et al.  Clinical examination and validation of primary diagnosis in anatomic pathology using whole slide digital images. , 2011, Archives of pathology & laboratory medicine.

[3]  Shaimaa Al-Janabi,et al.  Whole slide images for primary diagnostics in dermatopathology: a feasibility study , 2011, Journal of Clinical Pathology.

[4]  Yukako Yagi,et al.  Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies. , 2006, Human pathology.

[5]  Andrew Evans,et al.  Virtual microscopy using whole-slide imaging as an enabler for teledermatopathology: A paired consultant validation study , 2012, Journal of pathology informatics.

[6]  Puay Hoon Tan,et al.  Enabling digital pathology in the diagnostic setting: navigating through the implementation journey in an academic medical centre , 2016, Journal of Clinical Pathology.

[7]  Christopher A Moskaluk,et al.  Diagnostic Efficiency in Digital Pathology: A Comparison of Optical Versus Digital Assessment in 510 Surgical Pathology Cases , 2018, The American journal of surgical pathology.

[8]  Alexis B. Carter,et al.  Validating whole slide imaging for diagnostic purposes in pathology: guideline from the College of American Pathologists Pathology and Laboratory Quality Center. , 2013, Archives of pathology & laboratory medicine.

[9]  Darren Treanor,et al.  Observer agreement comparing the use of virtual slides with glass slides in the pathology review component of the POSH breast cancer cohort study , 2012, Journal of Clinical Pathology.

[10]  Michael J. Thrall,et al.  Validation of multiple whole slide imaging scanners based on the guideline from the College of American Pathologists Pathology and Laboratory Quality Center. , 2015, Archives of pathology & laboratory medicine.

[11]  Yukako Yagi,et al.  Primary histologic diagnosis using automated whole slide imaging: a validation study , 2006, BMC clinical pathology.

[12]  Béla Molnár,et al.  Validation of diagnostic accuracy using digital slides in routine histopathology , 2012, Diagnostic Pathology.

[13]  Richard J. Cote,et al.  Intra-observer reproducibility of whole slide imaging for the primary diagnosis of breast needle biopsies , 2014, Journal of pathology informatics.

[14]  Kuang-Yu Jen,et al.  Reliability of whole slide images as a diagnostic modality for renal allograft biopsies. , 2013, Human pathology.

[15]  Joseph P Houghton,et al.  Concordance between digital pathology and light microscopy in general surgical pathology: a pilot study of 100 cases , 2014, Journal of Clinical Pathology.

[16]  Drazen Jukic,et al.  Evaluation of 2 whole-slide imaging applications in dermatopathology. , 2008, Human pathology.

[17]  Matteo Brunelli,et al.  iPathology cockpit diagnostic station: validation according to College of American Pathologists Pathology and Laboratory Quality Center recommendation at the Hospital Trust and University of Verona , 2014, Diagnostic Pathology.

[18]  Clive R. Taylor,et al.  Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology , 2017, The American journal of surgical pathology.

[19]  W Scott Campbell,et al.  Whole slide imaging diagnostic concordance with light microscopy for breast needle biopsies. , 2014, Human pathology.

[20]  Mari Mino-Kenudson,et al.  Whole-slide imaging digital pathology as a platform for teleconsultation: a pilot study using paired subspecialist correlations. , 2009, Archives of pathology & laboratory medicine.

[21]  Werner Kempf,et al.  Comparative diagnostic accuracy in virtual dermatopathology , 2011, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[22]  Shaimaa Al-Janabi,et al.  Whole slide images for primary diagnostics of gastrointestinal tract pathology: a feasibility study. , 2012, Human pathology.

[23]  S. Al-Janabi,et al.  Digital slide images for primary diagnostics in breast pathology: a feasibility study. , 2012, Human pathology.

[24]  Walter H Henricks,et al.  Validation of whole slide imaging for primary diagnosis in surgical pathology. , 2013, Archives of pathology & laboratory medicine.

[25]  H. Grabsch,et al.  Comparing virtual with conventional microscopy for the consensus diagnosis of Barrett’s neoplasia in the AspECT Barrett’s chemoprevention trial pathology audit , 2012, Histopathology.

[26]  Rebecca Randell,et al.  Diagnosis of major cancer resection specimens with virtual slides: impact of a novel digital pathology workstation. , 2014, Human pathology.

[27]  Stephen S Raab,et al.  Patient safety in anatomic pathology: measuring discrepancy frequencies and causes. , 2009, Archives of pathology & laboratory medicine.

[28]  Fabio Pagni,et al.  Virtual surgical pathology in underdeveloped countries: The Zambia Project. , 2011, Archives of pathology & laboratory medicine.

[29]  Shaimaa Al-Janabi,et al.  Whole slide images as a platform for initial diagnostics in histopathology in a medium-sized routine laboratory , 2012, Journal of Clinical Pathology.

[30]  Victor E Reuter,et al.  Interobserver and intraobserver reproducibility in digital and routine microscopic assessment of prostate needle biopsies. , 2011, Human pathology.

[31]  Thomas P. Buck,et al.  Validation of a whole slide imaging system for primary diagnosis in surgical pathology: A community hospital experience , 2014, Journal of pathology informatics.

[32]  Dorina Gui,et al.  Diagnosis of dysplasia in upper gastro-intestinal tract biopsies through digital microscopy , 2012, Journal of pathology informatics.

[33]  Liron Pantanowitz,et al.  Overview of contemporary guidelines in digital pathology: what is available in 2015 and what still needs to be addressed? , 2015, Journal of Clinical Pathology.

[34]  Marius Nap,et al.  The evaluation of colon biopsies using virtual microscopy is reliable , 2013, Histopathology.

[35]  S. S. Raab Virtual microscopy for histology quality assurance of screen-detected polyps , 2012 .

[36]  Rebecca Randell,et al.  The Diagnostic Concordance of Whole Slide Imaging and Light Microscopy: A Systematic Review. , 2017, Archives of pathology & laboratory medicine.

[37]  M. Chevallier,et al.  Histological scoring of fibrosis and activity in HIV–chronic hepatitis B related liver disease: performance of the METAVIR score assessed on virtual slides , 2009, Journal of Clinical Pathology.

[38]  Ichiro Maeda,et al.  Whole‐slide imaging at primary pathological diagnosis: Validation of whole‐slide imaging‐based primary pathological diagnosis at twelve Japanese academic institutes , 2017, Pathology international.

[39]  W Scott Campbell,et al.  Concordance between whole-slide imaging and light microscopy for routine surgical pathology. , 2012, Human pathology.

[40]  Lars Egevad,et al.  Prostate needle biopsy examination by means of virtual microscopy. , 2011, Pathology, research and practice.

[41]  Mark Schiffman,et al.  A comparison of cervical histopathology variability using whole slide digitized images versus glass slides: experience with a statewide registry. , 2013, Human pathology.

[42]  Morten Fjeld,et al.  A comparative study of input devices for digital slide navigation , 2015, Journal of pathology informatics.

[43]  Yee-Wah Tsang,et al.  Validation of digital pathology imaging for primary histopathological diagnosis , 2016, Histopathology.

[44]  Jeffrey L. Fine 21st century workflow: A proposal , 2014, Journal of pathology informatics.

[45]  Shaimaa Al-Janabi,et al.  Whole slide images for primary diagnostics of urinary system pathology: a feasibility study , 2014, Journal of renal injury prevention.

[46]  Oriol Ordi,et al.  Validation of whole slide imaging in the primary diagnosis of gynaecological pathology in a University Hospital , 2014, Journal of Clinical Pathology.

[47]  Aleksandar Vodovnik,et al.  Diagnostic time in digital pathology: A comparative study on 400 cases , 2016, Journal of pathology informatics.

[48]  Christopher R Pierson,et al.  The College of American Pathologists Guidelines for Whole Slide Imaging Validation are Feasible for Pediatric Pathology: A Pediatric Pathology Practice Experience , 2015, Pediatric and developmental pathology : the official journal of the Society for Pediatric Pathology and the Paediatric Pathology Society.

[49]  Philip F Halloran,et al.  Superiority of virtual microscopy versus light microscopy in transplantation pathology , 2012, Clinical transplantation.

[50]  Shaimaa Al-Janabi,et al.  Whole slide images for primary diagnostics of paediatric pathology specimens: a feasibility study , 2012, Journal of Clinical Pathology.

[51]  Patricia Switten Nielsen,et al.  Virtual microscopy: an evaluation of its validity and diagnostic performance in routine histologic diagnosis of skin tumors. , 2010, Human pathology.