Localization of Diagnostically Relevant Regions of Interest in Whole Slide Images: a Comparative Study

Whole slide imaging technology enables pathologists to screen biopsy images and make a diagnosis in a digital form. This creates an opportunity to understand the screening patterns of expert pathologists and extract the patterns that lead to accurate and efficient diagnoses. For this purpose, we are taking the first step to interpret the recorded actions of world-class expert pathologists on a set of digitized breast biopsy images. We propose an algorithm to extract regions of interest from the logs of image screenings using zoom levels, time and the magnitude of panning motion. Using diagnostically relevant regions marked by experts, we use the visual bag-of-words model with texture and color features to describe these regions and train probabilistic classifiers to predict similar regions of interest in new whole slide images. The proposed algorithm gives promising results for detecting diagnostically relevant regions. We hope this attempt to predict the regions that attract pathologists' attention will provide the first step in a more comprehensive study to understand the diagnostic patterns in histopathology.

[1]  Anant Madabhushi,et al.  A Boosted Bayesian Multiresolution Classifier for Prostate Cancer Detection From Digitized Needle Biopsies , 2012, IEEE Transactions on Biomedical Engineering.

[2]  Jun Kong,et al.  Computer-aided prognosis of neuroblastoma on whole-slide images: Classification of stromal development , 2009, Pattern Recognit..

[3]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[4]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[6]  Anant Madabhushi,et al.  Multi-Field-of-View Framework for Distinguishing Tumor Grade in ER+ Breast Cancer From Entire Histopathology Slides , 2013, IEEE Transactions on Biomedical Engineering.

[7]  Kim L. Boyer,et al.  Computer-aided evaluation of neuroblastoma on whole-slide histology images: Classifying grade of neuroblastic differentiation , 2009, Pattern Recognit..

[8]  Anant Madabhushi,et al.  Automated gland and nuclei segmentation for grading of prostate and breast cancer histopathology , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[9]  Dong-Chen He,et al.  Texture Unit, Texture Spectrum And Texture Analysis , 1989, 12th Canadian Symposium on Remote Sensing Geoscience and Remote Sensing Symposium,.

[10]  Andrew Evans,et al.  Digital imaging in pathology: whole-slide imaging and beyond. , 2013, Annual review of pathology.

[11]  Darren Treanor,et al.  Tracking with virtual slides: a tool to study diagnostic error in histopathology , 2009, Histopathology.

[12]  Metin Nafi Gürcan,et al.  An efficient computational framework for the analysis of whole slide images: Application to follicular lymphoma immunohistochemistry , 2012, J. Comput. Sci..

[13]  Gary Longton,et al.  Development of a diagnostic test set to assess agreement in breast pathology: practical application of the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) , 2013, BMC Women's Health.

[14]  Andrew Zisserman,et al.  Efficient Visual Search of Videos Cast as Text Retrieval , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Claus Bahlmann,et al.  Automated detection of diagnostically relevant regions in H&E stained digital pathology slides , 2012, Medical Imaging.

[16]  Anant Madabhushi,et al.  AUTOMATED GRADING OF PROSTATE CANCER USING ARCHITECTURAL AND TEXTURAL IMAGE FEATURES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[17]  Linda G. Shapiro,et al.  Mouse cursor movement and eye tracking data as an indicator of pathologists’ attention when viewing digital whole slide images , 2012, Journal of pathology informatics.

[18]  Metin Nafi Gürcan,et al.  A Multiple Instance Learning Approach toward Optimal Classification of Pathology Slides , 2010, 2010 20th International Conference on Pattern Recognition.

[19]  Nassir Navab,et al.  Automated malignancy detection in breast histopathological images , 2012, Medical Imaging.

[20]  Metin Nafi Gürcan,et al.  Computerized classification of intraductal breast lesions using histopathological images , 2011, IEEE Transactions on Biomedical Engineering.

[21]  Anant Madabhushi,et al.  Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.