Content-based histopathological image retrieval for whole slide image database using binary codes

Content-based image retrieval (CBIR) has been widely researched for medical images. In application of histo- pathological images, there are two issues that need to be carefully considered. The one is that the digital slide is stored in a spatially continuous image with a size of more than 10K x 10K pixels. The other is that the size of query image varies in a large range according to different diagnostic conditions. It is a challenging work to retrieve the eligible regions for the query image from the database that consists of whole slide images (WSIs). In this paper, we proposed a CBIR framework for the WSI database and size-scalable query images. Each WSI in the database is encoded and stored in a matrix of binary codes. When retrieving, the query image is first encoded into a set of binary codes and analyzed to pre-choose a set of regions from database using hashing method. Then a multi-binary-code-based similarity measurement based on hamming distance is designed to rank proposal regions. Finally, the top relevant regions and their locations in the WSIs along with the diagnostic information are returned to assist pathologists in diagnoses. The effectiveness of the proposed framework is evaluated in a fine-annotated WSIs database of epithelial breast tumors. The experimental results show that proposed framework is both effective and efficiency for content-based whole slide image retrieval.

[1]  Limin Luo,et al.  Content-based cell pathology image retrieval by combining different features , 2004, SPIE Medical Imaging.

[2]  Sunil R. Lakhani,et al.  WHO classification of tumours of the breast , 2012 .

[3]  Lei Zheng,et al.  Design and analysis of a content-based pathology image retrieval system , 2003, IEEE Transactions on Information Technology in Biomedicine.

[4]  Fabio A. González,et al.  A Semantic Content-Based Retrieval Method for Histopathology Images , 2008, AIRS.

[5]  Kristen Grauman,et al.  Kernelized Locality-Sensitive Hashing , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Zhiguo Jiang,et al.  Pathology Image Retrieval by Block LBP Based pLSA Model with Low-Rank and Sparse Matrix Decomposition , 2014, IGTA.

[7]  Miguel Á. Carreira-Perpiñán,et al.  Hashing with binary autoencoders , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Zhiguo Jiang,et al.  PLSA-based pathological image retrieval for breast cancer with color deconvolution , 2013, Other Conferences.

[9]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[10]  Wei Liu,et al.  Towards Large-Scale Histopathological Image Analysis: Hashing-Based Image Retrieval , 2015, IEEE Transactions on Medical Imaging.

[11]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[12]  Zhiguo Jiang,et al.  Pathological Image Retrieval for Breast Cancer with pLSA Model , 2013, 2013 Seventh International Conference on Image and Graphics.

[13]  John R. Gilbertson,et al.  Evaluation of prostate tumor grades by content-based image retrieval , 1999, Other Conferences.

[14]  Zhiguo Jiang,et al.  Retrieval of pathology image for breast cancer using PLSA model based on texture and pathological features , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Vipin Chaudhary,et al.  Content based sub-image retrieval system for high resolution pathology images using salient interest points , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Ebroul Izquierdo,et al.  Combining Low-level Features for Improved Classification and Retrieval of Histology Images , 2010, Trans. Mass Data Anal. Images Signals.

[17]  Dorin Comaniciu,et al.  Bimodal system for interactive indexing and retrieval of pathology images , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[18]  Zhiguo Jiang,et al.  Breast Histopathological Image Retrieval Based on Latent Dirichlet Allocation , 2017, IEEE Journal of Biomedical and Health Informatics.

[19]  Dorin Comaniciu,et al.  Shape-based image indexing and retrieval for diagnostic pathology , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).