Correlation Filters for Detection of Cellular Nuclei in Histopathology Images

Nuclei detection in histology images is an essential part of computer aided diagnosis of cancers and tumors. It is a challenging task due to diverse and complicated structures of cells. In this work, we present an automated technique for detection of cellular nuclei in hematoxylin and eosin stained histopathology images. Our proposed approach is based on kernelized correlation filters. Correlation filters have been widely used in object detection and tracking applications but their strength has not been explored in the medical imaging domain up till now. Our experimental results show that the proposed scheme gives state of the art accuracy and can learn complex nuclear morphologies. Like deep learning approaches, the proposed filters do not require engineering of image features as they can operate directly on histopathology images without significant preprocessing. However, unlike deep learning methods, the large-margin correlation filters developed in this work are interpretable, computationally efficient and do not require specialized or expensive computing hardware. Availability: A cloud based webserver of the proposed method and its python implementation can be accessed at the following URL: http://faculty.pieas.edu.pk/fayyaz/software.html#corehist.

[1]  M. Kubát.  An Introduction to Machine Learning , 2017, Springer International Publishing.

[2]  F. Harris.  On the use of windows for harmonic analysis with the discrete Fourier transform , 1978, Proceedings of the IEEE.

[3]  Varun Srivastava,et al.  Cancerous Cell Detection UsingHistopathological Image Analysis , 2015 .

[4]  Derek R. Magee,et al.  Context-Based Classification of Cell Nuclei and Tissue Regions in Liver Histopathology , 2011, MIUA.

[5]  Luca Fiaschi,et al.  Learning-based mitotic cell detection in histopathological images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[6]  Hui Kong,et al.  Partitioning Histopathological Images: An Integrated Framework for Supervised Color-Texture Segmentation and Cell Splitting , 2011, IEEE Transactions on Medical Imaging.

[7]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[8]  Isaac N. Bankman,et al.  Handbook of medical imaging , 2000 .

[9]  Peng Zhao,et al.  Supervised learning-based cell image segmentation for P53 immunohistochemistry , 2006, IEEE Transactions on Biomedical Engineering.

[10]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[11]  Enrico Macii,et al.  Automated segmentation of tissue images for computerized IHC analysis , 2022 .

[12]  R. Kumar,et al.  Detection and Classification of Cancer from Microscopic Biopsy Images Using Clinically Significant and Biologically Interpretable Features , 2015, Journal of medical engineering.

[13]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[14]  J. Going,et al.  Scoring nuclear pleomorphism in breast cancer , 2001, Histopathology.

[15]  Manohar Kuse,et al.  Local isotropic phase symmetry measure for detection of beta cells and lymphocytes , 2011, Journal of pathology informatics.

[16]  Bernhard Schölkopf,et al.  A tutorial on kernel methods for categorization , 2007, Journal of Mathematical Psychology.

[17]  P. Khosla,et al.  Face Verification using Correlation Filters , 2002 .

[18]  Takeo Kanade,et al.  Correlation Filters for Object Alignment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[21]  Po-Whei Huang,et al.  Effective segmentation and classification for HCC biopsy images , 2010, Pattern Recognit..

[22]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[23]  Martin Hofmann,et al.  Support Vector Machines — Kernels and the Kernel Trick , 2006 .

[24]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[25]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  D. N. Kim,et al.  Fast Fourier Transform - Algorithms and Applications , 2010 .

[27]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[28]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[29]  Amit Sethi,et al.  Towards generalized nuclear segmentation in histological images , 2013, 13th IEEE International Conference on BioInformatics and BioEngineering.

[30]  Anant Madabhushi,et al.  An Integrated Region-, Boundary-, Shape-Based Active Contour for Multiple Object Overlap Resolution in Histological Imagery , 2012, IEEE Transactions on Medical Imaging.

[31]  B. V. K. Vijaya Kumar,et al.  Efficient design of advanced correlation filters for robust distortion-tolerant face recognition , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[32]  Wei Wang,et al.  Detection and classification of thyroid follicular lesions based on nuclear structure from histopathology images , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[33]  A. Fenster.  Handbook of Medical Imaging, Processing and Analysis , 2001 .

[34]  B. Yener,et al.  Automated cancer diagnosis based on histopathological images : a systematic survey , 2005 .

[35]  Hai Su,et al.  Beyond Classification: Structured Regression for Robust Cell Detection Using Convolutional Neural Network , 2015, MICCAI.

[36]  Chanho Jung,et al.  Unsupervised Segmentation of Overlapped Nuclei Using Bayesian Classification , 2010, IEEE Transactions on Biomedical Engineering.

[37]  Isaac N. Bankman,et al.  Handbook of Medical Imaging. Processing and Analysis , 2002 .

[38]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[39]  J P Vink,et al.  Efficient nucleus detector in histopathology images , 2013, Journal of microscopy.

[40]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[42]  F. Markowetz,et al.  Quantitative Image Analysis of Cellular Heterogeneity in Breast Tumors Complements Genomic Profiling , 2012, Science Translational Medicine.

[43]  Anant Madabhushi,et al.  Adaptive Energy Selective Active Contour with Shape Priors for Nuclear Segmentation and Gleason Grading of Prostate Cancer , 2011, MICCAI.

[44]  Daniel Racoceanu,et al.  Cell nuclei extraction from breast cancer histopathologyimages using colour, texture, scale and shape information , 2013, Diagnostic Pathology.

[45]  J. Beveridge,et al.  Average of Synthetic Exact Filters , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[47]  Daniel Heim,et al.  Detection and Segmentation of Cell Nuclei in Virtual Microscopy Images: A Minimum-Model Approach , 2012, Scientific Reports.