Automatic Multi-Stain Registration of Whole Slide Images in Histopathology

Joint analysis of multiple biomarker images and tissue morphology is important for disease diagnosis, treatment planning and drug development. It requires cross-staining comparison among Whole Slide Images (WSIs) of immune-histochemical and hematoxylin and eosin (H&E) microscopic slides. However, automatic, and fast cross-staining alignment of enormous gigapixel WSIs at single-cell precision is challenging. In addition to morphological deformations introduced during slide preparation, there are large variations in cell appearance and tissue morphology across different staining. In this paper, we propose a two-step automatic feature-based cross-staining WSI alignment to assist localization of even tiny metastatic foci in the assessment of lymph node. Image pairs were aligned allowing for translation, rotation, and scaling. The registration was performed automatically by first detecting landmarks in both images, using the scale-invariant image transform (SIFT), followed by the fast sample consensus (FSC) protocol for finding point correspondences and finally aligned the images. The Registration results were evaluated using both visual and quantitative criteria using the Jaccard index. The average Jaccard similarity index of the results produced by the proposed system is 0.942 when compared with the manual registration.

[1]  A. Cardona,et al.  Elastic volume reconstruction from series of ultra-thin microscopy sections , 2012, Nature Methods.

[2]  David B. A. Epstein,et al.  Hyper-Stain Inspector: A Framework for Robust Registration and Localised Co-Expression Analysis of Multiple Whole-Slide Images of Serial Histology Sections , 2017, Scientific Reports.

[3]  Stephan Saalfeld,et al.  As-rigid-as-possible mosaicking and serial section registration of large ssTEM datasets , 2010, Bioinform..

[4]  Maoguo Gong,et al.  A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration , 2015, IEEE Geoscience and Remote Sensing Letters.

[5]  Yuan-Fang Wang,et al.  Feature detector and descriptor for medical images , 2009, Medical Imaging.

[6]  Michael Unser,et al.  Elastic registration of biological images using vector-spline regularization , 2005, IEEE Transactions on Biomedical Engineering.

[7]  Carlos Ortiz-de-Solorzano,et al.  Consistent and Elastic Registration of Histological Sections Using Vector-Spline Regularization , 2006, CVAMIA.

[8]  Wiro J Niessen,et al.  Groupwise image registration based on a total correlation dissimilarity measure for quantitative MRI and dynamic imaging data , 2018, Scientific Reports.

[9]  Morteza Babaie,et al.  CNN and Deep Sets for End-to-End Whole Slide Image Representation Learning , 2021, MIDL.

[10]  Maged Goubran,et al.  Multimodal image registration and connectivity analysis for integration of connectomic data from microscopy to MRI , 2019, Nature Communications.

[11]  P. Coleman,et al.  PEP-19 immunohistochemistry defines the basal ganglia and associated structures in the adult human brain, and is dramatically reduced in Huntington's disease , 1998, Neuroscience.

[12]  Morteza Babaie,et al.  Fine-Tuning and training of densenet for histopathology image representation using TCGA diagnostic slides , 2021, Medical Image Anal..

[13]  Jun Kong,et al.  Feature-based registration of histopathology images with different stains: An application for computerized follicular lymphoma prognosis , 2009, Comput. Methods Programs Biomed..

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[15]  Derek R. Magee,et al.  3D reconstruction of multiple stained histology images , 2013, Journal of pathology informatics.

[16]  Sjors H.W. Scheres,et al.  Faculty Opinions recommendation of Real-time cryo-electron microscopy data preprocessing with Warp. , 2019, Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature.

[17]  Ching-Wei Wang,et al.  Robust image registration of biological microscopic images , 2014, Scientific Reports.

[18]  R A Hoffman,et al.  A High-Resolution Tile-Based Approach for Classifying Biological Regions in Whole-Slide Histopathological Images. , 2014, IFMBE proceedings.

[19]  Alain Pitiot,et al.  Geometrical regularization of displacement fields for histological image registration , 2008, Medical Image Anal..