Hierarchical patch-based co-registration of differently stained histopathology slides

Over the past decades, digital pathology has emerged as an alternative way of looking at the tissue at subcellular level. It enables multiplexed analysis of different cell types at micron level. Information about cell types can be extracted by staining sections of a tissue block using different markers. However, robust fusion of structural and functional information from different stains is necessary for reproducible multiplexed analysis. Such a fusion can be obtained via image co-registration by establishing spatial correspondences between tissue sections. Spatial correspondences can then be used to transfer various statistics about cell types between sections. However, the multi-modal nature of images and sparse distribution of interesting cell types pose several challenges for the registration of differently stained tissue sections. In this work, we propose a co-registration framework that efficiently addresses such challenges. We present a hierarchical patch-based registration of intensity normalized tissue sections. Preliminary experiments demonstrate the potential of the proposed technique for the fusion of multi-modal information from differently stained digital histopathology sections.

[1]  Jan Modersitzki,et al.  Multimodal Image Registration in Digital Pathology Using Cell Nuclei Densities , 2015, Bildverarbeitung für die Medizin.

[2]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[3]  Yves-Rémi Van Eycke,et al.  Registration of whole immunohistochemical slide images: an efficient way to characterize biomarker colocalization , 2015, J. Am. Medical Informatics Assoc..

[4]  Hans-Peter Meinzer,et al.  Bildverarbeitung für die Medizin 2007, Algorithmen, Systeme, Anwendungen, Proceedings des Workshops vom 25.-27. März 2007 in München , 2007, Bildverarbeitung für die Medizin.

[5]  Oleg Lobachev,et al.  Feature‐based multi‐resolution registration of immunostained serial sections , 2017, Medical Image Anal..

[6]  Alexander Horsch,et al.  Cognition Network Technology for Automated Holistic Analysis in Mammography , 2007, Bildverarbeitung für die Medizin.

[7]  Stefan Heldmann,et al.  Zooming in: high resolution 3D reconstruction of differently stained histological whole slide images , 2014, Medical Imaging.

[8]  Darren Treanor,et al.  Histopathology in 3D: From three-dimensional reconstruction to multi-stain and multi-modal analysis , 2015, Journal of pathology informatics.

[9]  Jun Kong,et al.  Feature-based registration of histopathology images with different stains: An application for computerized follicular lymphoma prognosis , 2009, Comput. Methods Programs Biomed..

[10]  Hans-Peter Meinzer,et al.  Bildverarbeitung für die Medizin 2014, Algorithmen - Systeme - Anwendungen, Proceedings des Workshops vom 16. bis 18. März 2014 in Aachen , 2014, Bildverarbeitung für die Medizin.

[11]  Maria Athelogou,et al.  Visualization and Navigation Platform for Co-Registered Whole Tissue Slides , 2014, Bildverarbeitung für die Medizin.