Histological Validation of MRI: A Review of Challenges in Registration of Imaging and Whole‐Mount Histopathology

Rigorous validation with ground truth information such as histology is needed to reliably assess the current and potential value of MRI techniques to characterize tissue and identify disease-related tissue alterations. Commonly used methods that aim to directly correlate histology and MRI data generally fall short of this goal due to spatial errors that preclude direct matching. Errors result from tissue deformation, differences in spatial resolution and slice thickness, non-coplanar and/or nonintersecting plane orientations, and different image contrast mechanisms. Some of these problems arise from limitations in standard protocols for clinical tissue processing and histology-based pathology reporting, and to some extent can be addressed by modifications to standard protocols without compromising the clinical process. Typical modifications include ex vivo specimen MRI, block-face photography, addition of fiducial markers, and 3D printed molds to constrain tissue deformation and guide sectioning. This review summarizes the advantages and limitations of MRI validation techniques based on coregistration of MRI with whole-mount histology of tissue specimens. LEVEL OF EVIDENCE: 4 TECHNICAL EFFICACY STAGE: 1.

[1]  A. Fenster,et al.  Registration of prostate histology images to ex vivo MR images via strand‐shaped fiducials , 2012, Journal of magnetic resonance imaging : JMRI.

[2]  Michael Unser,et al.  Fast parametric elastic image registration , 2003, IEEE Trans. Image Process..

[3]  Zhiqiang Qin,et al.  The role of radical prostatectomy for the treatment of metastatic prostate cancer: a systematic review and meta-analysis , 2017, Bioscience reports.

[4]  Zhengyi Yang,et al.  MRI-guided volume reconstruction of mouse brain from histological sections , 2012, Journal of Neuroscience Methods.

[5]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[6]  Frank Scheffold,et al.  Principles and Fundamentals of Optical Imaging , 2014 .

[7]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[8]  Cheng Soon Ong,et al.  Development of a registration framework to validate MRI with histology for prostate focal therapy. , 2015, Medical physics.

[9]  Victor E Reuter,et al.  Anatomy of the prostate revisited: implications for prostate biopsy and zonal origins of prostate cancer , 2012, Histopathology.

[10]  Tianmiao Wang,et al.  A Review of Point Feature Based Medical Image Registration , 2018, Chinese Journal of Mechanical Engineering.

[11]  Xia Li,et al.  Accuracy of image registration between MRI and light microscopy in the ex vivo brain. , 2011, Magnetic resonance imaging.

[12]  Holden H. Wu,et al.  A system using patient‐specific 3D‐printed molds to spatially align in vivo MRI with ex vivo MRI and whole‐mount histopathology for prostate cancer research , 2018, Journal of magnetic resonance imaging : JMRI.

[13]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Toru Tanaka,et al.  Deformable image registration between pathological images and MR image via an optical macro image , 2016, Pathology, research and practice.

[15]  J Q Trojanowski,et al.  Comparison of In Vivo and Ex Vivo MRI of the Human Hippocampal Formation in the Same Subjects , 2016, Cerebral cortex.

[16]  David L Wilson,et al.  Correcting spatial distortion in histological images. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[17]  Richard L Ehman,et al.  Fiducial markers for MR histological correlation in ex vivo or short‐term in vivo animal experiments: A screening study , 2006, Journal of magnetic resonance imaging : JMRI.

[18]  Wiro J. Niessen,et al.  Facilitating Tumor Functional Assessment by Spatially Relating 3D Tumor Histology and In Vivo MRI: Image Registration Approach , 2011, PloS one.

[19]  Frederik Maes,et al.  Validation of an Improved Patient-Specific Mold Design for Registration of In-vivo MRI and Histology of the Prostate , 2016, CLIP@MICCAI.

[20]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[21]  Anant Madabhushi,et al.  Coregistration of Preoperative MRI with Ex Vivo Mesorectal Pathology Specimens to Spatially Map Post-treatment Changes in Rectal Cancer Onto In Vivo Imaging: Preliminary Findings. , 2018, Academic radiology.

[22]  Eric P. Winer,et al.  Breast Cancer Treatment: A Review , 2019, JAMA.

[23]  Paul Suetens,et al.  Image registration using mutual information , 2015 .

[24]  Magnus Hellström,et al.  Tissue shrinkage after fixation with formalin injection of prostatectomy specimens , 2006, Virchows Archiv.

[25]  Yun Zhang,et al.  A critical review of image registration methods , 2010 .

[26]  Terry M. Peters,et al.  Image registration of ex-vivo MRI to sparsely sectioned histology of hippocampal and neocortical temporal lobe specimens , 2013, NeuroImage.

[27]  James D Brooks,et al.  Methods for registration of magnetic resonance images of ex vivo prostate specimens with histology , 2012, Journal of magnetic resonance imaging : JMRI.

[28]  Cornelis A T van den Berg,et al.  Validation of imaging with pathology in laryngeal cancer: accuracy of the registration methodology. , 2011, International journal of radiation oncology, biology, physics.

[29]  Yunpeng Liu,et al.  A robust feature-based registration method of multimodal image using phase congruency and coherent point drift , 2013, Other Conferences.

[30]  Odokuma Emmanuel Igho,et al.  Artifacts in histology: A 1-year retrospective study , 2017 .

[31]  Robert Bartha,et al.  Registration of in vivo magnetic resonance T 1-weighted brain images to triphenyltetrazolium chloride stained sections in small animals , 2006, Journal of Neuroscience Methods.

[32]  K Sklinda,et al.  Normal 3T MR Anatomy of the Prostate Gland and Surrounding Structures , 2019, Advances in medicine.

[33]  Hyunjin Park,et al.  Registration methodology for histological sections and in vivo imaging of human prostate. , 2008, Academic radiology.

[34]  Shyam Natarajan,et al.  A system for evaluating magnetic resonance imaging of prostate cancer using patient-specific 3D printed molds. , 2014, American journal of clinical and experimental urology.

[35]  Marco van Vulpen,et al.  Validation of functional imaging with pathology for tumor delineation in the prostate. , 2009, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[36]  George Wolberg,et al.  Geometric Transformation Techniques for Digital Images: A Survey , 1988 .

[37]  Dinggang Shen,et al.  Non-rigid registration between histological and MR images of the prostate: A joint segmentation and registration framework , 2009, CVPR 2009.

[38]  Navid Farahani,et al.  A Practical Guide to Whole Slide Imaging: A White Paper From the Digital Pathology Association. , 2018, Archives of pathology & laboratory medicine.

[39]  Deirdre M McGrath,et al.  Technical note: fiducial markers for correlation of whole-specimen histopathology with MR imaging at 7 tesla. , 2010, Medical physics.

[40]  Aaron Fenster,et al.  Prostate: registration of digital histopathologic images to in vivo MR images acquired by using endorectal receive coil. , 2012, Radiology.

[41]  Julip Jung,et al.  Histopathology and MR image fusion of the prostate , 2008, SPIE Medical Imaging.

[42]  Frithjof Kruggel,et al.  Slice-to-Volume Nonrigid Registration of Histological Sections to MR Images of the Human Brain , 2010, Anatomy research international.

[43]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[44]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[45]  Neda Bernasconi,et al.  In vivo MRI signatures of hippocampal subfield pathology in intractable epilepsy , 2016, Human brain mapping.

[46]  Pascal Haigron,et al.  Prostate whole-mount histology reconstruction and registration to MRI for correlating in-vivo observations with biological findings , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[47]  Manbir Singh,et al.  Automatic registration of postmortem brain slices to MRI reference volume , 1999 .

[48]  Anant Madabhushi,et al.  Spatially weighted mutual information (SWMI) for registration of digitally reconstructed ex vivo whole mount histology and in vivo prostate MRI , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[49]  Robert West,et al.  Spatial integration of radiology and pathology images to characterize breast cancer aggressiveness on pre-surgical MRI , 2019, Medical Imaging: Image Processing.

[50]  Y Chen,et al.  A stereotactic method for the three-dimensional registration of multi-modality biologic images in animals: NMR, PET, histology, and autoradiography. , 2003, Medical physics.

[51]  Peng Li,et al.  Correlating 2D histological slice with 3D MRI image volume using smart phone as an interactive tool for muscle study , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[52]  D. Hopwood,et al.  Fixatives and fixation: a review , 1969, The Histochemical Journal.

[53]  Renaud de Crevoisier,et al.  Slice correspondence estimation using SURF descriptors and context-based search for prostate whole-mount histology MRI registration , 2016, EMBC.

[54]  N. Ayache,et al.  Three-dimensional reconstruction of stained histological slices and 3D non-linear registration with in-vivo MRI for whole baboon brain , 2007, Journal of Neuroscience Methods.

[55]  Baris Turkbey,et al.  Multiparametric 3T prostate magnetic resonance imaging to detect cancer: histopathological correlation using prostatectomy specimens processed in customized magnetic resonance imaging based molds. , 2011, The Journal of urology.

[56]  G. Metzger,et al.  Registration of in vivo prostate MRI and pseudo‐whole mount histology using Local Affine Transformations guided by Internal Structures (LATIS) , 2015, Journal of magnetic resonance imaging : JMRI.

[57]  Navid Samavati,et al.  Technical Note: Method to correlate whole-specimen histopathology of radical prostatectomy with diagnostic MR imaging. , 2016, Medical physics.

[58]  Wolfhard Semmler,et al.  Fundamentals of optical imaging. , 2008, Handbook of experimental pharmacology.

[59]  Piotr Kozlowski,et al.  Device for sectioning prostatectomy specimens to facilitate comparison between histology and in vivo MRI , 2010, Journal of magnetic resonance imaging : JMRI.

[60]  M. Miller,et al.  Large Deformation Diffeomorphic Metric Mapping Registration of Reconstructed 3D Histological Section Images and in vivo MR Images , 2009, Front. Hum. Neurosci..

[61]  Maria Wynnchuk,et al.  An Artifact of H&E Staining: The Problem and Its Solution , 1990 .

[62]  R. Lenkinski,et al.  Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information. , 2011, Medical physics.

[63]  T Schormann,et al.  Three‐Dimensional linear and nonlinear transformations: An integration of light microscopical and MRI data , 1998, Human brain mapping.

[64]  Yutong Liu,et al.  Landmark Optimization Using Local Curvature for Point-Based Nonlinear Rodent Brain Image Registration , 2011, Int. J. Biomed. Imaging.

[65]  Yoshimi Anzai,et al.  Value of MRI in medicine: More than just another test? , 2018, Journal of magnetic resonance imaging : JMRI.

[66]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[67]  Sébastien Ourselin,et al.  Co-registration of Histological, Optical and MR Data of the Human Brain , 2002, MICCAI.

[68]  Chris Zarow,et al.  Co-registration of in vivo human MRI brain images to postmortem histological microscopic images , 2008 .

[69]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[70]  David J. Hawkes,et al.  Apparatus for Histological Validation of In Vivo and Ex Vivo Magnetic Resonance Imaging of the Human Prostate , 2017, Front. Oncol..

[71]  J R Thornbury,et al.  Local staging of prostate cancer with endorectal MR imaging: correlation with histopathology. , 1996, AJR. American journal of roentgenology.

[72]  Septimiu E. Salcudean,et al.  Registration of Whole-Mount Histology and Volumetric Imaging of the Prostate Using Particle Filtering , 2014, IEEE Transactions on Medical Imaging.

[73]  D. Reich,et al.  Postmortem magnetic resonance imaging to guide the pathologic cut: individualized, 3-dimensionally printed cutting boxes for fixed brains. , 2014, Journal of neuropathology and experimental neurology.

[74]  Geoffrey Watson,et al.  Diffusion anisotropy in fresh and fixed prostate tissue ex vivo , 2016, Magnetic resonance in medicine.

[75]  John A. Carrino,et al.  chapter 10 – Magnetic Resonance Imaging , 2007 .

[76]  D. Shen,et al.  Registering histological and MR images of prostate for image-based cancer detection. , 2007, Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention.

[77]  João Manuel R S Tavares,et al.  Medical image registration: a review , 2014, Computer methods in biomechanics and biomedical engineering.

[78]  Shailja Chatterjee,et al.  Artefacts in histopathology , 2014, Journal of oral and maxillofacial pathology : JOMFP.

[79]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[80]  J. Sammon,et al.  Review of the comparative effectiveness of radical prostatectomy, radiation therapy, or expectant management of localized prostate cancer in registry data. , 2017, Urologic oncology.

[81]  Bradford A Moffat,et al.  A Methodology for Registration of a Histological Slide and In Vivo MRI Volume Based on Optimizing Mutual Information , 2006, Molecular imaging.

[82]  Anant Madabhushi,et al.  Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation , 2017, Scientific Reports.

[83]  H. Hricak,et al.  Semi‐automatic deformable registration of prostate MR images to pathological slices , 2010, Journal of Magnetic Resonance Imaging.

[84]  Anant Madabhushi,et al.  Determining histology-MRI slice correspondences for defining MRI-based disease signatures of prostate cancer , 2011, Comput. Medical Imaging Graph..

[85]  Tahsin Kurc,et al.  Twenty Years of Digital Pathology: An Overview of the Road Travelled, What is on the Horizon, and the Emergence of Vendor-Neutral Archives , 2018, Journal of pathology informatics.

[86]  D. Peck,et al.  Registration and warping of magnetic resonance images to histological sections. , 1999, Medical physics.

[87]  Sébastien Ourselin,et al.  A Survey of Methods for 3D Histology Reconstruction , 2018, Medical Image Anal..

[88]  William E. Grizzle,et al.  The Effects of Tissue Processing Variables Other Than Fixation on Histochemical Staining and Immunohistochemical Detection of Antigens , 2001 .

[89]  Grégoire Malandain,et al.  Fusion of autoradiographs with an MR volume using 2-D and 3-D linear transformations , 2004, NeuroImage.

[90]  Edson Amaro Júnior,et al.  Multimodal Whole Brain Registration: MRI and High Resolution Histology , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[91]  Baris Turkbey,et al.  Use of patient-specific MRI-based prostate mold for validation of multiparametric MRI in localization of prostate cancer. , 2012, Urology.

[92]  William E. Grizzle,et al.  Introduction to the Theory and Practice of Fixation of Tissues , 2001 .

[93]  Henry Rusinek,et al.  Imaging of prostate cancer: a platform for 3D co-registration of in-vivo MRI ex-vivo MRI and pathology , 2012, Medical Imaging.

[94]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[95]  Soo-Hyung Kim,et al.  Intensity-based registration of medical images , 2009, 2009 International Conference on Test and Measurement.

[96]  Lars Ruthotto,et al.  Non-linear Image Registration , 2015, Handbook of Mathematical Methods in Imaging.

[97]  David L Wilson,et al.  Three‐dimensional method for comparing in vivo interventional MR images of thermally ablated tissue with tissue response , 2003, Journal of magnetic resonance imaging : JMRI.

[98]  Terry M. Peters,et al.  Registration of in-vivo to ex-vivo MRI of surgically resected specimens: A pipeline for histology to in-vivo registration , 2015, Journal of Neuroscience Methods.