Automatic deformable registration of histological slides to μCT volume data

Localizing a histological section in the three‐dimensional dataset of a different imaging modality is a challenging 2D‐3D registration problem. In the literature, several approaches have been proposed to solve this problem; however, they cannot be considered as fully automatic. Recently, we developed an automatic algorithm that could successfully find the position of a histological section in a micro computed tomography (μCT) volume. For the majority of the datasets, the result of localization corresponded to the manual results. However, for some datasets, the matching μCT slice was off the ground‐truth position. Furthermore, elastic distortions, due to histological preparation, could not be accounted for in this framework.

[1]  Arrate Muñoz-Barrutia,et al.  3D reconstruction of histological sections: Application to mammary gland tissue , 2010, Microscopy research and technique.

[2]  Paul Suetens,et al.  Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information , 1999, Medical Image Anal..

[3]  B. Balas,et al.  Personal Familiarity Influences the Processing of Upright and Inverted Faces in Infants , 2009, Front. Hum. Neurosci..

[4]  Bradford A Moffat,et al.  A Methodology for Registration of a Histological Slide and In Vivo MRI Volume Based on Optimizing Mutual Information , 2006, Molecular imaging.

[5]  Tony Pan,et al.  Registration and 3D visualization of large microscopy images , 2006, SPIE Medical Imaging.

[6]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[7]  H. Hege,et al.  Registering 2D and 3D imaging data of bone during healing , 2015, Connective tissue research.

[8]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[9]  Roee S. Lazebnik,et al.  Three-Dimensional Registration of Magnetic Resonance Image Data to Histological Sections with Model-Based Evaluation , 2005, Annals of Biomedical Engineering.

[10]  K. Scheffler,et al.  Three-dimensional strain fields in human brain resulting from formalin fixation , 2011, Journal of Neuroscience Methods.

[11]  Y Chen,et al.  A stereotactic method for the three-dimensional registration of multi-modality biologic images in animals: NMR, PET, histology, and autoradiography. , 2003, Medical physics.

[12]  Terry M. Peters,et al.  Registration of in-vivo to ex-vivo MRI of surgically resected specimens: A pipeline for histology to in-vivo registration , 2015, Journal of Neuroscience Methods.

[13]  P. Thurner,et al.  Comparison of microfocus- and synchrotron X-ray tomography for the analysis of osteointegration around Ti6Al4V implants. , 2004, European cells & materials.

[14]  Robert Bartha,et al.  Registration of in vivo magnetic resonance T 1-weighted brain images to triphenyltetrazolium chloride stained sections in small animals , 2006, Journal of Neuroscience Methods.

[15]  Gábor Székely,et al.  A mean three-dimensional atlas of the human thalamus: Generation from multiple histological data , 2010, NeuroImage.

[16]  Sébastien Ourselin,et al.  Co-registration of Histological, Optical and MR Data of the Human Brain , 2002, MICCAI.

[17]  Yutong Liu,et al.  Landmark Optimization Using Local Curvature for Point-Based Nonlinear Rodent Brain Image Registration , 2011, Int. J. Biomed. Imaging.

[18]  Kevin J Parker,et al.  Three-dimensional registration of prostate images from histology and ultrasound. , 2004, Ultrasound in medicine & biology.

[19]  M. Viceconti,et al.  A comparison between micro‐CT and histology for the evaluation of cortical bone: effect of polymethylmethacrylate embedding on structural parameters , 2012, Journal of microscopy.

[20]  Sébastien Ourselin,et al.  Fusion of Histological Sections and MR Images: Towards the Construction of an Atlas of the Human Basal Ganglia , 2001, MICCAI.

[21]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[22]  Septimiu E. Salcudean,et al.  Registration of whole-mount histology and tomography of the prostate using particle filtering , 2013, Medical Imaging.

[23]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Martin Styner,et al.  Parametric estimate of intensity inhomogeneities applied to MRI , 2000, IEEE Transactions on Medical Imaging.

[25]  Roee S. Lazebnik,et al.  Volume registration using needle paths and point landmarks for evaluation of interventional MRI treatments , 2003, IEEE Transactions on Medical Imaging.

[26]  Terry M. Peters,et al.  Single slice US-MRI registration for neurosurgical MRI-guided US , 2016, SPIE Medical Imaging.

[27]  Karl Zilles,et al.  Statistics of deformations in histology and application to improved alignment with MRI , 1995, IEEE Trans. Medical Imaging.

[28]  Orcun Goksel,et al.  Automatic registration of 2D histological sections to 3D microCT volumes: Trabecular bone. , 2017, Bone.

[29]  Dinggang Shen,et al.  Registering Histological and MR Images of Prostate for Image-Based Cancer Detection , 2006, MICCAI.

[30]  B. Müller,et al.  Tomographic brain imaging with nucleolar detail and automatic cell counting , 2016, Scientific Reports.

[31]  Wiro J. Niessen,et al.  Facilitating Tumor Functional Assessment by Spatially Relating 3D Tumor Histology and In Vivo MRI: Image Registration Approach , 2011, PloS one.

[32]  Nikos Paragios,et al.  Non-rigid 2D-3D Medical Image Registration Using Markov Random Fields , 2013, MICCAI.

[33]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[34]  Jean-Michel Morel,et al.  ASIFT: An Algorithm for Fully Affine Invariant Comparison , 2011, Image Process. Line.

[35]  Philippe C. Cattin,et al.  Histology to μCT Data Matching Using Landmarks and a Density Biased RANSAC , 2014, MICCAI.

[36]  Bert Müller,et al.  Automatic histology registration in application to x-ray modalities , 2016, Optical Engineering + Applications.

[37]  N. Ayache,et al.  Three-dimensional reconstruction of stained histological slices and 3D non-linear registration with in-vivo MRI for whole baboon brain , 2007, Journal of Neuroscience Methods.

[38]  P. Thurner,et al.  An optimization procedure for spatial and density resolution in hard X-ray micro-computed tomography , 2004 .

[39]  Julia A. Schnabel,et al.  Correlating Tumour Histology and ex vivo MRI Using Dense Modality-Independent Patch-Based Descriptors , 2015, Patch-MI@MICCAI.

[40]  T Schormann,et al.  Three‐Dimensional linear and nonlinear transformations: An integration of light microscopical and MRI data , 1998, Human brain mapping.

[41]  M. Miller,et al.  Large Deformation Diffeomorphic Metric Mapping Registration of Reconstructed 3D Histological Section Images and in vivo MR Images , 2009, Front. Hum. Neurosci..

[42]  Franz Pfeiffer,et al.  Multimodal imaging of human cerebellum - merging X-ray phase microtomography, magnetic resonance microscopy and histology , 2012, Scientific Reports.

[43]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[44]  Simon K. Warfield,et al.  Efficient multi-modal dense field non-rigid registration: alignment of histological and section images , 2005, Medical Image Anal..

[45]  Dinggang Shen,et al.  Non-rigid registration between histological and MR images of the prostate: A joint segmentation and registration framework , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[46]  Joakim Lindblad,et al.  Registration of 2D Histological Images of Bone Implants with 3D SRµCT Volumes , 2008, ISVC.

[47]  Daniel Jeanmonod,et al.  Strain fields in histological slices of brain tissue determined by synchrotron radiation-based micro computed tomography , 2008, Journal of Neuroscience Methods.

[48]  T. Bormann,et al.  Three-dimensional registration of tomography data for quantification in biomaterials science , 2012 .

[49]  Anja K. Stalder,et al.  Combined use of micro computed tomography and histology to evaluate the regenerative capacity of bone grafting materials , 2014 .

[50]  Marina Kolesnik,et al.  Interactive registration of 2D histology and 3D CT data for assessment of radiofrequency ablation treatment , 2011, Journal of pathology informatics.

[51]  Karen L. Smith,et al.  Robust, globally consistent and fully automatic multi‐image registration and montage synthesis for 3‐D multi‐channel images , 2011, Journal of microscopy.

[52]  Witaya Sungkarat,et al.  Automatic registration of postmortem brain slices to MRI reference volume , 1999, 1999 IEEE Nuclear Science Symposium. Conference Record. 1999 Nuclear Science Symposium and Medical Imaging Conference (Cat. No.99CH37019).

[53]  Dong Peng,et al.  Compressed Sensing Photoacoustic Imaging Based on Fast Alternating Direction Algorithm , 2012, Int. J. Biomed. Imaging.

[54]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[55]  C.‐L. TSAI,et al.  Alignment with sub‐pixel accuracy for images of multi‐modality microscopes using automatic calibration , 2008, Journal of microscopy.

[56]  Alain Pitiot,et al.  Piecewise affine registration of biological images for volume reconstruction , 2006, Medical Image Anal..

[57]  Hans Deyhle,et al.  Extending two-dimensional histology into the third dimension through conventional micro computed tomography , 2016, NeuroImage.

[58]  Jacek M. Zurada,et al.  An approach to multimodal biomedical image registration utilizing particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[59]  Nikos Paragios,et al.  Slice-to-volume medical image registration: a survey , 2017, Medical Image Anal..

[60]  Terry M. Peters,et al.  Image registration of ex-vivo MRI to sparsely sectioned histology of hippocampal and neocortical temporal lobe specimens , 2013, NeuroImage.

[61]  Hyunjin Park,et al.  Registration methodology for histological sections and in vivo imaging of human prostate. , 2008, Academic radiology.

[62]  D. Peck,et al.  Registration and warping of magnetic resonance images to histological sections. , 1999, Medical physics.

[63]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[64]  Charles R. Meyer,et al.  Mutual Information for Automated Unwarping of Rat Brain Autoradiographs , 1997, NeuroImage.

[65]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[66]  Frithjof Kruggel,et al.  Slice-to-Volume Nonrigid Registration of Histological Sections to MR Images of the Human Brain , 2010, Anatomy research international.