Smoothness-guided 3-D reconstruction of 2-D histological images

This paper tackles two problems: (1) the reconstruction of 3-D volumes from 2-D post-mortem slices (e.g., histology, autoradiography, immunohistochemistry) in the absence of external reference, and (2) the quantitative evaluation of the 3-D reconstruction. We note that the quality of a reconstructed volume is usually assessed by considering the smoothness of some reconstructed structures of interest (e.g., the gray-white matter surfaces in brain images). Here we propose to use smoothness as a means to drive the reconstruction process itself. From a pair-wise rigid reconstruction of the 2-D slices, we first extract the boundaries of structures of interest. Those are then smoothed with a min-max curvature flow confined to the 2-D planes in which the slices lie. Finally, for each slice, we estimate a linear or flexible transformation from the sparse displacement field computed from the flow, which we apply to the original 2-D slices to obtain a smooth volume. In addition, we present a co-occurrence matrix-based technique to quantify the smoothness of reconstructed volumes. We discuss and validate the application of both our reconstruction approach and the smoothness measure on synthetic examples as well as real histological data.

[1]  Sébastien Ourselin,et al.  Reconstructing a 3D structure from serial histological sections , 2001, Image Vis. Comput..

[2]  Richard A. Baldock,et al.  Robust Point Correspondence Applied to Two-and Three-Dimensional Image Registration , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Alberto F. Goldszal,et al.  Multimodality multidimensional image analysis of cortical and subcortical plasticity in the rat brain , 2007, Annals of Biomedical Engineering.

[4]  James A. Sethian,et al.  Flows under Min/Max Curvature Flow and Mean Curvature: Applications in Image Processing , 1996, ECCV.

[5]  S Baheerathan,et al.  Registration of serial sections of mouse liver cell nuclei , 1998, Journal of microscopy.

[6]  M. Mallar Chakravarty,et al.  Three-dimensional reconstruction of serial histological mouse brain sections , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[7]  Alain Pitiot,et al.  Geometrical regularization of displacement fields for histological image registration , 2008, Medical Image Anal..

[8]  Tony P. Pridmore,et al.  Smooth 3-D Reconstruction for 2-D Histological Images , 2009, IPMI.

[9]  James A. Sethian,et al.  Level Set Methods for Curvature Flow, Image Enchancement, and Shape Recovery in Medical Images , 1997, VisMath.

[10]  J Streicher,et al.  External marker‐based automatic congruencing: A new method of 3D reconstruction from serial sections , 1997, The Anatomical record.

[11]  Charles R. Meyer,et al.  Co-Registration of MRI and Autoradiography of Rat Brain in Three-Dimensions Following Automatic Reconstruction of 2D Data Set , 1995, CVRMed.

[12]  Jing Hua,et al.  FEATURE CURVE-GUIDED VOLUME RECONSTRUCTION FROM 2D IMAGES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Grégoire Malandain,et al.  Intensity Compensation within Series of Images , 2003, MICCAI.

[14]  Hans-Christian Hege,et al.  Visualization and Mathematics III , 2011 .

[15]  Sébastien Ourselin,et al.  A three-dimensional, histological and deformable atlas of the human basal ganglia. I. Atlas construction based on immunohistochemical and MRI data , 2007, NeuroImage.

[16]  Grégoire Malandain,et al.  Fusion of autoradiographs with an MR volume using 2-D and 3-D linear transformations , 2004, NeuroImage.

[17]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[18]  Sébastien Ourselin,et al.  Fusion of Histological Sections and MR Images: Towards the Construction of an Atlas of the Human Basal Ganglia , 2001, MICCAI.

[19]  Charles R. Meyer,et al.  Mutual Information for Automated Unwarping of Rat Brain Autoradiographs , 1997, NeuroImage.

[20]  J. Humm,et al.  The spatial accuracy of cellular dose estimates obtained from 3D reconstructed serial tissue autoradiographs. , 1995, Physics in medicine and biology.

[21]  Roee S. Lazebnik,et al.  Three-Dimensional Registration of Magnetic Resonance Image Data to Histological Sections with Model-Based Evaluation , 2005, Annals of Biomedical Engineering.

[22]  Alain Pitiot,et al.  Magnetic resonance imaging as a tool for in vivo and ex vivo anatomical phenotyping in experimental genetic models , 2007, Human brain mapping.

[23]  A W Toga,et al.  Postmortem cryosectioning as an anatomic reference for human brain mapping. , 1997, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[24]  R. Woods,et al.  Mapping Histology to Metabolism: Coregistration of Stained Whole-Brain Sections to Premortem PET in Alzheimer's Disease , 1997, NeuroImage.

[25]  A. Toga,et al.  A SURFACE-BASED TECHNIQUE FOR WARPING 3-DIMENSIONAL IMAGES OF THE BRAIN , 2000 .

[26]  F. S. Cohen,et al.  Automatic matching of homologous histological sections , 1998, IEEE Transactions on Biomedical Engineering.

[27]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[28]  Sébastien Ourselin,et al.  Co-registration of Histological, Optical and MR Data of the Human Brain , 2002, MICCAI.

[29]  Jonathan Nissanov,et al.  Elastic 3-D alignment of rat brain histological images , 2003, IEEE Transactions on Medical Imaging.

[30]  J. Modersitzki,et al.  Super-fast elastic registration of histologic images of a whole rat brain for three-dimensional reconstruction , 2010 .

[31]  Calvin C. Gotlieb,et al.  Texture descriptors based on co-occurrence matrices , 1990, Comput. Vis. Graph. Image Process..

[32]  Richard Baldock,et al.  Automatic reconstruction of serial sections using the finite element method , 1995 .

[33]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[34]  Jean-Francois Mangin,et al.  Robust Inter-slice Intensity Normalization Using Histogram Scale-Space Analysis , 2004, MICCAI.

[35]  Karl Zilles,et al.  Limitations of the principal-axes theory , 1997, IEEE Transactions on Medical Imaging.

[36]  Alan C. F. Colchester,et al.  Using Curve-Fitting of Curvilinear Features for Assessing Registration of Clinical Neuropathology with in Vivo MRI , 2008, MICCAI.

[37]  D. Collins,et al.  The creation of a brain atlas for image guided neurosurgery using serial histological data , 2003, NeuroImage.

[38]  Olivier D. Faugeras,et al.  Level Sets and Distance Functions , 2000, ECCV.

[39]  Ioannis Pitas,et al.  3D Volume Reconstruction by Serially Acquired 2D Slices Using a Distance Transform-Based Global Cost Function , 2002, SETN.

[40]  Alberto F. Goldszal,et al.  Three-Dimensional Reconstruction of Activated Columns from 2-[14C]Deoxy-d-glucose Data , 1995, NeuroImage.

[41]  Markus Löffler,et al.  Three-dimensional reconstruction and quantification of cervical carcinoma invasion fronts from histological serial sections , 2005, IEEE Transactions on Medical Imaging.

[42]  N. Ayache,et al.  Three-dimensional reconstruction of stained histological slices and 3D non-linear registration with in-vivo MRI for whole baboon brain , 2007, Journal of Neuroscience Methods.

[43]  M H Deverell,et al.  Three-dimensional reconstruction: methods of improving image registration and interpretation. , 1993, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[44]  Geneva G. Belford,et al.  An extendable registration similarity metric for anatomical image sequence alignment , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[45]  Paul M. Thompson,et al.  A surface-based technique for warping three-dimensional images of the brain , 1996, IEEE Trans. Medical Imaging.

[46]  Sébastien Ourselin,et al.  Block Matching: A General Framework to Improve Robustness of Rigid Registration of Medical Images , 2000, MICCAI.

[47]  Tao Ju,et al.  3D volume reconstruction of a mouse brain from histological sections using warp filtering , 2006, Journal of Neuroscience Methods.

[48]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[49]  Stefan Heldmann,et al.  International Journal of Computer Vision c ○ 2006 Springer Science + Business Media, LLC. Manufactured in the United States. DOI: 10.1007/s11263-006-9780-x Image Registration of Sectioned Brains , 2004 .

[50]  Brian B. Avants,et al.  3D Mouse Brain Reconstruction from Histology Using a Coarse-to-Fine Approach , 2006, WBIR.

[51]  P. Rousseeuw Least Median of Squares Regression , 1984 .

[52]  Tzay Y. Young,et al.  Registration and three-dimensional reconstruction of autoradiographic images by the disparity analysis method , 1993, IEEE Trans. Medical Imaging.

[53]  Grégoire Malandain,et al.  A low temperature embedding and section registration strategy for 3D image reconstruction of the rat brain from autoradiographic sections , 2006, Journal of Neuroscience Methods.