Algorithms for accurate 3D registration of neuronal images acquired by confocal scanning laser microscopy

This paper presents automated and accurate algorithms based on high‐order transformation models for registering three‐dimensional (3D) confocal images of dye‐injected neurons. The algorithms improve upon prior methods in several ways, and meet the more stringent image registration needs of applications such as two‐view attenuation correction recently developed by us. First, they achieve high accuracy (≈ 1.2 voxels, equivalent to 0.4 µm) by using landmarks, rather than intensity correlations, and by using a high‐dimensional affine and quadratic transformation model that accounts for 3D translation, rotation, non‐isotropic scaling, modest curvature of field, distortions and mechanical inconsistencies introduced by the imaging system. Second, they use a hierarchy of models and iterative algorithms to eliminate potential instabilities. Third, they incorporate robust statistical methods to achieve accurate registration in the face of inaccurate and missing landmarks. Fourth, they are fully automated, even estimating the initial registration from the extracted landmarks. Finally, they are computationally efficient, taking less than a minute on a 900‐MHz Pentium III computer for registering two images roughly 70 MB in size. The registration errors represent a combination of modelling, estimation, discretization and neuron tracing errors. Accurate 3D montaging is described; the algorithms have broader applicability to images of vasculature, and other structures with distinctive point, line and surface landmarks.

[1]  A. O. Dennis Willows,et al.  Computer-assisted visualizations of neural networks: expanding the field of view using seamless confocal montaging , 2000, Journal of Neuroscience Methods.

[2]  C. Q. Little,et al.  Registration of range data using a hybrid simulated annealing and iterative closest point algorithm , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  J. Tukey,et al.  The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data , 1974 .

[4]  E H Oldmixon,et al.  Methods for large data volumes from confocal scanning laser microscopy of lung , 1993, Journal of microscopy.

[5]  Badrinath Roysam,et al.  A Robust Two-View Method for Increasing the Imaging Depth and Correcting for Signal Attenuation in Confocal Microscope Images , 2000, Microscopy and Microanalysis.

[6]  Pavel V. Belichenko,et al.  Confocal Laser Scanning Microscopy and 3-D Reconstructions of Neuronal Structures in Human Brain Cortex , 1995, NeuroImage.

[7]  Charles V. Stewart,et al.  A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[9]  D. Szarowski,et al.  Advances in automated 3-D image analyses of cell populations imaged by confocal microscopy. , 1996, Cytometry.

[10]  Robert B. Fisher,et al.  A Comparison of Four Algorithms for Estimating 3-D Rigid Transformations , 1995, BMVC.

[11]  S. Paddock,et al.  Confocal laser scanning microscopy. , 1999, BioTechniques.

[12]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[13]  Khalid A. Al-Kofahi,et al.  Rapid automated three-dimensional tracing of neurons from confocal image stacks , 2002, IEEE Transactions on Information Technology in Biomedicine.

[14]  S. Bradbury,et al.  Introduction to Light Microscopy , 1998 .

[15]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[16]  Martin D. Levine,et al.  Registering Multiview Range Data to Create 3D Computer Objects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Charles V. Stewart,et al.  Robust Parameter Estimation in Computer Vision , 1999, SIAM Rev..

[18]  Hong Shen,et al.  Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms , 1999, IEEE Transactions on Information Technology in Biomedicine.

[19]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[20]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[21]  J N Turner,et al.  Automated 3-D montage synthesis from laser-scanning confocal images: application to quantitative tissue-level cytological analysis. , 1996, Cytometry.

[22]  O. A L-Ko F A H I,et al.  Attenuation correction in confocal laser microscopes : a novel two-view approach , 2003 .

[23]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Viergever,et al.  An Overview of Medical Image Registration Methods , 1998 .

[25]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[26]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Werner A. Stahel,et al.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[28]  C. Jennison,et al.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[29]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[30]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[31]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[32]  Martin Capek,et al.  Alignment of adjacent picture frames captured by a CLSM , 1997, IEEE Transactions on Information Technology in Biomedicine.

[33]  George Nagy,et al.  Volumetric registration based on intensity and geometry features , 2002 .

[34]  Kenichi Kanatani,et al.  Analysis of 3-D Rotation Fitting , 1994, IEEE Trans. Pattern Anal. Mach. Intell..