Automated Three-Dimensional Tracing of Neurons in Confocal and Brightfield Images

Automated three-dimensional (3-D) image analysis methods are presented for tracing of dye-injected neurons imaged by fluorescence confocal microscopy and HRP-stained neurons imaged by transmitted-light brightfield microscopy. An improved algorithm for adaptive 3-D skeletonization of noisy images enables the tracing. This algorithm operates by performing connectivity testing over large N x N x N voxel neighborhoods exploiting the sparseness of the structures of interest, robust surface detection that improves upon classical vacant neighbor schemes, improved handling of process ends or tips based on shape collapse prevention, and thickness-adaptive thinning. The confocal image stacks were skeletonized directly. The brightfield stacks required 3-D deconvolution. The results of skeletonization were analyzed to extract a graph representation. Topological and metric analyses can be carried out using this representation. A semiautomatic method was developed for reconnection of dendritic fragments that are disconnected due to insufficient dye penetration, an imaging deficiency, or skeletonization errors.

[1]  Rangasami L. Kashyap,et al.  Building Skeleton Models via 3-D Medial Surface/Axis Thinning Algorithms , 1994, CVGIP Graph. Model. Image Process..

[2]  A. Fine,et al.  Confocal microscopy: applications in neurobiology , 1988, Trends in Neurosciences.

[3]  Arthur W. Toga,et al.  Efficient Skeletonization of Volumetric Objects , 1999, IEEE Trans. Vis. Comput. Graph..

[4]  J. Roerdink,et al.  MATHEMATICAL MORPHOLOGY AND ITS APPLICATIONS TO IMAGE PROCESSING , 1994 .

[5]  Khalid A. Al-Kofahi,et al.  Rapid automated three-dimensional tracing of neurons from confocal image stacks , 2002, IEEE Transactions on Information Technology in Biomedicine.

[6]  S. Hell,et al.  Aberrations in confocal fluorescence microscopy induced by mismatches in refractive index , 1993 .

[7]  Karen L. Smith,et al.  Parameters affecting imaging of the horseradish‐peroxidase‐diaminobenzidine reaction product in the confocal scanning laser microscope , 1990, Journal of microscopy.

[8]  T J Holmes,et al.  Richardson-Lucy/maximum likelihood image restoration algorithm for fluorescence microscopy: further testing. , 1989, Applied optics.

[9]  Frans C. A. Groen,et al.  Three-Dimensional Skeletonization: Principle and Algorithm , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Michael Wang,et al.  Automated image analysis technologies for biological 3D light microscopy , 1997 .

[11]  D. Szarowski,et al.  Advances in automated 3-D image analyses of cell populations imaged by confocal microscopy. , 1996, Cytometry.

[12]  J. Clements,et al.  Cable properties of cat spinal motoneurones measured by combining voltage clamp, current clamp and intracellular staining. , 1989, The Journal of physiology.

[13]  Hartmut Schirmacher,et al.  Boundary Surface Shrinking - a Continuous Approach to 3D Center Line Extraction , 1998 .

[14]  Hong Shen,et al.  Optimal scheduling of tracing computations for real-time vascular landmark extraction from retinal fundus images , 2001, IEEE Transactions on Information Technology in Biomedicine.

[15]  Badrinath Roysam,et al.  Unsupervised noise removal algorithms for 3-D confocal fluorescence microscopy , 1992, Electronic Imaging.

[16]  R. Aikens,et al.  Solid-state imagers for microscopy. , 1989, Methods in cell biology.

[17]  Cherng-Min Ma Connectivity Preservation of 3D 6-Subiteration Thinning Algorithms , 1996, CVGIP Graph. Model. Image Process..

[18]  Paul H. Lewis,et al.  Extracting generalized cylinder models of dendritic trees from 3D image stacks , 1998, Photonics West - Biomedical Optics.

[19]  M I Miller,et al.  Bayesian image reconstruction for emission tomography incorporating Good's roughness prior on massively parallel processors. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Bidyut Baran Chaudhuri,et al.  Detection of 3-D Simple Points for Topology Preserving Transformations with Application to Thinning , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  R. Burke,et al.  Membrane area and dendritic structure in type‐identified triceps surae alpha motoneurons , 1987, The Journal of comparative neurology.

[22]  P D Coleman,et al.  Automated three-dimensional dendrite tracking system. , 1973, Electroencephalography and clinical neurophysiology.

[23]  Karen L. Smith,et al.  Ultrastructural investigation of neurons identified and localized using the confocal scanning laser microscope. , 1991, Journal of electron microscopy technique.

[24]  Jieun Kim,et al.  Automatic morphometric analysis of neural cells , 1998 .

[25]  T J Holmes,et al.  Blind deconvolution of quantum-limited incoherent imagery: maximum-likelihood approach. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[26]  King-Sun Fu,et al.  A parallel thinning algorithm for 3-D pictures , 1981 .

[27]  David A. Agard,et al.  Three-Dimensional Microscopy: Image Processing For High Resolution Subcellular Imaging , 1989, Optics & Photonics.

[28]  Gilles Bertrand,et al.  A note on "Thinning of 3-D images using the Safe Point Thinning Algorithm (SPTA)" , 1990, Pattern Recognit. Lett..

[29]  D A Turner,et al.  Dendrites of classes of hippocampal neurons differ in structural complexity and branching patterns , 1999, The Journal of comparative neurology.

[30]  Hong Shen,et al.  Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms , 1999, IEEE Transactions on Information Technology in Biomedicine.

[31]  Timothy J. Holmes Maximum-likelihood image restoration adapted for noncoherent optical imaging , 1988 .

[32]  Partha Pratim Das,et al.  Thinning of 3-D images using the Safe Point Thinning Algorithm (SPTA) , 1989, Pattern Recognit. Lett..

[33]  Alfred V. Aho,et al.  Data Structures and Algorithms , 1983 .

[34]  Longin Jan Latecki,et al.  An Algorithm for a 3D Simplicity Test , 1996, Comput. Vis. Image Underst..

[35]  D. Agard Optical sectioning microscopy: cellular architecture in three dimensions. , 1984, Annual review of biophysics and bioengineering.

[36]  Milan Sonka,et al.  A Fully Parallel 3D Thinning Algorithm and Its Applications , 1996, Comput. Vis. Image Underst..

[37]  Badrinath Roysam,et al.  Light Microscopic Images Reconstructed by Maximum Likelihood Deconvolution , 1995 .

[38]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[39]  Andrew R. Cohen,et al.  Automated tracing and volume measurements of neurons from 3‐D confocal fluorescence microscopy data , 1994, Journal of microscopy.

[40]  Edward R. Dougherty,et al.  An introduction to morphological image processing , 1992 .

[41]  Gerald Krell,et al.  Tracking on tree-like structures in 3-D confocal images , 1998 .

[42]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[43]  S. Cullheim,et al.  A quantitative light microscopic study of the dendrites of cat spinal γ‐motoneurons after intracellular staining with horseradish peroxidase , 1981, The Journal of comparative neurology.

[44]  Joseph J. Capowski,et al.  Computer Techniques in Neuroanatomy , 1989, Springer US.

[45]  Ching Y. Suen,et al.  Thinning Methodologies - A Comprehensive Survey , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  J. Kellerth,et al.  Electrophysiological and morphological measurements in cat gastrocnemius and soleus α-motoneurones , 1984, Brain Research.

[47]  Cherng Min Ma,et al.  On topology preservation in 3D thinning , 1994 .

[48]  James N. Turner,et al.  Confocal scanning laser microscope images of hippocampal neurons intracellularly labeled with biocytin , 1990, Journal of Neuroscience Methods.

[49]  Anca Dima,et al.  Automatic 3D-graph construction of nerve cells from confocal microscope scans , 2003 .

[50]  William Simon,et al.  Semiautomatic Tracking of Neuronal Processes , 1977 .