Rapid automated three-dimensional tracing of neurons from confocal image stacks

Algorithms are presented for fully automatic three-dimensional (3D) tracing of neurons that are imaged by fluorescence confocal microscopy. Unlike previous voxel-based skeletonization methods, the present approach works by recursively following the neuronal topology, using a set of 4 /spl times/ N/sup 2/ directional kernels (e.g., N = 32), guided by a generalized 3D cylinder model. This method extends our prior work on exploratory tracing of retinal vasculature to 3D space. Since the centerlines are of primary interest, the 3D extension can be accomplished by four rather than six sets of kernels. Additional modifications, such as dynamic adaptation of the correlation kernels, and adaptive step size estimation, were introduced for achieving robustness to photon noise, varying contrast, and apparent discontinuity and/or hollowness of structures. The end product is a labeling of all somas present, graph-theoretic representations of all dendritic/axonal structures, and image statistics such as soma volume and centroid, soma interconnectivity, the longest branch, and lengths of all graph branches originating from a soma. This method is able to work directly with unprocessed confocal images, without expensive deconvolution or other preprocessing. It is much faster that skeletonization, typically consuming less than a minute to trace a 70 MB image on a 500 MHz computer. These properties make it attractive for large-scale automated tissue studies that require rapid on-line image analysis, such as high-throughput neurobiology/angiogenesis assays, and initiatives such as the Human Brain Project.

[1]  P D Coleman,et al.  Automated three-dimensional dendrite tracking system. , 1973, Electroencephalography and clinical neurophysiology.

[2]  William Simon,et al.  Semiautomatic Tracking of Neuronal Processes , 1977 .

[3]  S. Cullheim,et al.  A quantitative light microscopic study of the dendrites of cat spinal γ‐motoneurons after intracellular staining with horseradish peroxidase , 1981, The Journal of comparative neurology.

[4]  J. Kellerth,et al.  Electrophysiological and morphological measurements in cat gastrocnemius and soleus α-motoneurones , 1984, Brain Research.

[5]  J. Sklansky,et al.  Computing the skeleton of coronary arteries in cineangiograms. , 1986, Computers and biomedical research, an international journal.

[6]  R. Burke,et al.  Membrane area and dendritic structure in type‐identified triceps surae alpha motoneurons , 1987, The Journal of comparative neurology.

[7]  P. Eichel,et al.  A method for a fully automatic definition of coronary arterial edges from cineangiograms. , 1988, IEEE transactions on medical imaging.

[8]  Jan J. Gerbrands,et al.  Automated Centerline Tracing in Coronary Angiograms , 1988 .

[9]  Jae S. Lim,et al.  A new method for estimation of coronary artery dimensions in angiograms , 1988, IEEE Trans. Acoust. Speech Signal Process..

[10]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[11]  Joseph J. Capowski,et al.  Computer Techniques in Neuroanatomy , 1989, Springer US.

[12]  Y Sun,et al.  Automated identification of vessel contours in coronary arteriograms by an adaptive tracking algorithm. , 1989, IEEE transactions on medical imaging.

[13]  J. Clements,et al.  Cable properties of cat spinal motoneurones measured by combining voltage clamp, current clamp and intracellular staining. , 1989, The Journal of physiology.

[14]  E M Glaser,et al.  Neuron imaging with Neurolucida--a PC-based system for image combining microscopy. , 1990, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[15]  Y. Sun,et al.  Segmentation of coronary arteriograms by iterative ternary classification , 1990, IEEE Transactions on Biomedical Engineering.

[16]  J. Pawley,et al.  Handbook of Biological Confocal Microscopy , 1990, Springer US.

[17]  M. Garreau,et al.  A knowledge-based approach for 3-D reconstruction and labeling of vascular networks from biplane angiographic projections. , 1991, IEEE transactions on medical imaging.

[18]  T. Woolsey,et al.  Computer-aided analyses of thalamocortical afferent ingrowth. , 1991, Cerebral cortex.

[19]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[20]  Karen L. Smith,et al.  Confocal microscopy and three-dimensional reconstruction of electrophysiologically identified neurons in thick brain slices. , 1991, Journal of electron microscopy technique.

[21]  M. Goldbaum,et al.  DIGITAL OVERLAY OF FLUORESCEIN ANGIOGRAMS AND FUNDUS IMAGES FOR TREATMENT OF SUBRETINAL NEOVASCULARIZATION , 1992, Retina.

[22]  S. Collins,et al.  Reduction of failure rates in automated analysis of difficult images: improved simultaneous detection of left and right coronary borders , 1992, Proceedings Computers in Cardiology.

[23]  J. Reiber,et al.  A new algorithm to detect irregular coronary boundaries: the gradient field transform , 1992, Proceedings Computers in Cardiology.

[24]  Luc Vincent,et al.  Morphological grayscale reconstruction: definition, efficient algorithm and applications in image analysis , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Jayaram K. Udupa,et al.  Adaptive boundary detection using 'live-wire' two-dimensional dynamic programming , 1992, Proceedings Computers in Cardiology.

[26]  Jack Sklansky,et al.  Reconstructing the cross sections of coronary arteries from biplane angiograms , 1992, IEEE Trans. Medical Imaging.

[27]  Mark Nelson,et al.  Automated registration of digital ocular fundus images for comparison of lesions , 1993, Photonics West - Lasers and Applications in Science and Engineering.

[28]  Ying Sun,et al.  Recursive tracking of vascular networks in angiograms based on the detection-deletion scheme , 1993, IEEE Trans. Medical Imaging.

[29]  B Willis,et al.  Iterative, constrained 3‐D image reconstruction of transmitted light bright‐field micrographs based on maximum likelihood estimation , 1993, Journal of microscopy.

[30]  M. Hart,et al.  A method of automated coronary artery tracking in unsubtracted angiograms , 1993, Proceedings of Computers in Cardiology Conference.

[31]  B. Matsumoto Cell biological applications of confocal microscopy , 1993 .

[32]  Shan Lu,et al.  Automatic detection of the coronary arterial contours with sub-branches from an X-ray angiogram , 1993, Proceedings of Computers in Cardiology Conference.

[33]  A. K. Klein,et al.  Identifying vascular features with orientation specific filters and B-spline snakes , 1994, Computers in Cardiology 1994.

[34]  S. Collins,et al.  Lumen centerline detection in complex coronary angiograms , 1994, IEEE Transactions on Biomedical Engineering.

[35]  Liang Zhou,et al.  The detection and quantification of retinopathy using digital angiograms , 1994, IEEE Trans. Medical Imaging.

[36]  Andrew R. Cohen,et al.  Automated tracing and volume measurements of neurons from 3‐D confocal fluorescence microscopy data , 1994, Journal of microscopy.

[37]  R Collorec,et al.  Computer vision approaches for the three-dimensional reconstruction of coronary arteries: review and prospects. , 1994, Critical reviews in biomedical engineering.

[38]  Ying Sun,et al.  Directional low-pass filtering for improved accuracy and reproducibility of stenosis quantification in coronary arteriograms , 1995, IEEE Trans. Medical Imaging.

[39]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[40]  Milan Sonka,et al.  Robust simultaneous detection of coronary borders in complex images , 1995, IEEE Trans. Medical Imaging.

[41]  Badrinath Roysam,et al.  Light Microscopic Images Reconstructed by Maximum Likelihood Deconvolution , 1995 .

[42]  José M. N. Leitão,et al.  A nonsmoothing approach to the estimation of vessel contours in angiograms , 1995, IEEE Trans. Medical Imaging.

[43]  Sebastian Stier,et al.  Extraction of line properties based on direction fields , 1996, IEEE Trans. Medical Imaging.

[44]  Albert M. Vossepoel,et al.  Adaptive Vectorization of Line Drawing Images , 1997, Comput. Vis. Image Underst..

[45]  R. Poli,et al.  An algorithm for real-time vessel enhancement and detection. , 1997, Computer methods and programs in biomedicine.

[46]  G. Šimić,et al.  Volume and number of neurons of the human hippocampal formation in normal aging and Alzheimer's disease , 1997, The Journal of comparative neurology.

[47]  Hong Shen,et al.  Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms , 1999, IEEE Transactions on Information Technology in Biomedicine.

[48]  J. Mong,et al.  Gonadal Steroids Promote Glial Differentiation and Alter Neuronal Morphology in the Developing Hypothalamus in a Regionally Specific Manner , 1999, The Journal of Neuroscience.

[49]  Christopher J. Pace,et al.  Confocal Light Microscopy of Brain Cells and Tissue: Image Analysis & Quantitation , 1999 .

[50]  Hong Shen,et al.  Optimal scheduling of tracing computations for real-time vascular landmark extraction from retinal fundus images , 2001, IEEE Transactions on Information Technology in Biomedicine.

[51]  Ram Shanmugam Neuroinformatics: An overview of the Human Brain Project : Stephen H. Koslow and Michael F. Huerta (Eds.); Lawrence Erlbaum Associates Press, Mahwah, NJ, 1997, pp 376, ISBN 0-8058-2099-X , 2001, Neurocomputing.

[52]  G. Cox Biological confocal microscopy , 2002 .

[53]  L. Vincent Morphological Algorithms , 2018, Mathematical Morphology in Image Processing.