Automated parameter selection for segmentation of tube-like biological structures using optimization algorithm and mdl

Segmentation of tube-like biological structures, e.g., neurons and blood vessels, allows extraction of structural measurements supporting quantitative studies ranging from understanding neural growth to cancer research. While automated segmentation algorithms minimize subjectivity associated with tedious manual segmentation, they generally have parameter settings to cope with high variability in image data across applications. Currently, these settings are chosen empirically, formulated heuristically, or by trial-and-error with no assurance towards optimality. This work is motivated by the need to automatically select parameter settings for segmentation algorithms since they directly affect segmentation accuracy. An objective trade-off between a probabilistic measure of image-content coverage of a segmentation and its conciseness is based on the minimum description length principle (MDL). The recursive random search (RRS) optimization algorithm is used to efficiently explore combinations of segmentation algorithm parameter settings. For 3-D images, computation time is reduced by coordinated-optimizations on non-empty, representative subimages based on intensity and structural information. The method is initially applied to 223 2-D images of human retinal vasculature and cultured neurons, from four different sources, using a single segmentation algorithm with 8 parameters. Relative to default settings, improvements in the proposed MDL based segmentation quality metric are strongly correlated with improvements in agreement with ground truth (r = 0.78), ranging between 4.7--21% using 1000 function evaluations. Paired t-tests showed that improvements are statistically significant ( p < 0.0005). Most of the improvement occurred in the first 44 function evaluations. For 223 images, RRS outperforms other optimization algorithms (controlled random search, multi-start pattern search, simulated annealing, and genetic algorithm) on average at all 1000 function evaluations. RRS with 1000 function evaluations is on average within 3.56% of the global optimum (6,804,000 function evaluations). The proposed coordinated subimage-optimization method results in average speedup of 11.2X for 22 3-D neurons images. This enables non-expert users to use segmentation algorithms without knowledge of underlying algorithms, increases objectivity, and broadens applicability of the segmentation algorithm. It simplifies the user interface to just one optional parameter, creating a consistent interface that allows developers to freely modify the algorithms. The method allows adaptation of parameters across batches of images and delivers higher morphometric accuracy.

[1]  B. Ripley,et al.  Robust Statistics , 2018, Wiley Series in Probability and Statistics.

[2]  Ying Sun,et al.  Directional low-pass filtering for improved accuracy and reproducibility of stenosis quantification in coronary arteriograms , 1995, IEEE Trans. Medical Imaging.

[3]  K. Marti,et al.  Controlled Random Search Procedures for Global Optimization , 2020, International Series in Operations Research & Management Science.

[4]  Frédéric Galland,et al.  Minimum description length synthetic aperture radar image segmentation , 2003, IEEE Trans. Image Process..

[5]  Francis K. H. Quek,et al.  Vessel extraction in medical images by wave-propagation and traceback , 2001, IEEE Transactions on Medical Imaging.

[6]  A Hammoude An empirical parameter selection method for endocardial border identification algorithms. , 2001, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[7]  G Valli,et al.  An algorithm for real-time vessel enhancement and detection. , 1997, Computer methods and programs in biomedicine.

[8]  J. Alison Noble,et al.  Segmentation of Cerebral Vessels and Aneurysms from MR Angiography Data , 1997, IPMI.

[9]  Jürgen Weese,et al.  Multi-scale line segmentation with automatic estimation of width, contrast and tangential direction in 2D and 3D medical images , 1997, CVRMed.

[10]  Juan Ruiz-Alzola,et al.  Comments on: A methodology for evaluation of boundary detection algorithms on medical images , 2004, IEEE Trans. Medical Imaging.

[11]  Max A. Viergever,et al.  Vessel Axis Determination Using Wave Front Propagation Analysis , 2001, MICCAI.

[12]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Bir Bhanu,et al.  Object detection via feature synthesis using MDL-based genetic programming , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  I. K. Wood Neuroscience: Exploring the brain , 1996 .

[15]  J Hale,et al.  An Algorithm for MR Angiography Image Enhancement , 1995, Magnetic resonance in medicine.

[16]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[17]  P. Choyke,et al.  Gray-scale skeletonization of small vessels in magnetic resonance angiography , 2000, IEEE Transactions on Medical Imaging.

[18]  S. Schmidt,et al.  Quantitation of angiogenesis in the chick chorioallantoic membrane model using fractal analysis. , 1996, Microvascular research.

[19]  S. Pizer,et al.  Intensity ridge and widths for tubular object segmentation and description , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[20]  Bir Bhanu,et al.  Closed-loop object recognition using reinforcement learning , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  S. Joshi,et al.  Mesial temporal sclerosis and temporal lobe epilepsy: MR imaging deformation-based segmentation of the hippocampus in five patients. , 2000, Radiology.

[22]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[23]  M V Boland,et al.  Toward objective selection of representative microscope images. , 1999, Biophysical journal.

[24]  Badrinath Roysam,et al.  Automated Three-Dimensional Tracing of Neurons in Confocal and Brightfield Images , 2003, Microscopy and Microanalysis.

[25]  Dr. Zbigniew Michalewicz,et al.  How to Solve It: Modern Heuristics , 2004 .

[26]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[27]  R. Camplejohn,et al.  Introduction to flow cytometry: Computing , 1991 .

[28]  Kyuseok Shim,et al.  WALRUS: a similarity retrieval algorithm for image databases , 1999, IEEE Transactions on Knowledge and Data Engineering.

[29]  David B. Fogel,et al.  Evolutionary Computation: The Fossil Record , 1998 .

[30]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[31]  D L Parker,et al.  Vessel enhancement filtering in three‐dimensional MR angiography , 1995, Journal of magnetic resonance imaging : JMRI.

[32]  David H. Eberly,et al.  Ridges in Image and Data Analysis , 1996, Computational Imaging and Vision.

[33]  W. Brent Lindquist,et al.  Automated Algorithms for Multiscale Morphometry of Neuronal Dendrites , 2004, Neural Computation.

[34]  Badrinath Roysam,et al.  Automated image analysis methods for 3‐D quantification of the neurovascular unit from multichannel confocal microscope images , 2005, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[35]  M. Paradiso,et al.  Neuroscience: Exploring the brain, 3rd ed. , 2007 .

[36]  Yaghout Nourani,et al.  A comparison of simulated annealing cooling strategies , 1998 .

[37]  L. Armijo Minimization of functions having Lipschitz continuous first partial derivatives. , 1966 .

[38]  Mark A. Pitt,et al.  Advances in Minimum Description Length: Theory and Applications , 2005 .

[39]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[42]  Max A. Viergever,et al.  Scale and the differential structure of images , 1992, Image Vis. Comput..

[43]  José M. N. Leitão,et al.  A nonsmoothing approach to the estimation of vessel contours in angiograms , 1995, IEEE Trans. Medical Imaging.

[44]  Martin Styner,et al.  Parametric estimate of intensity inhomogeneities applied to MRI , 2000, IEEE Transactions on Medical Imaging.

[45]  J. Alison Noble,et al.  An adaptive segmentation algorithm for time-of-flight MRA data , 1999, IEEE Transactions on Medical Imaging.

[46]  Ching Y. Suen,et al.  Thinning Methodologies - A Comprehensive Survey , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Tao Ye,et al.  A recursive random search algorithm for large-scale network parameter configuration , 2003, SIGMETRICS '03.

[48]  Yongmin Kim,et al.  A methodology for evaluation of boundary detection algorithms on medical images , 1997, IEEE Transactions on Medical Imaging.

[49]  R. Jain,et al.  Automated tracing and change analysis of angiogenic vasculature from in vivo multiphoton confocal image time series. , 2003, Microvascular research.

[50]  Bowei Xi,et al.  A smart hill-climbing algorithm for application server configuration , 2004, WWW '04.

[51]  R K Jain,et al.  Quantitation and physiological characterization of angiogenic vessels in mice: effect of basic fibroblast growth factor, vascular endothelial growth factor/vascular permeability factor, and host microenvironment. , 1996, The American journal of pathology.

[52]  H.M. Wechsler,et al.  Digital image processing, 2nd ed. , 1981, Proceedings of the IEEE.

[53]  Yvan G. Leclerc,et al.  Constructing simple stable descriptions for image partitioning , 1989, International Journal of Computer Vision.

[54]  G. Shepherd,et al.  Geometric and functional organization of cortical circuits , 2005, Nature Neuroscience.

[55]  Dmitry B. Goldgof,et al.  An Objective Comparison Methodology of Edge Detection Algorithms Using a Structure from Motion Task , 1998, CVPR.

[56]  H. Moch,et al.  Angiogenesis in cervical neoplasia: microvessel quantitation in precancerous lesions and invasive carcinomas with clinicopathological correlations. , 1997, Gynecologic oncology.

[57]  Sudeep Sarkar,et al.  Comparison of edge detectors: a methodology and initial study , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[58]  Robert M. Haralick,et al.  A methodology for quantitative performance evaluation of detection algorithms , 1995, IEEE Trans. Image Process..

[59]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[60]  Abhir Bhalerao,et al.  Model Based Segmentation for Retinal Fundus Images , 2003, SCIA.

[61]  Dmitry B. Goldgof,et al.  Comparison of Edge Detector Performance through Use in an Object Recognition Task , 2001, Comput. Vis. Image Underst..

[62]  Dai Fukumura,et al.  Dissecting tumour pathophysiology using intravital microscopy , 2002, Nature Reviews Cancer.

[63]  Andrew Hunter,et al.  Measurement of retinal vessel widths from fundus images based on 2-D modeling , 2004, IEEE Transactions on Medical Imaging.

[64]  Y. J. Zhang,et al.  A survey on evaluation methods for image segmentation , 1996, Pattern Recognit..

[65]  Timothy F. Cootes,et al.  A minimum description length approach to statistical shape modeling , 2002, IEEE Transactions on Medical Imaging.

[66]  J. Giedt,et al.  Rensselaer Polytechnic Institute , 1960, Nature.

[67]  Charles V. Stewart,et al.  Predictive scheduling algorithms for real-time feature extraction and spatial referencing: application to retinal image sequences , 2004, IEEE Transactions on Biomedical Engineering.

[68]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[69]  Petia Radeva,et al.  Vesselness enhancement diffusion , 2003, Pattern Recognit. Lett..

[70]  C. Stewart Retinal Vessel Extraction Using Multiscale Matched Filters, Confidence and Edge Me , 2006 .

[71]  Khalid A. Al-Kofahi,et al.  Rapid automated three-dimensional tracing of neurons from confocal image stacks , 2002, IEEE Transactions on Information Technology in Biomedicine.

[72]  Guido Gerig,et al.  Multiscale detection of curvilinear structures in 2-D and 3-D image data , 1995, Proceedings of IEEE International Conference on Computer Vision.

[73]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[74]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[75]  J. van Pelt,et al.  Analysis of tubular structures in three-dimensional confocal images , 2002, Network.

[76]  L. Darrell Whitley,et al.  Searching in the Presence of Noise , 1996, PPSN.

[77]  W. Brent Lindquist,et al.  An Image Analysis Algorithm for Dendritic Spines , 2002, Neural Computation.

[78]  Gianni Di Pillo,et al.  A New Version of the Price's Algorithm for Global Optimization , 1997, J. Glob. Optim..

[79]  I E Magnin,et al.  Improved vessel visualization in MR angiography by nonlinear anisotropic filtering , 1997, Magnetic resonance in medicine.

[80]  W. Price Global optimization by controlled random search , 1983 .

[81]  Max A. Viergever,et al.  Multiscale vessel tracking , 2004, IEEE Transactions on Medical Imaging.

[82]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[83]  G. S. Watson Statistics on Spheres , 1983 .

[84]  D. Parker,et al.  Vessel enhancement filtering in three‐dimensional MR angiograms using long‐range signal correlation , 1997, Journal of magnetic resonance imaging : JMRI.

[85]  Stephen R. Aylward,et al.  Initialization, noise, singularities, and scale in height ridge traversal for tubular object centerline extraction , 2002, IEEE Transactions on Medical Imaging.

[86]  Hong Shen,et al.  Optimal scheduling of tracing computations for real-time vascular landmark extraction from retinal fundus images , 2001, IEEE Transactions on Information Technology in Biomedicine.

[87]  Alejandro F. Frangi,et al.  Model-based quantitation of 3-D magnetic resonance angiographic images , 1999, IEEE Transactions on Medical Imaging.

[88]  Joseph J. Capowski,et al.  Computer Techniques in Neuroanatomy , 1989, Springer US.

[89]  J. E. Falk,et al.  An Algorithm for Separable Nonconvex Programming Problems , 1969 .

[90]  W. Lunscher,et al.  Optimal Edge Detector Design I: Parameter Selection and Noise Effects , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[91]  D. Aykac,et al.  Segmentation and analysis of the human airway tree from three-dimensional X-ray CT images , 2003, IEEE Transactions on Medical Imaging.

[92]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[93]  Guido Gerig,et al.  Valmet: A New Validation Tool for Assessing and Improving 3D Object Segmentation , 2001, MICCAI.

[94]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo method , 1981, Wiley series in probability and mathematical statistics.

[95]  Badrinath Roysam,et al.  A hybrid 3D watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks , 2003, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[96]  Badrinath Roysam,et al.  Robust model-based vasculature detection in noisy biomedical images , 2004, IEEE Transactions on Information Technology in Biomedicine.

[97]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[98]  Sean Dougherty,et al.  Edge detector evaluation using empirical ROC curves , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[99]  Nicholas Ayache,et al.  Model-Based Detection of Tubular Structures in 3D Images , 2000, Comput. Vis. Image Underst..

[100]  P.K Sahoo,et al.  A survey of thresholding techniques , 1988, Comput. Vis. Graph. Image Process..

[101]  Max A. Viergever,et al.  Localization and segmentation of aortic endografts using marker detection , 2003, IEEE Transactions on Medical Imaging.

[102]  R.A. Zoroofi,et al.  Automatic extraction and measurement of leukocyte motion in microvessels using spatiotemporal image analysis , 1997, IEEE Transactions on Biomedical Engineering.

[103]  C. Storey,et al.  Application of Stochastic Global Optimization Algorithms to Practical Problems , 1997 .

[104]  Chia-Ling Tsai,et al.  The dual-bootstrap iterative closest point algorithm with application to retinal image registration , 2003, IEEE Transactions on Medical Imaging.

[105]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[106]  Sudeep Sarkar,et al.  Robust Visual Method for Assessing the Relative Performance of Edge-Detection Algorithms , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[107]  J. Koenderink The structure of images , 2004, Biological Cybernetics.

[108]  M. Stephens EDF Statistics for Goodness of Fit and Some Comparisons , 1974 .

[109]  Keith W. Ross,et al.  Computer networking - a top-down approach featuring the internet , 2000 .

[110]  Zelda B. Zabinsky,et al.  Stochastic Methods for Practical Global Optimization , 1998, J. Glob. Optim..

[111]  Jorma Rissanen,et al.  The Minimum Description Length Principle in Coding and Modeling , 1998, IEEE Trans. Inf. Theory.

[112]  Hong Shen,et al.  Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms , 1999, IEEE Transactions on Information Technology in Biomedicine.

[113]  Kevin W. Bowyer,et al.  Comparison of Edge Detectors Using an Object Recognition Task , 1999, CVPR.

[114]  Yitzhak Yitzhaky,et al.  A Method for Objective Edge Detection Evaluation and Detector Parameter Selection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[115]  Robert M. Haralick,et al.  Ridges and valleys on digital images , 1983, Comput. Vis. Graph. Image Process..

[116]  Khalid A. Al-Kofahi,et al.  Median-based robust algorithms for tracing neurons from noisy confocal microscope images , 2003, IEEE Transactions on Information Technology in Biomedicine.

[117]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[118]  Peter Meer,et al.  Edge Detection with Embedded Confidence , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[119]  S. Laxminarayan,et al.  Angiography and Plaque Imaging: Advanced Segmentation Techniques , 2007 .

[120]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[121]  José M. N. Leitão,et al.  Unsupervised contour representation and estimation using B-splines and a minimum description length criterion , 2000, IEEE Trans. Image Process..

[122]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[123]  Sebastian Stier,et al.  Extraction of line properties based on direction fields , 1996, IEEE Trans. Medical Imaging.

[124]  Badrinath Roysam,et al.  Associative Multiple-Label Image Analysis Method for Synapse Identification in Neuronal Cultures: Application to Comparative Analysis of Synapse Formation Efficiency & Distribution on Smooth and Topographically Modified Surfaces , 2005 .

[125]  Thomas Scheper,et al.  Flow cytometry in biotechnology , 2001, Applied Microbiology and Biotechnology.

[126]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[127]  Mark W. Powell,et al.  Automated performance evaluation of range image segmentation algorithms , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[128]  G. T. Timmer,et al.  Stochastic global optimization methods part II: Multi level methods , 1987, Math. Program..

[129]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[130]  J N Turner,et al.  Topographically modified surfaces affect orientation and growth of hippocampal neurons , 2004, Journal of neural engineering.

[131]  Chia-Ling Tsai,et al.  Model-based method for improving the accuracy and repeatability of estimating vascular bifurcations and crossovers from retinal fundus images , 2004, IEEE Transactions on Information Technology in Biomedicine.

[132]  P E Summers,et al.  Multiresolution, model‐based segmentation of MR angiograms , 1997, Journal of magnetic resonance imaging : JMRI.

[133]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[134]  D. Pinkel,et al.  Segmentation of confocal microscope images of cell nuclei in thick tissue sections , 1999, Journal of microscopy.

[135]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[136]  Jim R. Parker,et al.  Use of multiple algorithms in image content searches , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[137]  Benoit M. Dawant,et al.  Morphometric analysis of white matter lesions in MR images: method and validation , 1994, IEEE Trans. Medical Imaging.

[138]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[139]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[140]  E Meijering,et al.  Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[141]  J. Hannan,et al.  Introduction to probability and mathematical statistics , 1986 .

[142]  J. Morel,et al.  Variational Methods in Image Segmentation: with seven image processing experiments , 1994 .

[143]  Anil K. Jain,et al.  Goal-Directed Evaluation of Binarization Methods , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[144]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[145]  Carsten Steger,et al.  An Unbiased Detector of Curvilinear Structures , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[146]  Patrick D. Surry,et al.  Fundamental Limitations on Search Algorithms: Evolutionary Computing in Perspective , 1995, Computer Science Today.

[147]  Kenneth A. De Jong,et al.  An Analysis of the Interacting Roles of Population Size and Crossover in Genetic Algorithms , 1990, PPSN.

[148]  Alejandro F. Frangi,et al.  3D MRA coronary axis determination using a minimum cost path approach , 2002, Magnetic resonance in medicine.

[149]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[150]  O. SIAMJ.,et al.  ON THE CONVERGENCE OF PATTERN SEARCH ALGORITHMS , 1997 .