Tracking and Describing Deformable Objects Using Active Contour Models

Technical Report TR-CIM-90-9 In this thesis we consider a number of issues in developing techniques and algorithms to automate the visual tracking of deformable objects in the plane. We have applied these techniques in cell locomotion and tracking studies. We examine two classes of computer vision problems. First, we consider the segmentation of a noisy intensity image and the tracking of a nonrigid object. Second, we consider the shape analysis of an amorphous object. In evaluating these problems, we explore a new technique based on an active contour model commonly called a "snake." The snake permits us to simultaneously solve, in constrained cases, both the segmentation and tracking problems. We present a detailed analysis of the snake model, emphasizing its limitations and shortcomings, and propose various improvements to the original description of the model. Then, we study the two complementary types of shape descriptors: boundary- and region-based. We propose to combine these within the context of the grassfire transform. Two new algorithms are described. First, we present a contour segmentation technique using mathematical morphology on the curvature function, we call curvature morphology. Accurate localization for different scales of curvature features is achieved, leading to a Morphological Curvature Scale-space or MCS. Second, the snake model is used to simulate the grassfire transform using the previously extracted contour features. This permits us to produce a multiscale skeleton representation of shape which is based on the Euclidean distance metric. New significance criteria for our shape descriptors, such as the ``region-support'' of curvature extrema and the ``ridge-support'' of skeleton branches are also proposed. Finally, numerous implementation details are discussed; for example, the description of an efficient sequential Euclidean distance transform.

[1]  E. Neville,et al.  Introduction a la Geometrie Infinitesimale Directe , 1933 .

[2]  C. Zheng,et al.  ; 0 ; , 1951 .

[3]  H. Piaggio Differential Geometry of Curves and Surfaces , 1952, Nature.

[4]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[5]  I. G. BONNER CLAPPISON Editor , 1960, The Electric Power Engineering Handbook - Five Volume Set.

[6]  Harry Blum,et al.  An Associative Machine for Dealing with the Visual Field and Some of Its Biological Implications , 1962 .

[7]  A. Goodman A Partial Differential Equation and Parallel Plane Curves , 1964 .

[8]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[9]  M. Forray,et al.  Variational Calculus in Science and Engineering , 1968 .

[10]  A. ROSENFELD,et al.  Distance functions on digital pictures , 1968, Pattern Recognit..

[11]  Ugo Montanari,et al.  A Method for Obtaining Skeletons Using a Quasi-Euclidean Distance , 1968, J. ACM.

[12]  Ugo Montanari,et al.  Continuous Skeletons from Digitized Images , 1969, JACM.

[13]  C. J. Hilditch,et al.  Linear Skeletons From Square Cupboards , 1969 .

[14]  Giorgio Levi,et al.  A Grey-Weighted Skeleton , 1970, Inf. Control..

[15]  W. Ramsey Analysis of individual leucocyte behavior during chemotaxis.. , 1972, Experimental cell research.

[16]  H. Blum Biological shape and visual science (part I) , 1973 .

[17]  Theodosios Pavlidis,et al.  Segmentation of Plane Curves , 1974, IEEE Transactions on Computers.

[18]  L. Riggs,et al.  Curvature detectors in human vision? , 1974, Science.

[19]  Azriel Rosenfeld,et al.  An Improved Method of Angle Detection on Digital Curves , 1975, IEEE Transactions on Computers.

[20]  Jake K. Aggarwal,et al.  Computer Recognition of Partial Views of Curved Objects , 1977, IEEE Transactions on Computers.

[21]  David A. H. Jacobs,et al.  The State of the Art in Numerical Analysis. , 1978 .

[22]  P. Noble,et al.  A Markov chain characterization of human neutrophil locomotion under neutral and chemotactic conditions. , 1977, Canadian journal of physiology and pharmacology.

[23]  David J. Evans,et al.  Algorithm 512: A Normalized Algorithm for Solution of Positive Definite Symmetric Quindiagonal Systems of Linear Equations [F4] , 1977, TOMS.

[24]  Larry S. Davis,et al.  A Corner-Finding Algorithm for Chain-Coded Curves , 1977, IEEE Transactions on Computers.

[25]  HARRY BLUM,et al.  Shape description using weighted symmetric axis features , 1978, Pattern Recognit..

[26]  Herbert Freeman,et al.  Shape description via the use of critical points , 1978, Pattern Recognit..

[27]  E Bell,et al.  An interactive computer system for the analysis of cell lineages. , 1979, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[28]  F. Bookstein The line-skeleton , 1979 .

[29]  Pascal Fua,et al.  Finding Object Bound-aries Using Guided Gradient Ascent , 1980 .

[30]  T. Pavlidis A thinning algorithm for discrete binary images , 1980 .

[31]  Demetri Terzopoulos Matching Deformable Models to Images: Direct and Iterative Solutions , 1987, Topical Meeting on Machine Vision.

[32]  P. Danielsson Euclidean distance mapping , 1980 .

[33]  A. Boyarsky,et al.  The quantification of blood cell motion by a method of automatic digital picture processing , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Theodosios Pavlidis,et al.  Algorithms for Shape Analysis of Contours and Waveforms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  J. W. Humberston Classical mechanics , 1980, Nature.

[36]  E. R. Davies,et al.  Thinning algorithms: A critique and a new methodology , 1981, Pattern Recognit..

[37]  J. Sklansky,et al.  Skeleton generation fromx, y boundary sequences , 1981 .

[38]  P. J. Burt,et al.  Fast Filter Transforms for Image Processing , 1981 .

[39]  S. Zigmond,et al.  Cell polarity: an examination of its behavioral expression and its consequences for polymorphonuclear leukocyte chemotaxis , 1981, The Journal of cell biology.

[40]  Luigi P. Cordella,et al.  From Local Maxima to Connected Skeletons , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Carlo Arcelli,et al.  Pattern thinning by contour tracing , 1981 .

[42]  D. T. Lee,et al.  Medial Axis Transformation of a Planar Shape , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Peter J. Burt,et al.  Fast algorithms for estimating local image properties , 1982, Comput. Graph. Image Process..

[44]  Frank P. Ferrie,et al.  Cell Tracking: A Modeling and Minimization Approach , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Michael Brady,et al.  Computational Approaches to Image Understanding , 1982, CSUR.

[46]  Theodosios Pavlidis,et al.  An asynchronous thinning algorithm , 1982, Comput. Graph. Image Process..

[47]  Jun-ichiro Toriwaki,et al.  Paths and distance functions on three-dimensional digitized pictures , 1983, Pattern Recognit. Lett..

[48]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[49]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[50]  C. J. Hilditch Comparison of thinning algorithms on a parallel processor , 1983, Image Vis. Comput..

[51]  A. Favre,et al.  Parallel syntactic thinning by recoding of binary pictures , 1983, Comput. Vis. Graph. Image Process..

[52]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[53]  Demetri Terzopoulos,et al.  The Role of Constraints and Discontinuities in Visible-Surface Reconstruction , 1983, IJCAI.

[54]  Martin D. Levine,et al.  Understanding blood cell motion , 1982, Comput. Graph. Image Process..

[55]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[56]  H. Yamada Complete Euclidean Distance Transformation by Parallel Poeration , 1984 .

[57]  King-Sun Fu,et al.  Stochastic skeleton modeling of objects , 1984, Comput. Vis. Graph. Image Process..

[58]  P. J. Burt,et al.  The Pyramid as a Structure for Efficient Computation , 1984 .

[59]  Karin Wall,et al.  A fast sequential method for polygonal approximation of digitized curves , 1984, Comput. Vis. Graph. Image Process..

[60]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[61]  G. Borgefors Distance transformations in arbitrary dimensions , 1984 .

[62]  T. Poggio Vision by man and machine. , 1984, Scientific American.

[63]  Richard M. Stern,et al.  Fast Computation of the Difference of Low-Pass Transform , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  Margaret M. Fleck Local Rotational Symmetries , 1985 .

[65]  Luigi P. Cordella,et al.  An O(N) algorithm for polygonal approximation , 1985, Pattern Recognit. Lett..

[66]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[67]  Hilary Buxton,et al.  Convolution with separable masks for early image processing , 1985, Comput. Vis. Graph. Image Process..

[68]  Gabriella Sanniti di Baja,et al.  A Width-Independent Fast Thinning Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  J. Lackie Cell Movement and Cell Behaviour , 1986, Springer Netherlands.

[70]  Gérard G. Medioni,et al.  Corner detection and curve representation using cubic B-splines , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[71]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  William M. Wells,et al.  Efficient Synthesis of Gaussian Filters by Cascaded Uniform Filters , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[74]  Farzin Mokhtarian,et al.  Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[75]  M. Levine,et al.  Computer Assisted Analyses of Cell Locomotion and Chemotaxis , 1986 .

[76]  Andrew Blake,et al.  Weak Continuity Constraints Generate Uniform Scale-Space Descriptions of Plane Curves , 1986, ECAI.

[77]  Catherine Garbay,et al.  Image Structure Representation and Processing: A Discussion of Some Segmentation Methods in Cytology , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Stanley R Sternberg,et al.  Grayscale morphology , 1986 .

[79]  Gabriella Sanniti di Baja,et al.  Computing Voronoi diagrams in digital pictures , 1986, Pattern Recognit. Lett..

[80]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[81]  C. Arcelli,et al.  Finding Multiple Pixels , 1986 .

[82]  Charles R. Dyer,et al.  Shape Smoothing Using Medial Axis Properties , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[83]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[84]  Michael Leyton,et al.  Symmetry-curvature duality , 1987, Comput. Vis. Graph. Image Process..

[85]  Martin D. Levine,et al.  Multiple Resolution Skeletons , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[86]  Fernand Klein,et al.  Euclidean distance transformations and model-guided image interpretation , 1987, Pattern Recognit. Lett..

[87]  Roland T. Chin,et al.  A one-pass thinning algorithm and its parallel implementation , 1987, Comput. Vis. Graph. Image Process..

[88]  Jose L. Navalón,et al.  A thinning algorithm based on contours , 1987 .

[89]  Andrew Witkin,et al.  Stereo Matching As Constrained Optimization Using Scale Continuation Methods , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[90]  Wen Xu,et al.  CGT: A fast thinning algorithm implemented on a sequential computer , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[91]  Gabriella Sanniti di Baja,et al.  A contour characterization for multiply connected figures , 1987, Pattern Recognit. Lett..

[92]  S. Zucker,et al.  Endstopped neurons in the visual cortex as a substrate for calculating curvature , 1987, Nature.

[93]  Demetri Terzopoulos,et al.  On Matching Deformable Models to Images , 1987, Topical Meeting on Machine Vision.

[94]  Guy L. Scott,et al.  The Alternative Snake - and Other Animals , 1987, Alvey Vision Conference.

[95]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[96]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[97]  L. O'Gorman Curvilinear feature detection from curvature estimation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[98]  Q. Ye The signed Euclidean distance transform and its applications , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[99]  Terry E. Weymouth,et al.  Using Dynamic Programming For Minimizing The Energy Of Active Contours In The Presence Of Hard Constraints , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[100]  Gregory Y. Tang,et al.  Region filling with the use of the discrete green theorem , 1988, Comput. Vis. Graph. Image Process..

[101]  Gabriella Sanniti di Baja,et al.  Finding local maxima in a pseudo-Euclidian distance transform , 1988, Comput. Vis. Graph. Image Process..

[102]  Steven W. Zucker,et al.  The Organization Of Curve Detection: Coarse Tangent Fields And Fine Spline Coverings , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[103]  Farzin Mokhtarian,et al.  The renormalized curvature scale space and the evolution properties of planar curves , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[104]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[105]  Albert M. Vossepoel,et al.  A note on "distance transformations in digital images" , 1988, Comput. Vis. Graph. Image Process..

[106]  Ernest S. Baugher,et al.  Extraction of trend lines and extrema from multiscale curves , 1988, Pattern Recognit..

[107]  Roman Kuc,et al.  Introduction to Digital Signal Processing , 1988 .

[108]  Gabriella Sanniti di Baja,et al.  Skeletonizing the distance transform on the hexagonal grid , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[109]  R. E. Burge,et al.  A new algorithm for extracting the interior of bounded regions based on chain coding , 1988, Comput. Vis. Graph. Image Process..

[110]  Michael Leyton,et al.  A Process-Grammar for Shape , 1988, Artif. Intell..

[111]  Murray Hill,et al.  An Analysis of Feature Detectability from Curvature Estimation , 1988 .

[112]  A de Boisfleury-Chevance,et al.  Locomotion of white blood cells: a biophysical analysis. , 1989, Blood cells.

[113]  Frederic Fol Leymarie,et al.  Shape Features Using Curvature Morphology , 1989, Other Conferences.

[114]  Seshadri Mohan,et al.  Tree Searched Chain Coding for Subpixel Reconstruction of Planar Curves , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[115]  Roland T. Chin,et al.  On the Detection of Dominant Points on Digital Curves , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[116]  Cell locomotion as shape change. , 1989, Blood cells.

[117]  Gabriella Sanniti di Baja,et al.  A One-Pass Two-Operation Process to Detect the Skeletal Pixels on the 4-Distance Transform , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[118]  Frederic Fol Leymarie,et al.  Snakes and Skeletons , 1989 .

[119]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[120]  Oliver Wr Cell locomotion as shape change. , 1989 .

[121]  Min-Hong Han,et al.  Identification of cornerpoints of two-dimensional images using a line search method , 1989, Pattern Recognit..

[122]  Yun Xia,et al.  Skeletonization via the Realization of the Fire Front's Propagation and Extinction in Digital Binary Shapes , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[123]  James S. Duncan,et al.  Parametrically deformable contour models , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[124]  Frederic Fol Leymarie,et al.  New Method For Shape Description Based On An Active Contour Model , 1990, Other Conferences.

[125]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[126]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[127]  Alan L. Yuille,et al.  3D symmetry-curvature duality theorems , 1990, Comput. Vis. Graph. Image Process..

[128]  Frederic Fol Leymarie,et al.  Skeletons from Snakes , 1990 .

[129]  Frederic Fol Leymarie,et al.  Fast raster scan distance propagation on the discrete rectangular lattice , 1992, CVGIP Image Underst..

[130]  Frederic Fol Leymarie,et al.  Simulating the Grassfire Transform Using an Active Contour Model , 1992, IEEE Trans. Pattern Anal. Mach. Intell..