Iterated tensor voting and curvature improvement

Tensor voting (TV) methods have been developed in a series of papers by Medioni and coworkers during the last years. The method has been proved efficient for feature extraction and grouping and has been applied successfully in a diversity of applications such as contour and surface inferences, motion analysis, etc. We present here two studies on improvements of the method. The first one consists in iterating the TV process, and the second one integrates curvature information. In contrast to other grouping methods, TV claims the advantage to be non-iterative. Although non-iterative TV methods provide good results in many cases, the algorithm can be iterated to deal with more complex or more ambiguous data configurations. We present experiments that demonstrate that iterations substantially improve the process of feature extraction and help to overcome limitations of the original algorithm. As a further contribution, we propose a curvature improvement for TV. Unlike the curvature-augmented TV proposed by Tang and Medioni, our method evaluates the full curvature, sign and amplitude in the 2D case. Another advantage of the method is that it uses part of the curvature calculation already performed by the classical TV, limiting the computational costs. Curvature-modified voting fields are also proposed. Results show smoother curves, a lower degree of artifacts and a high tolerance against scale variations of the input. The methods are finally tested under noisy conditions showing that the proposed improvements preserve the noise robustness of the TV method.

[1]  Lance R. Williams,et al.  A Comparison of Measures for Detecting Natural Shapes in Cluttered Backgrounds , 1998, International Journal of Computer Vision.

[2]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[3]  David G. Stork,et al.  Pattern Classification , 1973 .

[4]  Gérard G. Medioni,et al.  First order augmentation to tensor voting for boundary inference and multiscale analysis in 3D , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Chi-Keung Tang,et al.  A Computational Framework for Feature Extraction and Segmentation , 2000 .

[6]  Gérard G. Medioni,et al.  Inference of Surfaces, 3D Curves, and Junctions From Sparse, Noisy, 3D Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Stephen Grossberg,et al.  A neural network for enhancing boundaries and surfaces in synthetic aperture radar images , 1999, Neural Networks.

[8]  C. Gilbert,et al.  Spatial distribution of contextual interactions in primary visual cortex and in visual perception. , 2000, Journal of neurophysiology.

[9]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Heiko Neumann,et al.  Computational Neural Models of Spatial Integration in Perceptual Grouping , 2001 .

[11]  Azriel Rosenfeld,et al.  An Application of Relaxation Labeling to Line and Curve Enhancement , 1977, IEEE Transactions on Computers.

[12]  Heiko Neumann,et al.  Recurrent Long-Range Interactions in Early Vision , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[13]  Marcello Pelillo,et al.  The Dynamics of Nonlinear Relaxation Labeling Processes , 1997, Journal of Mathematical Imaging and Vision.

[14]  Andreas K. Kreiter,et al.  Rapid contour integration in macaque monkeys , 2005, Vision Research.

[15]  Mi-Suen Lee,et al.  N-Dimensional Tensor Voting and Application to Epipolar Geometry Estimation , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  L. Finkel,et al.  Extraction of perceptually salient contours by striate cortical networks , 1998, Vision Research.

[17]  Mircea Nicolescu,et al.  Perceptual Grouping Based on Iterative Multi-scale Tensor Voting , 2006, ISVC.

[18]  P. Kellman,et al.  From fragments to objects : segmentation and grouping in vision , 2001 .

[19]  T. S. Lee,et al.  Gestalten of Today: Early Processing of Visual Contours and Surfaces , 1996 .

[20]  Mi-Suen Lee,et al.  A Computational Framework for Segmentation and Grouping , 2000 .

[21]  Heiko Neumann,et al.  Are Iterations and Curvature Useful for Tensor Voting? , 2004, ECCV.

[22]  Steven W. Zucker,et al.  Two Stages of Curve Detection Suggest Two Styles of Visual Computation , 1989, Neural Computation.

[23]  Chi-Keung Tang,et al.  Robust estimation of adaptive tensors of curvature by tensor voting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Gérard G. Medioni,et al.  Curvature-Augmented Tensor Voting for Shape Inference from Noisy 3D Data , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Steven W. Zucker,et al.  Continuous Relaxation and Local Maxima Selection: Conditions for Equivalence , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Gérard G. Medioni,et al.  Layered 4D Representation and Voting for Grouping from Motion , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Heiko Neumann,et al.  Neural Mechanisms for the Robust Representation of Junctions , 2004, Neural Computation.

[28]  R. F Hess,et al.  Contour integration and cortical processing , 2003, Journal of Physiology-Paris.

[29]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[30]  Ronen Basri,et al.  Completion energies and scale , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Arnaud Delorme,et al.  Feed-forward contour integration in primary visual cortex based on asynchronous spike propagation , 2001, Neurocomputing.

[32]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[33]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[34]  J. Rothwell Principles of Neural Science , 1982 .

[35]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[36]  Gabriel Cristóbal,et al.  Sparse Approximation of Images Inspired from the Functional Architecture of the Primary Visual Areas , 2007, EURASIP J. Adv. Signal Process..

[37]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  S. Zucker,et al.  Endstopped neurons in the visual cortex as a substrate for calculating curvature , 1987, Nature.