Spectral Partitioning with Inde nite Kernels using the Nystr om Extension

Fowlkes et al recently introduced an approximation to the Normalized Cut NCut grouping algorithm based on random subsampling and the Nystr om extension As presented their method is restricted to the case where W the weighted adjacency matrix is positive de nite Although many common measures of image similarity i e kernels are positive de nite a popular example being Gaussian weighted distance there are important cases that are not In this work we present a modi cation to Nystr om NCut that does not require W to be positive de nite The modi cation only a ects the orthogonalization step and in doing so it necessitates one additional O m operation where m is the number of random samples used in the approximation As such it is of interest to know which kernels are positive de nite and which are inde nite In addressing this issue we further develop connections between NCut and related methods in the kernel machines literature We provide a proof that the Gaussian weighted chi squared kernel is positive de nite which has thus far only been conjectured We also explore the performance of the approximation algorithm on a variety of grouping cues including contour color and texture

[1]  Serge J. Belongie,et al.  Model-based halftoning for color image segmentation , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Vapnik,et al.  SVMs for Histogram Based Image Classification , 1999 .

[3]  Jitendra Malik,et al.  Efficient spatiotemporal grouping using the Nystrom method , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Joachim M. Buhmann,et al.  Non-parametric similarity measures for unsupervised texture segmentation and image retrieval , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[6]  Michael Werman,et al.  Stochastic image segmentation by typical cuts , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[8]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[9]  J. Williamson Harmonic Analysis on Semigroups , 1967 .

[10]  Jitendra Malik,et al.  Contour and Texture Analysis for Image Segmentation , 2001, International Journal of Computer Vision.

[11]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Jitendra Malik,et al.  Contour Continuity in Region Based Image Segmentation , 1998, ECCV.

[13]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[14]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Pietro Perona,et al.  A Factorization Approach to Grouping , 1998, ECCV.

[16]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[17]  R. Mathias An arithmetic-geometric-harmonic mean inequality involving Hadamard products , 1993 .