On the Local Optimality of the Fuzzy Isodata Clustering Algorithm

The convergence of the fuzzy ISODATA clustering algorithm was proved by Bezdek [3]. Two sets of conditions were derived and it was conjectured that they are necessary and sufficient for a local minimum point. In this paper, we address this conjecture and explore the properties of the underlying optimization problem. The notions of reduced objective function and improving and feasible directions are used to examine this conjecture. Finally, based on the derived properties of the problem, a new stopping criterion for the fuzzy ISODATA algorithm is proposed.

[1]  Tohru Katayama,et al.  Restoration of images degraded by motion blur and noise , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[2]  D.E. Dudgeon,et al.  Two-dimensional digital filtering , 1975, Proceedings of the IEEE.

[3]  J. Woods,et al.  Kalman filtering in two dimensions: Further results , 1981 .

[4]  Shokri Z. Selim,et al.  K-Means-Type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  M. Ekstrom,et al.  Realizable Wiener filtering in two dimensions , 1982 .

[6]  R. Saeks,et al.  System theory : a Hilbert space approach , 1982 .

[7]  William A. Porter,et al.  Optimization problems in partially ordered Hilbert resolution spaces , 1982 .

[8]  Jorge L. Aravena,et al.  Ordered and partially ordered processing of multidimensional images , 1985, IEEE Trans. Acoust. Speech Signal Process..

[9]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[10]  E. M. L. Beale,et al.  Nonlinear Programming: A Unified Approach. , 1970 .

[11]  James C. Bezdek,et al.  Fuzzy mathematics in pattern classification , 1973 .

[12]  James C. Bezdek,et al.  A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  JOHN w. WOODS,et al.  Kalman filtering in two dimensions , 1977, IEEE Trans. Inf. Theory.

[14]  Richard Saeks,et al.  Resolution space; operators and systems , 1973 .

[15]  William A. Porter,et al.  Modern foundations of systems engineering , 1966 .

[16]  Arch W. Naylor,et al.  Linear Operator Theory in Engineering and Science , 1971 .