A proof of the convergence theorem of maximum-entropy clustering algorithm

In this paper, we point out that the counterexample constructed by Yu et al. is incorrect by using scientific computing software Sage. This means that the example cannot negate the convergence theorem of maximum entropy clustering algorithm. Furthermore, we construct an example to negate Theorem 1 in Yu’s paper, and we propose Proposition 3 to prove that the limit of the iterative sequence is a local minimum of the objective function while v varies and u remains stable. Finally, we give a theoretical proof of the convergence theorem of maximum entropy clustering algorithm.

[1]  Geoffrey C. Fox,et al.  A deterministic annealing approach to clustering , 1990, Pattern Recognit. Lett..

[2]  Rui-Ping Li,et al.  A maximum-entropy approach to fuzzy clustering , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[3]  N. Karayiannis MECA: maximum entropy clustering algorithm , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[4]  Jian Yu,et al.  Counterexamples to convergence theorem of maximum-entropy clustering algorithm , 2007, Science in China Series F: Information Sciences.

[5]  Sadaaki Miyamoto,et al.  Fuzzy c-means as a regularization and maximum entropy approach , 1997 .

[6]  Nicolaos B. Karayiannis Fuzzy Partition Entropies and Entropy Constrained Fuzzy Clustering Algorithms , 1997, J. Intell. Fuzzy Syst..

[7]  Nanning Zheng,et al.  Maximum-entropy clustering algorithm and its global convergence analysis , 2001 .