The multisynapse neural network and its application to fuzzy clustering

In this paper, a new neural architecture, the multisynapse neural network, is developed for constrained optimization problems, whose objective functions may include high-order, logarithmic, and sinusoidal forms, etc., unlike the traditional Hopfield networks which can only handle quadratic form optimization. Meanwhile, based on the application of this new architecture, a fuzzy bidirectional associative clustering network (FBACN), which is composed of two layers of recurrent networks, is proposed for fuzzy-partition clustering according to the objective-functional method. It is well known that fuzzy c-means is a milestone algorithm in the area of fuzzy c-partition clustering. All of the following objective-functional-based fuzzy c-partition algorithms incorporate the formulas of fuzzy c-means as the prime mover in their algorithms. However, when an application of fuzzy c-partition has sophisticated constraints, the necessity of analytical solutions in a single iteration step becomes a fatal issue of the existing algorithms. The largest advantage of FBACN is that it does not need analytical solutions. For the problems on which some prior information is known, we bring a combination of part crisp and part fuzzy clustering in the third optimization problem.

[1]  Shokri Z. Selim,et al.  A simulated annealing algorithm for the clustering problem , 1991, Pattern Recognit..

[2]  I. Turksen.  A fuzzy neural hybrid system modeling , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[3]  Weibo Gong,et al.  ART2 neural network clustering for hierarchical simulation , 1998, Defense, Security, and Sensing.

[4]  M. Narasimha Murty,et al.  Clustering with evolution strategies , 1994, Pattern Recognit..

[5]  David M. Skapura,et al.  Neural networks - algorithms, applications, and programming techniques , 1991, Computation and neural systems series.

[6]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[7]  S. Miyamoto,et al.  Crisp and fuzzy methods of optimal clustering on networks of objects , 1998, 1998 Second International Conference. Knowledge-Based Intelligent Electronic Systems. Proceedings KES'98 (Cat. No.98EX111).

[8]  Kyung-Whan Oh,et al.  A performance measure for the fuzzy cluster validity , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[9]  F. Klawonn,et al.  Fuzzy clustering with evolutionary algorithms , 1998 .

[10]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[11]  Qiwen Zhang,et al.  A new clustering algorithm with multiple runs of iterative procedures , 1991, Pattern Recognit..

[12]  Sadaaki Miyamoto,et al.  An overview and new methods in fuzzy clustering , 1998, 1998 Second International Conference. Knowledge-Based Intelligent Electronic Systems. Proceedings KES'98 (Cat. No.98EX111).

[13]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[14]  Jacek M. Zurada,et al.  Introduction to artificial neural systems , 1992 .

[15]  Donald E. Brown,et al.  A practical application of simulated annealing to clustering , 1990, Pattern Recognit..

[16]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[17]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[18]  L. K. Li,et al.  Fixed point analysis for discrete-time recurrent neural networks , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[19]  Chin-Shyurng Fahn,et al.  A distributed approach to fuzzy clustering by genetic algorithms , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[20]  J. Steck.  Convergence of recurrent networks as contraction mappings , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[21]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[22]  Shokri Z. Selim,et al.  A global algorithm for the fuzzy clustering problem , 1993, Pattern Recognit..

[23]  Rajesh N. Davé,et al.  Characterization and detection of noise in clustering , 1991, Pattern Recognit. Lett..

[24]  Jzau-Sheng Lin,et al.  A fuzzy Hopfield neural network for medical image segmentation , 1996 .

[25]  James C. Bezdek,et al.  Fuzzy Kohonen clustering networks , 1994, Pattern Recognit..

[26]  H. Thiele,et al.  A characterization of arbitrary Ruspini partitions by fuzzy similarity relations , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[27]  James E. Steck,et al.  Use of Hopfield neural networks in optimal guidance , 1994 .

[28]  Rajesh N. Davé,et al.  Generalized fuzzy c-shells clustering and detection of circular and elliptical boundaries , 1992, Pattern Recognit..

[29]  Rui-Ping Li,et al.  A maximum-entropy approach to fuzzy clustering , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[30]  Hichem Frigui,et al.  The fuzzy c spherical shells algorithm: A new approach , 1992, IEEE Trans. Neural Networks.

[31]  Morton Nadler,et al.  Pattern recognition engineering , 1993 .

[32]  Hidetomo Ichihashi,et al.  Simultaneous application of clustering and correspondence analysis , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[33]  R. Bellman,et al.  Abstraction and pattern classification , 1996 .

[34]  Robert Everist Greene,et al.  Introduction to Topology , 1983 .

[35]  Hong Liu,et al.  Evolutionary semi-supervised fuzzy clustering , 2003, Pattern Recognit. Lett..

[36]  T. Van Le,et al.  Evolutionary fuzzy clustering , 1995 .

[37]  Jung-Hua Wang,et al.  Optimal clustering using neural networks , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[38]  Amrane Houacine,et al.  Robust optimal fuzzy clustering algorithm applicable to multispectral and polarimetric synthetic aperture radar images , 1999, Remote Sensing.

[39]  C. A. Murthy,et al.  A new split-and-merge clustering technique , 1992, Pattern Recognit. Lett..

[40]  John W. Davenport,et al.  Generalized fuzzy c-means clustering in the presence of outlying data , 1999, Defense, Security, and Sensing.

[41]  Terrance L. Huntsberger,et al.  PARALLEL SELF-ORGANIZING FEATURE MAPS FOR UNSUPERVISED PATTERN RECOGNITION , 1990 .

[42]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[43]  Masao Mukaidono,et al.  Gaussian clustering method based on maximum-fuzzy-entropy interpretation , 1999, Fuzzy Sets Syst..