Some applications of clustering in the design of neural networks

In this paper, we discuss the role of clustering techniques in the design of neural networks. Specifically, we address the issue in relation to two network paradigms: one based on back-propagation and the other based on radial basis functions. In the former case, we demonstrate, emprically, that by employing clustering techniques, the training effort may be drastically brought down. In the latter case, we demonstrate that clustering techniques can be employed to build more robust classifiers. We also discuss the role of clustering in the design of hierarchical systems. Specifically, we discuss a hierarchical system based on radial basis functions.

[1]  Eric Dietrich,et al.  Experimental and theoretical artificial intelligence , 1989, J. Exp. Theor. Artif. Intell..

[2]  Aaron E. Rosenberg,et al.  Speaker-independent recognition of isolated words using clustering techniques , 1979 .

[3]  Richard C. T. Lee,et al.  Towards Automatic Auditing of Records , 1978, IEEE Transactions on Software Engineering.

[4]  M. Narasimha Murty,et al.  Clustering algorithms for library comparison , 1991, Pattern Recognit..

[5]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[6]  M. Narasimha Murty,et al.  A knowledge-based clustering algorithm , 1991, Pattern Recognit. Lett..

[7]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[8]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[9]  Thomas Jackson,et al.  Neural Computing - An Introduction , 1990 .

[10]  Sun-Yuan Kung,et al.  Digital neural networks , 1993, Prentice Hall Information and System Sciences Series.

[11]  M. Narasimha Murty,et al.  A deductive clustering approach , 1994, J. Exp. Theor. Artif. Intell..

[12]  Ryszard S. Michalski,et al.  Automated Construction of Classifications: Conceptual Clustering Versus Numerical Taxonomy , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[14]  D.R. Hush,et al.  Progress in supervised neural networks , 1993, IEEE Signal Processing Magazine.

[15]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[16]  S. Renals,et al.  Phoneme classification experiments using radial basis functions , 1989, International 1989 Joint Conference on Neural Networks.