RCE networks: an experimental investigation

The author briefly surveys the history of hyperspherical classifiers and restricted Coulomb energy (RCE) networks. The ability of a trained RCE classifier to correctly classify new instances is compared with that of several well-known classifiers. Two unexplored aspects of RCE network classifiers are experimentally examined: (1) the treatment of potential wells on the number of training epochs, storage requirements, and generalization; and (2) rejection of an instance from an unknown class. Modifications to a traditional RCE classifier improve average generalization from 83.2% to 90.7% with comparable computational cost. For comparison, a nearest-neighbor classifier performs at 93% and a feedforward network at 88.4% on the same data. When the improved RCE classifier is compared with its underlying adaptive nearest-neighbor classifier the results show that the incorporation of potential wells into the RCE classifier does not reduce training time, nor pattern storage, nor does it improve generalization to new instances.<<ETX>>

[1]  Richard Lippmann,et al.  Practical Characteristics of Neural Network and Conventional Pattern Classifiers on Artificial and Speech Problems , 1989, NIPS.

[2]  William Mendenhall,et al.  Introduction to Probability and Statistics , 1961, The Mathematical Gazette.

[3]  Steven J. Nowlan,et al.  Maximum Likelihood Competitive Learning , 1989, NIPS.

[4]  Scott E. Fahlman,et al.  An empirical study of learning speed in back-propagation networks , 1988 .

[5]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Paul W. Cooper,et al.  A Note on an Adaptive Hypersphere Decision Boundary , 1966, IEEE Trans. Electron. Comput..

[7]  Pentti Kanerva,et al.  Sparse Distributed Memory , 1988 .

[8]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[9]  Raymond D. Rimey,et al.  Real-Time 3-D Object Classification Using a Learning System , 1987, Other Conferences.

[10]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[11]  Leon N. Cooper,et al.  Pattern Class Degeneracy in an Unrestricted Storage Density Memory , 1987, NIPS.

[12]  T. W. Potter Storing and retrieving data in a parallel distributed memory system , 1987 .

[13]  Paul W. Cooper,et al.  The Hypersphere in Pattern Recognition , 1962, Inf. Control..

[14]  Yuchun Lee,et al.  Classifiers : adaptive modules in pattern recognition systems , 1989 .

[15]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[16]  M. J. Hudak RCE classifiers: theory and practice , 1992 .