RCE classifiers: theory and practice

Restricted Coulomb Energy (RCE) classifiers, as described by Scofield et al. (1988), are shown to have a conceptual relationship with hyperspherical classifiers developed in the 1960s by Batchelor (1974). These classifiers are also shown to share similarities with networks of localized receptive fields and with psychological models of concept formation. Next, the performance of some RCE classifiers is examined. The ability of a trained RCE classifier to generalize to new instances is compared with that of several well-known classifiers. Then, four previously unexamined aspects of RCE classifiers are investigated empirically: (1) the influence of potential wells on training rate, (2) the influence of potential wells on storage requirement, (3) the influence of potential wells on generalization to new instances, and (4) rejection of an instance from an unknown class. Modifications of a traditional RCE classifier improve average correct classification at generalization from 83.2 to 90.7% without significant ...

[1]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[2]  Edward B. Roessler,et al.  Introduction to Probability and Statistics , 1961, The Mathematical Gazette.

[3]  Paul W. Cooper,et al.  The Hypersphere in Pattern Recognition , 1962, Inf. Control..

[4]  Paul W. Cooper,et al.  A Note on an Adaptive Hypersphere Decision Boundary , 1966, IEEE Trans. Electron. Comput..

[5]  M. Posner,et al.  Retention of Abstract Ideas. , 1970 .

[6]  Stephen K. Reed,et al.  Pattern recognition and categorization , 1972 .

[7]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[8]  Bruce G. Batchelor,et al.  Practical approach to pattern classification , 1974 .

[9]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[10]  B. G. Batchelor,et al.  Classification and Data Analysis in Vector Spaces , 1978 .

[11]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[12]  S. Dowdy,et al.  Statistics for Research , 1983 .

[13]  Edward E. Smith,et al.  Concepts and concept formation. , 1984, Annual review of psychology.

[14]  T. W. Potter.  Storing and retrieving data in a parallel distributed memory system , 1987 .

[15]  Raymond D. Rimey,et al.  Real-Time 3-D Object Classification Using a Learning System , 1987, Other Conferences.

[16]  Leon N. Cooper,et al.  Pattern Class Degeneracy in an Unrestricted Storage Density Memory , 1987, NIPS.

[17]  L N Cooper,et al.  A relaxation model for memory with high storage density. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Dembo,et al.  General potential surfaces and neural networks. , 1988, Physical review. A, General physics.

[19]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[20]  Pentti Kanerva,et al.  Sparse Distributed Memory , 1988 .

[21]  Steven J. Nowlan,et al.  Maximum Likelihood Competitive Learning , 1989, NIPS.

[22]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[23]  Yuchun Lee,et al.  Classifiers : adaptive modules in pattern recognition systems , 1989 .

[24]  Richard Lippmann,et al.  Practical Characteristics of Neural Network and Conventional Pattern Classifiers on Artificial and Speech Problems , 1989, NIPS.