A new, cellular automaton-based, nearest neighbor pattern classifier and its VLSI implementation

A new, parallel, nearest-neighbor (NN) pattern classifier, based on a 2D Cellular Automaton (CA) architecture, is presented in this paper. The proposed classifier is both time and space efficient, when compared with already existing NN classifiers, since it does not require complex distance calculations and ordering of distances, and storage requirements are kept minimal since each cell stores information only about its nearest neighborhood. The proposed classifier produces piece-wise linear discriminant curves between clusters of points of complex shape (nonlinearly separable) using the computational geometry concept known as the Voronoi diagram, which is established through CA evolution. These curves are established during an "off-line" operation and, thus, the subsequent classification of unknown patterns is achieved very fast. The VLSI design and implementation of a nearest neighborhood processor of the proposed 2D CA architecture is also presented in this paper. >

[1]  Kai Hwang,et al.  Advanced parallel processing with supercomputer architectures , 1987, Proc. IEEE.

[2]  Ray A. Jarvis,et al.  Clustering Using a Similarity Measure Based on Shared Near Neighbors , 1973, IEEE Transactions on Computers.

[3]  Edward A. Patrick,et al.  A Generalized k-Nearest Neighbor Rule , 1970, Inf. Control..

[4]  Josef A. Nossek,et al.  An analog implementation of discrete-time cellular neural networks , 1992, IEEE Trans. Neural Networks.

[5]  S. Wolfram.  Statistical mechanics of cellular automata , 1983 .

[6]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[7]  Thomas M. Cover,et al.  Estimation by the nearest neighbor rule , 1968, IEEE Trans. Inf. Theory.

[8]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[9]  Jun Gu,et al.  A Novel Discrete Relaxation Architecture , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Chris Jesshope.  Wafer Scale Integration , 1986 .

[11]  Howard C. Card,et al.  Group Properties of Cellular Automata and VLSI Applications , 1986, IEEE Transactions on Computers.

[12]  S. Wolfram,et al.  Two-dimensional cellular automata , 1985 .

[13]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Small Sample Performance , 1952 .

[14]  Philip S. Liu,et al.  VLSI Arrays for Pattern Recognition and Image Processing: I/O Bandwidth Considerations , 1984 .

[15]  C.-T. Tseng,et al.  The design of a nonparametric hierarchical classifier , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[16]  G. Krishna,et al.  Agglomerative clustering using the concept of mutual nearest neighbourhood , 1978, Pattern Recognit..

[17]  B.V. Dasarathy,et al.  A composite classifier system design: Concepts and methodology , 1979, Proceedings of the IEEE.

[18]  Hugh B. Woodruff,et al.  An algorithm for a selective nearest neighbor decision rule (Corresp.) , 1975, IEEE Trans. Inf. Theory.

[19]  Heinrich Niemann,et al.  An efficient branch-and-bound nearest neighbour classifier , 1988, Pattern Recognition Letters.

[20]  Thomas P. Yunck,et al.  A Technique to Identify Nearest Neighbors , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  Kazuo Murota,et al.  A Fast Voronoi-Diagram Algorithm With Quaternary Tree Bucketing , 1984, Inf. Process. Lett..

[22]  Alan J. Broder.  Strategies for efficient incremental nearest neighbor search , 1990, Pattern Recognit..

[23]  Lionel M. Ni,et al.  Design of a Pattern Cluster Using Two-Level Pipelined Systolic Array , 1984 .

[24]  Andrew Luk,et al.  A Re-Examination of the Distance-Weighted k-Nearest Neighbor Classification Rule , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  KC Gowda,et al.  Disaggregative Clustering Using the Concept of Mutual Nearest Neighborhood , 1978 .

[26]  Laurent Miclet,et al.  Approximative fast nearest-neighbour recognition , 1983, Pattern Recognit. Lett..

[27]  Igor Aleksander,et al.  Automata theory : an engineering approach , 1975 .

[28]  Panagiotis Tzionas,et al.  Design and VLSI implementation of a pattern classifier using pseudo 2D cellular automata , 1992 .