Winner-Takes-All Associative Memory: A Hamming Distance Vector Quantizer

We present a design methodology for mapping neuralyinspired algorithms for vector quantization, into VLSI hardware.We describe the building blocks used: memory cells, current conveyors,and translinear circuits. We use the basic building blocks todesign an associative processor for bit-pattern classification;a high-density memory based neuromorphic processor. Operatingin parallel, the single chip system determines the closest match,based on the Hamming distance, between an input bit pattern andmultiple stored bit templates; ties are broken arbitrarily. Energyefficient processing is achieved through a precision-on-demandarchitecture. Scalable storage and processing is achieved througha compact six transistor static RAM cell/ALU circuit. The singlechip system is programmable for template sets of up to 124 bitsper template and can store up to 116 templates (total storagecapacity of 14 Kbits). An additional 604 bits of auxiliary storageis used for pipelining and fault tolerance re-configuration capability.A fully functional 6.8 mm by 6.9 mmchip has been fabricated in a standard single–poly, double–metal2.0µmn–well CMOS process.

[1]  Carver A. Mead,et al.  VLSI architectures for implementation of neural networks , 1987 .

[2]  Andreas G. Andreou,et al.  Device mismatch limitations on the performance of an associative memory system , 1993, Proceedings of 36th Midwest Symposium on Circuits and Systems.

[3]  B. Gilbert Translinear circuits: a proposed classification , 1975 .

[4]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[5]  Toshiaki Yamanaka,et al.  A 16-Mb CMOS SRAM with a 2.3- mu m/sup 2/ single-bit-line memory cell , 1993 .

[6]  Kwabena Boahen,et al.  A heteroassociative memory using current-mode MOS analog VLSI circuits , 1989 .

[7]  Aleksandra Pavasović,et al.  Characterization of subthreshold MOS mismatch in transistors for VLSI systems , 1994 .

[8]  Teuvo Kohonen,et al.  Content-addressable memories , 1980 .

[9]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[10]  John Lazzaro,et al.  Winner-Take-All Networks of O(N) Complexity , 1988, NIPS.

[11]  Paul Losleben,et al.  Advanced Research in VLSI , 1987 .

[12]  Mohamad H. Hassoun,et al.  Associative neural memories , 1993 .

[13]  Edgar Sánchez-Sinencio,et al.  A high-density and low-power charge-based Hamming network , 1993, IEEE Trans. Very Large Scale Integr. Syst..

[14]  Andreas G. Andreou,et al.  Storage enhancement techniques for digital memory based, analog computational engines , 1994, Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94.

[15]  Kwabena Boahen,et al.  Design of a bidirectional associative memory chip , 1993 .

[16]  Andreas G. Andreou,et al.  An associative memory integrated system for character recognition , 1993, Proceedings of 36th Midwest Symposium on Circuits and Systems.

[17]  John S. Denker,et al.  Neural Networks for Computing , 1998 .

[18]  Sidney Soclof Analog integrated circuits , 1985 .

[19]  Kwabena Boahen,et al.  Translinear circuits in subthreshold MOS , 1996 .

[20]  Terri S. Fiez,et al.  Analog VLSI : signal and information processing , 1994 .

[21]  J. Fellrath,et al.  CMOS analog integrated circuits based on weak inversion operations , 1977 .

[22]  Bing J. Sheu,et al.  A nonvolatile analog neural memory using floating-gate MOS transistors , 1992 .

[23]  Gert Cauwenberghs,et al.  Analysis and verification of an analog VLSI incremental outer-product learning system , 1992, IEEE Trans. Neural Networks.

[24]  T. Kohonen Contentaddressable Memories , 1987 .

[25]  Masayoshi Sasaki,et al.  A 9-ns 16-Mb CMOS SRAM with offset-compensated current sense amplifier , 1993 .

[26]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[27]  Kwabena Boahen,et al.  Architectures for associative memories using current-mode analog MOS circuits , 1989 .

[28]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .