Stochastic circuit design and performance evaluation of vector quantization

Vector quantization (VQ) is a general data compression technique that has a scalable implementation complexity and potentially a high compression ratio. In this paper, a novel implementation of VQ using stochastic circuits is proposed and its performance is evaluated. The stochastic and binary designs are compared for the same compression quality and the circuits are synthesized for an industrial 28-nm cell library. The effects of varying the sequence length of the stochastic design are studied with respect to the performance metric of throughput per area (TPA). When a shortened 512-bit encoding sequence is used to obtain a lower quality compression, the TPA is about 2.60 times that of the binary implementation with the same quality as that of the stochastic implementation measured by the L1 norm error (i.e., the first-order error). Thus, the stochastic implementation outperforms the conventional binary design in terms of TPA for a relatively low compression quality. By exploiting the progressive precision feature of a stochastic circuit, a readily scalable processing quality can be attained by simply halting the computation after different numbers of clock cycles.

[1]  Ming Jian Zuo,et al.  A Stochastic Approach for the Analysis of Fault Trees With Priority AND Gates , 2014, IEEE Transactions on Reliability.

[2]  Aaron E. Rosenberg,et al.  Report: A vector quantization approach to speaker recognition , 1987, AT&T Technical Journal.

[3]  Keshab K. Parhi,et al.  Architectures for digital filters using stochastic computing , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Hao Chen,et al.  Stochastic computational models for accurate reliability evaluation of logic circuits , 2010, GLSVLSI '10.

[5]  Vincent C. Gaudet,et al.  Iterative decoding using stochastic computation , 2003 .

[6]  Hao Chen,et al.  A Stochastic Computational Approach for Accurate and Efficient Reliability Evaluation , 2014, IEEE Transactions on Computers.

[7]  Les E. Atlas,et al.  Impulses and stochastic arithmetic for signal processing , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[8]  Howard C. Card,et al.  Stochastic Neural Computation II: Soft Competitive Learning , 2001, IEEE Trans. Computers.

[9]  W.J. Gross,et al.  Stochastic Implementation of LDPC Decoders , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[10]  Nasser M. Nasrabadi,et al.  Image coding using vector quantization: a review , 1988, IEEE Trans. Commun..

[11]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[12]  Xin Li,et al.  An Architecture for Fault-Tolerant Computation with Stochastic Logic , 2011, IEEE Transactions on Computers.

[13]  John P. Hayes,et al.  Survey of Stochastic Computing , 2013, TECS.

[14]  Vijay P. Singh,et al.  MULTIVARIATE PROBABILITY DISTRIBUTIONS , 2008 .

[15]  John P. Hayes,et al.  Stochastic circuits for real-time image-processing applications , 2013, 2013 50th ACM/EDAC/IEEE Design Automation Conference (DAC).

[16]  Weikang Qian,et al.  The synthesis of robust polynomial arithmetic with stochastic logic , 2008, 2008 45th ACM/IEEE Design Automation Conference.

[17]  Howard C. Card,et al.  Stochastic Neural Computation I: Computational Elements , 2001, IEEE Trans. Computers.

[18]  Bruce F. Cockburn,et al.  Design, evaluation and fault-tolerance analysis of stochastic FIR filters , 2016, Microelectron. Reliab..

[19]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[20]  Kia Bazargan,et al.  Computation on Stochastic Bit Streams Digital Image Processing Case Studies , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[21]  Marina Schmid Behavioral Synthesis Digital System Design Using The Synopsys Behavioral Compiler , 2016 .

[22]  Brian R. Gaines,et al.  Stochastic Computing Systems , 1969 .

[23]  Fabrizio Lombardi,et al.  A Stochastic Approach for the Analysis of Dynamic Fault Trees With Spare Gates Under Probabilistic Common Cause Failures , 2015, IEEE Transactions on Reliability.

[24]  David J. Lilja,et al.  Using stochastic computing to implement digital image processing algorithms , 2011, 2011 IEEE 29th International Conference on Computer Design (ICCD).

[25]  Kia Bazargan,et al.  Logical Computation on Stochastic Bit Streams with Linear Finite-State Machines , 2014, IEEE Transactions on Computers.