Understanding variance propagation in stochastic computing systems

Stochastic arithmetic provide several benefits over traditional computing method such as high fault tolerance, simple hardware implementation, low hardware area. In order to increase accuracy of error analysis and improve method of performance evaluation for stochastic computing systems, a new variance transfer function for stochastic computing systems based on combinational logic is proposed in this work. The transfer function is proved by a new mathematical method: hypergeometric decomposition, which makes stochastic computing theory more perfect and reliable. According to the variance transfer function, several measurements based on variance are developed to evaluate performance between different stochastic computing algorithms. By comparing this method with traditional bit-level simulation method, variance measurements are proved to be less time consumption, more comprehensive, and more effective to evaluate and understand stochastic computing systems.

[1]  Leopoldo García Franquelo,et al.  Analog to digital and digital to analog conversion based on stochastic logic , 1995, Proceedings of IECON '95 - 21st Annual Conference on IEEE Industrial Electronics.

[2]  Brian R. Gaines,et al.  Stochastic Computing Systems , 1969 .

[3]  G. Verghese,et al.  Mass fluctuation kinetics: capturing stochastic effects in systems of chemical reactions through coupled mean-variance computations. , 2007, The Journal of chemical physics.

[4]  David J. Lilja,et al.  A low power fault-tolerance architecture for the kernel density estimation based image segmentation algorithm , 2011, ASAP 2011 - 22nd IEEE International Conference on Application-specific Systems, Architectures and Processors.

[5]  Krishna V. Palem,et al.  Energy aware computing through probabilistic switching: a study of limits , 2005, IEEE Transactions on Computers.

[6]  John Shawe-Taylor,et al.  Generating binary sequences for stochastic computing , 1994, IEEE Trans. Inf. Theory.

[7]  Xin Li,et al.  An Architecture for Fault-Tolerant Computation with Stochastic Logic , 2011, IEEE Transactions on Computers.

[8]  Yasuji Sawada,et al.  Functional abilities of a stochastic logic neural network , 1992, IEEE Trans. Neural Networks.

[9]  M. Ueda,et al.  FPGA implementation of a blind source separation system based on stochastic computing , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[10]  David J. Lilja,et al.  Using stochastic computing to implement digital image processing algorithms , 2011, 2011 IEEE 29th International Conference on Computer Design (ICCD).

[11]  Howard C. Card,et al.  Stochastic Neural Computation I: Computational Elements , 2001, IEEE Trans. Computers.

[12]  Hao Chen,et al.  Stochastic computational models for accurate reliability evaluation of logic circuits , 2010, GLSVLSI '10.