On the synthesis of stochastic flow networks

A stochastic flow network is a directed graph with incoming edges (inputs) and outgoing edges (outputs), tokens enter through the input edges, travel stochastically in the network and can exit the network through the output edges. Each node in the network is a splitter, namely, a token can enter a node through an incoming edge and exit on one of the output edges according to a predefined probability distribution. We address the following synthesis question: Given a finite set of possible splitters and an arbitrary rational probability distribution, design a stochastic flow network, such that every token that enters the input edge will exit the outputs with the prescribed probability distribution. The problem of probability synthesis dates back to von Neummann's 1951 work and was followed, among others, by Knuth and Yao in 1976, who demonstrated that arbitrary rational probabilities can be generated with tree networks; where minimizing the expected path length, the expected number of coin tosses in their paradigm, is the key consideration. Motivated by the synthesis of stochastic DNA based molecular systems, we focus on designing optimal-sized stochastic flow networks (the size of a network is the number of splitters). We assume that each splitter has two outgoing edges and is unbiased (probability  per output edge). We show that an arbitrary rational probability aoverb with a ≤ b ≤ 2n can be realized by a stochastic flow network of size n, we also show that this is optimal. We note that our stochastic flow networks have feedback (cycles in the network), in fact, we demonstrate that feedback improves the expressibility of stochastic flow networks, since without feedback only probabilities of the form aover2n (a an integer) can be realized.

[1]  Po-Ling Loh,et al.  The Synthesis and Analysis of Stochastic Switching Circuits , 2012, ArXiv.

[2]  Jehoshua Bruck,et al.  Transforming Probabilities With Combinational Logic , 2011, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[3]  Erik Winfree,et al.  DNA as a universal substrate for chemical kinetics , 2009, Proceedings of the National Academy of Sciences.

[4]  Kia Bazargan,et al.  The synthesis of combinational logic to generate probabilities , 2009, 2009 IEEE/ACM International Conference on Computer-Aided Design - Digest of Technical Papers.

[5]  Po-Ling Loh,et al.  The robustness of stochastic switching networks , 2009, 2009 IEEE International Symposium on Information Theory.

[6]  Jehoshua Bruck,et al.  On the expressibility of stochastic switching circuits , 2009, 2009 IEEE International Symposium on Information Theory.

[7]  Matthew Cook,et al.  Computation with finite stochastic chemical reaction networks , 2008, Natural Computing.

[8]  Jehoshua Bruck,et al.  Stochastic switching circuit synthesis , 2008, 2008 IEEE International Symposium on Information Theory.

[9]  Michael C. Loui,et al.  Optimal random number generation from a biased coin , 2005, SODA '05.

[10]  Mamoru Hoshi,et al.  Interval algorithm for random number generation , 1997, IEEE Trans. Inf. Theory.

[11]  Julia Abrahams,et al.  Generation of discrete distributions from biased coins , 1996, IEEE Trans. Inf. Theory.

[12]  Y. Peres Iterating Von Neumann's Procedure for Extracting Random Bits , 1992 .

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  Manuel Blum,et al.  Independent unbiased coin flips from a correlated biased source—A finite state markov chain , 1984, Comb..

[15]  Quentin F. Stout,et al.  TREE ALGORITHMS FOR UNBIASED COIN TOSSING WITH A BIASED COIN , 1984 .

[16]  Andrew Chi-Chih Yao,et al.  The complexity of nonuniform random number generation , 1976 .

[17]  P. Elias The Efficient Construction of an Unbiased Random Sequence , 1972 .

[18]  W. Hoeffding,et al.  Unbiased Coin Tossing With a Biased Coin , 1970 .

[19]  Wassily Hoeffding,et al.  UNBIASED COIN TOSSING WITH A BIASED COIN by , 1969 .

[20]  C. L. Sheng,et al.  Threshold Logic Elements Used as a Probability Transformer , 1965, JACM.

[21]  Arthur Gill,et al.  On a Weight Distribution Problem, with Application to the Design of Stochastic Generators , 1963, JACM.

[22]  Arthur Gill,et al.  Synthesis of probability transformers , 1962 .