Z-Skip-Links for Fast Traversal of ZDDs Representing Large-Scale Sparse Datasets

ZDD (Zero-suppressed Binary Decision Diagram) is known as an efficient data structure for representing and manipulating large-scale sets of combinations. In this article, we propose a method of using Z-Skip-Links to accelerate ZDD traversals for manipulating large-scale sparse datasets. We discuss average case complexity analysis of our method, and present the optimal parameter setting. Our method can be easily implemented into the existing ZDD packages just by adding one link per ZDD node. Experimental results show that we obtained dozens of acceleration ratio for the instances of the large-scale sparse datasets including thousands of items.

[1]  Donald E. Knuth,et al.  The Art of Computer Programming, Volume 4, Fascicle 2: Generating All Tuples and Permutations (Art of Computer Programming) , 2005 .

[2]  Ken Satoh,et al.  Compiling Bayesian Networks by Symbolic Probability Calculation Based on Zero-Suppressed BDDs , 2007, IJCAI.

[3]  Bart Goethals,et al.  Advances in frequent itemset mining implementations: report on FIMI'03 , 2004, SKDD.

[4]  Sheldon B. Akers,et al.  Binary Decision Diagrams , 1978, IEEE Transactions on Computers.

[5]  Olivier Coudert,et al.  Solving graph optimization problems with ZBDDs , 1997, Proceedings European Design and Test Conference. ED & TC 97.

[6]  Hiroki Arimura,et al.  Counterexamples to the long-standing conjecture on the complexity of BDD binary operations , 2012, Inf. Process. Lett..

[7]  William Pugh,et al.  Skip lists: a probabilistic alternative to balanced trees , 1989, CACM.

[8]  Shin-ichi Minato,et al.  Zero-Suppressed BDDs for Set Manipulation in Combinatorial Problems , 1993, 30th ACM/IEEE Design Automation Conference.

[9]  Hiroki Arimura,et al.  LCM over ZBDDs: Fast Generation of Very Large-Scale Frequent Itemsets Using a Compact Graph-Based Representation , 2008, PAKDD.

[10]  James Bailey,et al.  Fast mining of high dimensional expressive contrast patterns using zero-suppressed binary decision diagrams , 2006, KDD '06.

[11]  Taisuke Sato,et al.  Propositionalizing the EM algorithm by BDDs , 2010 .

[12]  Randal E. Bryant,et al.  Graph-Based Algorithms for Boolean Function Manipulation , 1986, IEEE Transactions on Computers.