Functional Dependency Mining: Harnessing Multicore Systems

We are at the beginning of the multicore era. When combined with Hyper-Threading Technology, multicore can provide powerful optimization opportunities, increasing system throughput substantially. Inspired by this modern technology, we propose a multi-threaded algorithm, called MT FASTFDS, for mining functional dependencies which harnesses multicore system. Through a detailed experimental study, we show that our parallel algorithm scales very well with the number of cores available.

[1]  Hannu Toivonen,et al.  TANE: An Efficient Algorithm for Discovering Functional and Approximate Dependencies , 1999, Comput. J..

[2]  János Demetrovics,et al.  Functional Dependencies in Relational Databases: A Lattice Point of View , 1992, Discret. Appl. Math..

[3]  Yuan Zhao,et al.  Automated elicitation of functional dependencies from source codes of database transactions , 2004, Inf. Softw. Technol..

[4]  Alexandre Termier,et al.  PGP-mc: Towards a Multicore Parallel Approach for Mining Gradual Patterns , 2010, DASFAA.

[5]  Jean-Marc Petit,et al.  Efficient Discovery of Functional Dependencies and Armstrong Relations , 2000, EDBT.

[6]  David Maier,et al.  The Theory of Relational Databases , 1983 .

[7]  Sergio Greco,et al.  Repairing Inconsistent XML Data with Functional Dependencies , 2005, Encyclopedia of Database Technologies and Applications.

[8]  Eric Li,et al.  Optimization of Frequent Itemset Mining on Multiple-Core Processor , 2007, VLDB.

[9]  Heikki Mannila,et al.  Design by Example: An Application of Armstrong Relations , 1986, J. Comput. Syst. Sci..

[10]  Alexandre Termier,et al.  Discovering closed frequent itemsets on multicore: Parallelizing computations and optimizing memory accesses , 2010, 2010 International Conference on High Performance Computing & Simulation.

[11]  Cory J. Butz,et al.  FD/spl I.bar/Mine: discovering functional dependencies in a database using equivalences , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[12]  Edward L. Robertson,et al.  FastFDs: A Heuristic-Driven, Depth-First Algorithm for Mining Functional Dependencies from Relation Instances - Extended Abstract , 2001, DaWaK.

[13]  Salvatore Orlando,et al.  Parallel Mining of Frequent Closed Patterns: Harnessing Modern Computer Architectures , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[14]  Jean-Marc Petit,et al.  Functional and approximate dependency mining: database and FCA points of view , 2002, J. Exp. Theor. Artif. Intell..

[15]  Rosine Cicchetti,et al.  FUN: An Efficient Algorithm for Mining Functional and Embedded Dependencies , 2001, ICDT.