Data mining is an iterative and interactive process that explores and analyzes voluminous digital data to discover valid, novel, and meaningful patterns (Mohammed, 1999). Since digital data may have terabytes of records, data mining techniques aim to find patterns using computationally efficient techniques. It is related to a subarea of statistics called exploratory data analysis. During the past decade, data mining techniques have been used in various business, government, and scientific applications. Association rule mining (Agrawal, Imielinsky & Sawmi, 1993) is one of the most studied fields in the data-mining domain. The key strength of association mining is completeness. It has the ability to discover all associations within a given dataset. Two important constraints of association rule mining are support and confidence (Agrawal & Srikant, 1994). These constraints are used to measure the interestingness of a rule. The motivation of association rule mining comes from market-basket analysis that aims to discover customer purchase behavior. However, its applications are not limited only to market-basket analysis; rather, they are used in other applications, such as network intrusion detection, credit card fraud detection, and so forth. The widespread use of computers and the advances in network technologies have enabled modern organizations to distribute their computing resources among different sites. Various business applications used by such organizations normally store their day-to-day data in each respective site. Data of such organizations increases in size everyday. Discovering useful patterns from such organizations using a centralized data mining approach is not always feasible, because merging datasets from different sites into a centralized site incurs large network communication costs (Ashrafi, David & Kate, 2004). Furthermore, data from these organizations are not only distributed over various locations, but are also fragmented vertically. Therefore, it becomes more difficult, if not impossible, to combine them in a central location. Therefore, Distributed Association Rule Mining (DARM) emerges as an active subarea of data-mining research. Consider the following example. A supermarket may have several data centers spread over various regions across the country. Each of these centers may have gigabytes of data. In order to find customer purchase behavior from these datasets, one can employ an association rule mining algorithm in one of the regional data centers. However, employing a mining algorithm to a particular data center will not allow us to obtain all the potential patterns, because customer purchase patterns of one region will vary from the others. So, in order to achieve all potential patterns, we rely on some kind of distributed association rule mining algorithm, which can incorporate all data centers. Distributed systems, by nature, require communication. Since distributed association rule mining algorithms generate rules from different datasets spread over various geographical sites, they consequently require external communications in every step of the process (Ashrafi, David & Kate, 2004; Assaf & Ron, 2002; Cheung, Ng, Fu & Fu, 1996). As a result, DARM algorithms aim to reduce communication costs in such a way that the total cost of generating global association rules must be less than the cost of combining datasets of all participating sites into a centralized site.
[1]
John Wang Montclair.
Data Warehousing and Mining : Concepts , Methodologies , Tools , and Applications
,
2008
.
[2]
Kate Smith-Miles,et al.
Reducing Communication Cost in a Privacy Preserving Distributed Association Rule Mining
,
2004,
DASFAA.
[3]
J. Hsu.
Data Mining and Business Intelligence: Tools, Technologies, and Applications
,
2004
.
[4]
Alexandre V. Evfimievski,et al.
Privacy preserving mining of association rules
,
2002,
Inf. Syst..
[5]
John Francis Kros,et al.
Imprecise Data and the Data Mining Process
,
2009,
Encyclopedia of Data Warehousing and Mining.
[6]
David Taniar,et al.
ODAM: An optimized distributed association rule mining algorithm
,
2004,
IEEE Distributed Systems Online.
[7]
Vikas Agrawal,et al.
Statistical Sampling to Instantiate Materialized View Selection Problems in Data Warehouses
,
2007,
Int. J. Data Warehous. Min..
[8]
Rakesh Agrawal,et al.
Parallel Mining of Association Rules
,
1996,
IEEE Trans. Knowl. Data Eng..
[9]
Jaideep Vaidya,et al.
Privacy preserving association rule mining in vertically partitioned data
,
2002,
KDD.
[10]
Jiawei Han,et al.
A fast distributed algorithm for mining association rules
,
1996,
Fourth International Conference on Parallel and Distributed Information Systems.
[11]
Yi Pan,et al.
Introduction: Recent Developments in Parallel and Distributed Data Mining
,
2004,
Distributed and Parallel Databases.
[12]
Wen-Chi Hou,et al.
Mining for Profitable Patterns in the Stock Market
,
2005
.
[13]
Tomasz Imielinski,et al.
Mining association rules between sets of items in large databases
,
1993,
SIGMOD Conference.
[14]
Jayant R. Haritsa,et al.
Maintaining Data Privacy in Association Rule Mining
,
2002,
VLDB.
[15]
Mohammed J. Zaki.
Parallel and distributed association mining: a survey
,
1999,
IEEE Concurr..
[16]
Kate Smith-Miles,et al.
Towards Privacy Preserving Distributed Association Rule Mining
,
2003,
IWDC.
[17]
Philip Calvert,et al.
Encyclopedia of Data Warehousing and Mining
,
2006
.
[18]
Mohammed J. Zaki.
Scalable Algorithms for Association Mining
,
2000,
IEEE Trans. Knowl. Data Eng..
[19]
David Wai-Lok Cheung,et al.
Efficient Mining of Association Rules in Distributed Databases
,
1996,
IEEE Trans. Knowl. Data Eng..