A New Clustering Algorithm for Transaction Data via Caucus

The fast-growing large point of sale databases in stores and companies sets a pressing need for extracting high-level knowledge. Transaction clustering arises to receive attentions in recent years. However, traditional clustering techniques are not useful to solve this problem. Transaction data sets are different from the traditional data sets in their high dimensionality, sparsity and a large number of outliers. In this paper we present and experimentally evaluate a new efficient transaction clustering technique based on cluster of buyers called caucus that can be effectively used for identification of center of cluster. Experiments on real and synthetic data sets indicate that compare to prior work, caucus-based method can derive clusters of better quality as well as reduce the execution time considerably.

[1]  Ming-Syan Chen,et al.  An efficient clustering algorithm for market basket data based on small large ratios , 2001, 25th Annual International Computer Software and Applications Conference. COMPSAC 2001.

[2]  Philip S. Yu,et al.  Online Generation of Profile Association Rules , 1998, KDD.

[3]  Manoranjan Dash,et al.  Dimensionality reduction of unsupervised data , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[4]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[6]  Mark A. Gluck,et al.  Information, Uncertainty and the Utility of Categories , 1985 .

[7]  J. D. Fast,et al.  Entropy: The significance of the concept of entropy and its applications in science and technology , 1962 .

[8]  Ke Wang,et al.  Clustering transactions using large items , 1999, CIKM '99.

[9]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[10]  Huan Liu,et al.  Neural-network feature selector , 1997, IEEE Trans. Neural Networks.

[11]  Vipin Kumar,et al.  Hypergraph Based Clustering in High-Dimensional Data Sets: A Summary of Results , 1998, IEEE Data Eng. Bull..

[12]  Philip S. Yu,et al.  Finding generalized projected clusters in high dimensional spaces , 2000, SIGMOD '00.

[13]  Philip S. Yu,et al.  Online algorithms for finding profile association rules , 1998, CIKM '98.

[14]  Philip S. Yu,et al.  Finding generalized projected clusters in high dimensional spaces , 2000, SIGMOD 2000.

[15]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .