Association rule mining using hybrid GA-PSO for multi-objective optimisation

Association Rule Mining (ARM), a Data Mining process, extracts hidden strong relationships among a large set of the correlated data. With the burgeoning advancement and application of Association Rule Mining in diverse fields ranging from the web usage mining to medical diagnosis and business intelligence to geographical information systems, the decision-making in ARM involves a multi-objective perspective to obtain an interesting and accurate rule set. By considering the Pareto optimality, an optimal trade-off is established between the conflicting and incommensurate performance parameters — comprehensibility, interestingness and confidence of the mined rules. Both, Genetic Algorithm (GA) and Particle Swarm Optimisation (PSO), being population-based stochastic search method, have found their strong base in mining association rules. We propose an association rule mining scheme using our proposed multi-objective hybridisation of GA-PSO algorithm. The primary advantage of the proposed algorithm is that the hybridisation of multiple objective-GA with multi objective-PSO balances the exploration and exploitation tasks, resulting in valuable extraction of accurate and interpretable mined rules. Evaluating this hybrid model on Bakery dataset shows that with generation of comprehensible, interesting and reliable association rules, the model also converges four times faster than mono-objective hybridisation.

[1]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[2]  Michael N. Vrahatis,et al.  Multi-Objective Particles Swarm Optimization Approaches , 2008 .

[3]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[4]  Das Amrita,et al.  Mining Association Rules between Sets of Items in Large Databases , 2013 .

[5]  Francesco Grimaccia,et al.  Development and validation of different hybridization strategies between GA and PSO , 2007, 2007 IEEE Congress on Evolutionary Computation.

[6]  Din J. Wasem,et al.  Mining of Massive Datasets , 2014 .

[7]  Lakhmi C. Jain,et al.  Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[8]  Xindong Wu,et al.  Efficient mining of both positive and negative association rules , 2004, TOIS.

[9]  Kalina Yacef,et al.  Interestingness Measures for Associations Rules in Educational Data , 2008, EDM.

[10]  M Reyes Sierra,et al.  Multi-Objective Particle Swarm Optimizers: A Survey of the State-of-the-Art , 2006 .

[11]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[12]  Behrouz Minaei-Bidgoli,et al.  Mining numerical association rules via multi-objective genetic algorithms , 2013, Inf. Sci..

[13]  Alex A. Freitas,et al.  A survey of evolutionary algorithms for data mining and knowledge discovery , 2003 .

[14]  Aravind Seshadri,et al.  A FAST ELITIST MULTIOBJECTIVE GENETIC ALGORITHM: NSGA-II , 2000 .

[15]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[16]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[17]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[18]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[19]  Carlos A. Coello Coello,et al.  Multi-Objective Particle Swarm Optimizers: An Experimental Comparison , 2009, EMO.

[20]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[21]  Pramod K. Singh,et al.  Association rule mining using multi-objective evolutionary algorithms: Strengths and challenges , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[22]  Joshua D. Knowles,et al.  M-PAES: a memetic algorithm for multiobjective optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[23]  Sanghamitra Bandyopadhyay,et al.  Multi-Objective Particle Swarm Optimization with time variant inertia and acceleration coefficients , 2007, Inf. Sci..

[24]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[25]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[26]  Francisco Herrera,et al.  A New Multiobjective Evolutionary Algorithm for Mining a Reduced Set of Interesting Positive and Negative Quantitative Association Rules , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Jian Pei,et al.  Mining frequent patterns without candidate generation , 2000, SIGMOD '00.

[28]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[29]  M. N. Vrahatis,et al.  Particle swarm optimization method in multiobjective problems , 2002, SAC '02.

[30]  S. Kanmani,et al.  Mining association rules using hybrid genetic algorithm and particle swarm optimisation algorithm , 2015, Int. J. Data Anal. Tech. Strateg..

[31]  Bhabesh Nath,et al.  Multi-objective rule mining using genetic algorithms , 2004, Inf. Sci..

[32]  Xianpeng Wang,et al.  A Hybrid Multiobjective Evolutionary Algorithm for Multiobjective Optimization Problems , 2013, IEEE Transactions on Evolutionary Computation.

[33]  Vadlamani Ravi,et al.  Association rule mining using binary particle swarm optimization , 2013, Eng. Appl. Artif. Intell..

[34]  C. Coello,et al.  Multi-Objective Particle Swarm Optimizers : A Survey of the State-ofthe-Art , 2006 .