An enriched game-theoretic framework for multi-objective clustering

The framework of multi-objective clustering can serve as a competent technique in nowadays human issues ranging from decision making process to machine learning and pattern recognition problems. Multi-objective clustering basically aims at placing similar objects into the same groups based on some conflicting objectives, which substantially supports the use of game theory to come to a resolution. Based on these understandings, this paper suggests Enriched Game Theory K-means, called EGTKMeans, as a novel multi-objective clustering technique based on the notion of game theory. EGTKMeans is specially designed to optimize two intrinsically conflicting objectives, named, compaction and equi-partitioning. The key contributions of the proposed approach are three folds. First, it formulates an elegant and novel payoff definition which considers both objectives with equal priority. The presented payoff function incorporates a desirable fairness into the final clustering results. Second, EGTKMeans performs better off by utilizing the advantages of mixed strategies as well as those of pure ones, considering the existence of mixed Nash Equilibrium in every game. The last but not the least is that EGTKMeans approaches the optimal solution in a very promising manner by optimizing both objectives simultaneously. The experimental results suggest that the proposed approach significantly outperforms other rival methods across real world and synthetic data sets with reasonable time complexity.

[1]  Anil K. Jain,et al.  Multiobjective data clustering , 2004, CVPR 2004.

[2]  N. Ranganathan,et al.  A microeconomic approach to multi-robot team formation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Samuel,et al.  A Game-Theoretic Framework for Similarity-Based Data Clustering , 2009 .

[4]  Majid Bagheri,et al.  Forest Fire Modeling and Early Detection using Wireless Sensor Networks , 2009, Ad Hoc Sens. Wirel. Networks.

[5]  Pavel Berkhin,et al.  A Survey of Clustering Data Mining Techniques , 2006, Grouping Multidimensional Data.

[6]  Joshua D. Knowles,et al.  On semi-supervised clustering via multiobjective optimization , 2006, GECCO.

[7]  Caro Lucas,et al.  Spatial Data Mining for Optimized Selection of Facility Locations in Field-based Services , 2007, 2007 IEEE Symposium on Computational Intelligence and Data Mining.

[8]  Joshua D. Knowles,et al.  An Evolutionary Approach to Multiobjective Clustering , 2007, IEEE Transactions on Evolutionary Computation.

[9]  Andrea Torsello,et al.  Grouping with Asymmetric Affinities: A Game-Theoretic Perspective , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Andrea Torsello,et al.  Beyond partitions: Allowing overlapping groups in pairwise clustering , 2008, 2008 19th International Conference on Pattern Recognition.

[11]  Adrian Vetta,et al.  Nash equilibria in competitive societies, with applications to facility location, traffic routing and auctions , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[12]  N. Ranganathan,et al.  A Game Theoretic Approach for Simultaneous Compaction and Equipartitioning of Spatial Data Sets , 2010, IEEE Transactions on Knowledge and Data Engineering.

[13]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[14]  Yi-tzuu T. Chien Interactive pattern recognition , 1978 .

[15]  Tomoharu Nagao,et al.  Evolutionary image segmentation based on multiobjective clustering , 2009, 2009 IEEE Congress on Evolutionary Computation.

[16]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[17]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[18]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[19]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Multi-Objective Clustering Ensemble with Prior Knowledge , 2007, BSB.

[20]  Joshua D. Knowles,et al.  Multiobjective clustering around medoids , 2005, 2005 IEEE Congress on Evolutionary Computation.

[21]  Marcello Pelillo,et al.  A Game-Theoretic Approach to Hypergraph Clustering , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Robert F. Ling,et al.  Cluster analysis algorithms for data reduction and classification of objects , 1981 .

[23]  H. Edelsbrunner,et al.  Efficient algorithms for agglomerative hierarchical clustering methods , 1984 .

[24]  Marcello Pelillo,et al.  Dominant Sets and Pairwise Clustering , 2007 .

[25]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[26]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[27]  Joshua D. Knowles,et al.  Improvements to the scalability of multiobjective clustering , 2005, 2005 IEEE Congress on Evolutionary Computation.

[28]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[29]  A. Rubinstein,et al.  A Course in Game Theory , 1995 .

[30]  Jean-Paul Chilès,et al.  Wiley Series in Probability and Statistics , 2012 .

[31]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[32]  Licheng Jiao,et al.  Unsupervised texture image segmentation using multiobjective evolutionary clustering ensemble algorithm , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[33]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[34]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  A Strategy  for the Selection of Solutions of the Pareto Front Approximation in Multi-objective Clustering Approaches , 2008, 2008 10th Brazilian Symposium on Neural Networks.

[35]  Anthony T. Chronopoulos,et al.  Algorithmic mechanism design for load balancing in distributed systems , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[36]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[37]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Andrew McLennan,et al.  Gambit: Software Tools for Game Theory , 2006 .

[39]  Jiannong Cao,et al.  An Energy-Aware Routing Protocol in Wireless Sensor Networks , 2009, Sensors.

[40]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[41]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[42]  Anil K. Jain,et al.  Clustering ensembles: models of consensus and weak partitions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Daniel Grosu,et al.  Parallel Computation of Nash Equilibria in N-Player Games , 2009, 2009 International Conference on Computational Science and Engineering.

[44]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.