Optimizing exchange confidence during collaborative clustering

Collaborative clustering is a recent learning paradigm concerned with the unsupervised analysis of complex multi-view data using several algorithms working together. Well known applications of collaborative clustering include multi-view clustering and distributed data clustering, where several algorithms exchange information in order to mutually improve each others based on the diversity of their models or their view of the data. However, many of the proposed algorithms and statistical models in these fields lack the capability to properly detect noisy views and sub-optimal collaborators. As a result, these weak collaborators and noisy views often go undetected during the collaborative process, and end up deteriorating the results of all other algorithms.In this article, we propose a weighting optimization method for the collaborative version of the SOM algorithm that will help detect whether local self-organizing maps should or should not exchange their information based on the diversity between their topologies. This method can further be used to detect noisy views and discard them in unsupervised collaborative and multi-view processes.

[1]  Younès Bennani,et al.  Learning confidence exchange in Collaborative Clustering , 2011, The 2011 International Joint Conference on Neural Networks.

[2]  Ulrike von Luxburg,et al.  Clustering Stability: An Overview , 2010, Found. Trends Mach. Learn..

[3]  Younès Bennani,et al.  Collaborative Clustering: How to Select the Optimal Collaborators? , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[4]  Younès Bennani,et al.  Collaborative Clustering using Prototype-Based Techniques , 2012, Int. J. Comput. Intell. Appl..

[5]  Marc Tommasi,et al.  Decentralized Collaborative Learning of Personalized Models over Networks , 2016, AISTATS.

[6]  Younès Bennani,et al.  Diversity analysis in collaborative clustering , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[7]  Jérémie Sublime,et al.  Collaborative Clustering through Constrained Networks using Bandit Optimization , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[8]  Jacques-Henri Sublemontier,et al.  Unsupervised collaborative boosting of clustering: An unifying framework for multi-view clustering, multiple consensus clusterings and alternative clustering , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[9]  Younès Bennani,et al.  Topological Collaborative Clustering , 2010, Aust. J. Intell. Inf. Process. Syst..

[10]  Pierre Gançarski,et al.  Collaborative clustering: Why, when, what and how , 2018, Inf. Fusion.

[11]  Younès Bennani,et al.  Entropy based probabilistic collaborative clustering , 2017, Pattern Recognit..

[12]  Christopher M. Bishop,et al.  GTM: The Generative Topographic Mapping , 1998, Neural Computation.

[13]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[14]  Najet Arous,et al.  SOM variants for topological horizontal collaboration , 2016, 2016 2nd International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[15]  Younès Bennani,et al.  From horizontal to vertical collaborative clustering using generative topographic maps , 2016, Int. J. Hybrid Intell. Syst..

[16]  T. Kohonen.  Analysis of a simple self-organizing process , 1982, Biological Cybernetics.

[17]  Arthur Zimek,et al.  The blind men and the elephant: on meeting the problem of multiple truths in data from clustering and pattern mining perspectives , 2013, Machine Learning.

[18]  Yves Lechevallier,et al.  A multi-view relational fuzzy c-medoid vectors clustering algorithm , 2015, Neurocomputing.

[19]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[20]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[21]  Basarab Matei,et al.  Analysis of the influence of diversity in collaborative and multi-view clustering , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[22]  Sandro Vega-Pons,et al.  A Survey of Clustering Ensemble Algorithms , 2011, Int. J. Pattern Recognit. Artif. Intell..

[23]  Geert Wets,et al.  PSO driven collaborative clustering: A clustering algorithm for ubiquitous environments , 2011, Intell. Data Anal..

[24]  Shai Ben-David,et al.  A Sober Look at Clustering Stability , 2006, COLT.

[25]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .