Evolutionary Robust Clustering Over Time for Temporal Data

In many clustering scenes, data samples’ attribute values change over time. For such data, we are often interested in obtaining a partition for each time step and tracking the dynamic change of partitions. Normally, a smooth change is assumed for data to have a temporal smooth nature. Existing algorithms consider the temporal smoothness as an a priori preference and bias the search towards the preferred direction. This a priori manner leads to a risk of converging to an unexpected region because it is not always the case that a reasonable preference can be elicited given the little prior knowledge about the data. To address this issue, this paper proposes a new clustering framework called evolutionary robust clustering over time. One significant innovation of the proposed framework is processing the temporal smoothness in an a posteriori manner, which avoids unexpected convergence that occurs in existing algorithms. Furthermore, the proposed framework automatically tunes the weight of smoothness without data’s affinity matrix and predefined parameters, which holds better applicability and scalability. The effectiveness and efficiency of the proposed framework are confirmed by comparing with state-of-the-art algorithms on both synthetic and real datasets.

[1]  Charles Elkan,et al.  Expectation Maximization Algorithm , 2010, Encyclopedia of Machine Learning.

[2]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Clustering , 2015, ACM Comput. Surv..

[3]  Rongheng Lin,et al.  OPEC: Daily Load Data Analysis Based on Optimized Evolutionary Clustering , 2019 .

[4]  Thomas Brox,et al.  A Unified Video Segmentation Benchmark: Annotation, Metrics and Analysis , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Haris Vikalo,et al.  Evolutionary Clustering via Message Passing , 2019, IEEE Transactions on Knowledge and Data Engineering.

[6]  Francesco Folino,et al.  An Evolutionary Multiobjective Approach for Community Discovery in Dynamic Networks , 2014, IEEE Transactions on Knowledge and Data Engineering.

[7]  Kalyanmoy Deb,et al.  Dynamic Multi-objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-thermal Power Scheduling , 2007, EMO.

[8]  Padhraic Smyth,et al.  Stacked Density Estimation , 1997, NIPS.

[9]  Chhavi Rana,et al.  An evolutionary clustering algorithm based on temporal features for dynamic recommender systems , 2014, Swarm Evol. Comput..

[10]  Li Ni,et al.  Clustering Evolutionary Data with an r-Dominance Based Multi-objective Evolutionary Algorithm , 2016, IDEAL.

[11]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[12]  Yew-Soon Ong,et al.  Curbing Negative Influences Online for Seamless Transfer Evolutionary Optimization , 2019, IEEE Transactions on Cybernetics.

[13]  Lei Feng,et al.  Human Motion Segmentation via Robust Kernel Sparse Subspace Clustering , 2018, IEEE Transactions on Image Processing.

[14]  Qingfu Zhang,et al.  Spatio-temporal data evolutionary clustering based on MOEA/D , 2011, GECCO '11.

[15]  Haris Vikalo,et al.  Evolutionary Self-Expressive Models for Subspace Clustering , 2018, IEEE Journal of Selected Topics in Signal Processing.

[16]  Johan A. K. Suykens,et al.  Efficient evolutionary spectral clustering , 2016, Pattern Recognit. Lett..

[17]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[18]  Xin Yao,et al.  Robust Optimization Over Time: Problem Difficulties and Benchmark Problems , 2015, IEEE Transactions on Evolutionary Computation.

[19]  Xin Yao,et al.  Does Preference Always Help? A Holistic Study on Preference-Based Evolutionary Multiobjective Optimization Using Reference Points , 2019, IEEE Transactions on Evolutionary Computation.

[20]  Tapabrata Ray,et al.  Adaptive Sorting-Based Evolutionary Algorithm for Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[21]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[22]  M. Middendorf,et al.  Evolutionary Dynamic Multiobjective Optimization via Learning From Historical Search Process , 2021, IEEE Transactions on Cybernetics.

[23]  Joshua D. Knowles,et al.  An Evolutionary Approach to Multiobjective Clustering , 2007, IEEE Transactions on Evolutionary Computation.

[24]  Dervis Karaboga,et al.  A comprehensive survey of traditional, merge-split and evolutionary approaches proposed for determination of cluster number , 2017, Swarm Evol. Comput..

[25]  Haris Vikalo,et al.  Evolutionary affinity propagation , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Gang Chen,et al.  Evolutionary clustering with differential evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[27]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[28]  Yao Zhao,et al.  Sparsity Learning Formulations for Mining Time-Varying Data , 2015, IEEE Transactions on Knowledge and Data Engineering.

[29]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[30]  Yun Chi,et al.  On evolutionary spectral clustering , 2009, TKDD.

[31]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[32]  Kalyanmoy Deb,et al.  A combined genetic adaptive search (GeneAS) for engineering design , 1996 .

[33]  G. J. Mitchell,et al.  Principles and procedures of statistics: A biometrical approach , 1981 .

[34]  Joshua D. Knowles,et al.  An Improved and More Scalable Evolutionary Approach to Multiobjective Clustering , 2018, IEEE Transactions on Evolutionary Computation.

[35]  Gang Chen,et al.  Clustering Time-Evolving Data Using an Efficient Differential Evolution , 2015, ICSI.

[36]  Bara'a Ali Attea,et al.  A new multi-objective evolutionary framework for community mining in dynamic social networks , 2016, Swarm Evol. Comput..

[37]  Mario Ignacio Chacon Murguia,et al.  Bio-inspired architecture for static object segmentation in time varying background models from video sequences , 2018, Neurocomputing.

[38]  Deepayan Chakrabarti,et al.  Evolutionary clustering , 2006, KDD '06.

[39]  G. Yen,et al.  A Consensus Community-Based Particle Swarm Optimization for Dynamic Community Detection , 2020, IEEE Transactions on Cybernetics.

[40]  Zhao Li,et al.  Hierarchical evolving Dirichlet processes for modeling nonlinear evolutionary traces in temporal data , 2016, Data Mining and Knowledge Discovery.

[41]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[42]  Alfred O. Hero,et al.  Adaptive evolutionary clustering , 2011, Data Mining and Knowledge Discovery.

[43]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .