A General Transfer Learning-based Gaussian Mixture Model for Clustering

Gaussian mixture model (GMM) is a well-known model-based approach for data clustering. However, when the data samples are insufficient, the classical GMM-based clustering algorithms are not effective anymore. Referring to the idea of transfer clustering methods, this paper proposes a general transfer GMM-based clustering framework, which employs the important knowledge extracted from some known source domain to guide and improve the clustering on the target domain with small-scale data. Specifically, three traditional GMM-based clustering approaches are extended to the corresponding transfer clustering versions. Furthermore, to avoid the negative transfer problem, maximum mean discrepancy (MMD) is introduced to search the most matched source domain to provide more positive guidance for data clustering on the target domain. Experiments on synthetic and real-world datasets demonstrate the efficiency of the presented framework compared with several existing transfer clustering algorithms.

[1]  Hujun Bao,et al.  Laplacian Regularized Gaussian Mixture Model for Data Clustering , 2011, IEEE Transactions on Knowledge and Data Engineering.

[2]  Jeffrey L. Andrews,et al.  Addressing overfitting and underfitting in Gaussian model-based clustering , 2018, Comput. Stat. Data Anal..

[3]  Sufyan Ali Memon,et al.  Kernel Possibilistic Fuzzy c-Means Clustering with Local Information for Image Segmentation , 2018, Int. J. Fuzzy Syst..

[4]  Yu Li,et al.  A Fuzzy Clustering Approach for Complex Color Image Segmentation Based on Gaussian Model with Interactions between Color Planes and Mixture Gaussian Model , 2018, Int. J. Fuzzy Syst..

[5]  Joan Claudi Socoró,et al.  Parallel hierarchical architectures for efficient consensus clustering on big multimedia cluster ensembles , 2020, Inf. Sci..

[6]  Kesari Verma,et al.  Fuzzy Shared Nearest Neighbor Clustering , 2019, International Journal of Fuzzy Systems.

[7]  Honghai Liu,et al.  Fuzzy Gaussian Mixture Models , 2012, Pattern Recognit..

[8]  Thierry Denoeux,et al.  Clustering and classification of fuzzy data using the fuzzy EM algorithm , 2016, Fuzzy Sets Syst..

[9]  Jinwen Ma,et al.  Entropy Penalized Automated Model Selection On Gaussian Mixture , 2004, Int. J. Pattern Recognit. Artif. Intell..

[10]  Mohammad Reza Daliri,et al.  A Template-Based Sequential Algorithm for Online Clustering of Spikes in Extracellular Recordings , 2020, Cognitive Computation.

[11]  Zhaohong Deng,et al.  Transfer Prototype-Based Fuzzy Clustering , 2014, IEEE Transactions on Fuzzy Systems.

[12]  Shafqat Iqbal,et al.  A New Hesitant Fuzzy-Based Forecasting Method Integrated with Clustering and Modified Smoothing Approach , 2020, International Journal of Fuzzy Systems.

[13]  Yang Zhao,et al.  Regularized Gaussian Mixture Model for High-Dimensional Clustering , 2019, IEEE Transactions on Cybernetics.

[14]  Hsiao-Dong Chiang,et al.  TRUST-TECH-Based Expectation Maximization for Learning Finite Mixture Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Pengjiang Qian,et al.  Cluster Prototypes and Fuzzy Memberships Jointly Leveraged Cross-Domain Maximum Entropy Clustering , 2016, IEEE Transactions on Cybernetics.

[16]  Jiwen Dong,et al.  Random Feature Map-Based Multiple Kernel Fuzzy Clustering with All Feature Weights , 2019, International Journal of Fuzzy Systems.

[17]  Sotirios Chatzis A method for training finite mixture models under a fuzzy clustering principle , 2010, Fuzzy Sets Syst..

[18]  C. L. Philip Chen,et al.  Uncertain Data Clustering in Distributed Peer-to-Peer Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Yuehui Chen,et al.  Multivariate morphological reconstruction based fuzzy clustering with a weighting multi-channel guided image filter for color image segmentation , 2020, Int. J. Mach. Learn. Cybern..

[20]  Wei Liu,et al.  Knowledge transfer for spectral clustering , 2018, Pattern Recognit..

[21]  Miin-Shen Yang,et al.  Entropy-type classification maximum likelihood algorithms for mixture models , 2011, Soft Comput..

[22]  Korris Fu-Lai Chung,et al.  Transfer affinity propagation-based clustering , 2016, Inf. Sci..

[23]  Miin-Shen Yang,et al.  Unsupervised fuzzy model-based Gaussian clustering , 2019, Inf. Sci..