Evolutionary Distance Metric Learning Approach to Semi-supervised Clustering with Neighbor Relations

This study proposes a distance metric learning method based on a clustering index with neighbor relation that simultaneously evaluates inter-and intra-clusters. Our proposed method optimizes a distance transform matrix based on the Mahalanobis distance by utilizing a self-adaptive differential evolution (jDE) algorithm. Our approach directly improves various clustering indices and in principle requires less auxiliary information compared to conventional metric learning methods. We experimentally validated the search efficiency of jDE and the generalization performance.

[1]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[2]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[3]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[4]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[5]  Masayuki Numao,et al.  Neighborhood-Based Smoothing of External Cluster Validity Measures , 2012, PAKDD.

[6]  Frédéric Alexandre,et al.  Self-organizing Map Initialization , 2005, ICANN.

[7]  Jouni Lampinen,et al.  Optimized distance metrics for differential evolution based nearest prototype classifier , 2012, Expert Syst. Appl..

[8]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[9]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[10]  Samuel Kaski,et al.  Principle of Learning Metrics for Exploratory Data Analysis , 2004, J. VLSI Signal Process..

[11]  Tomer Hertz,et al.  Boosting margin based distance functions for clustering , 2004, ICML.

[12]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[13]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[14]  Dacheng Tao,et al.  Learning a Distance Metric by Empirical Loss Minimization , 2011, IJCAI.

[15]  Geoffrey E. Hinton,et al.  Neighbourhood Components Analysis , 2004, NIPS.

[16]  M. Yamamura,et al.  Multi-parent recombination with simplex crossover in real coded genetic algorithms , 1999 .

[17]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[18]  Yi Liu,et al.  An Efficient Algorithm for Local Distance Metric Learning , 2006, AAAI.

[19]  Xin Yao,et al.  Benchmark Generator for CEC'2009 Competition on Dynamic Optimization , 2008 .

[20]  Tomer Hertz,et al.  Learning Distance Functions using Equivalence Relations , 2003, ICML.