Semi-supervised LDA Based Method for Similarity Distance Metric Learning

In recent years, computer vision technology has drawn much attention of people and been applied into many fields of human's living. Data classification/identification is a key task in computer vision. The similarity distance metric learning based method is wildly used to compare the similar positive pairs from dissimilar negative pairs. However, there are more and more challenging computer vision task have been proposed. Traditional similarity distance metric learning methods are fail to metric the similarity of these task due to the drastic variation of feature caused by illumination, view angle, pose and background changes. Thus, the existing methods are unable to learn effective and complete patterns to describe the appearance change of individuals. To overcome this problem, we proposed a novel semi-supervised (Linear Discriminant Analysis) LDA based method for similarity distance metric learning. The proposed method first learn a metric projection with traditional LDA method. The then test data are identified with the potential positive pairs to fine-turning the metric model by forcing the identified data to be close to the center of positive training data pairs. Finally, the proposed method are compared to some classic metric learning algorithms to demonstrate its effectiveness and accuracy.

[1]  Tomer Hertz,et al.  Computing Gaussian Mixture Models with EM Using Equivalence Constraints , 2003, NIPS.

[2]  Dan Klein,et al.  From Instance-level Constraints to Space-Level Constraints: Making the Most of Prior Knowledge in Data Clustering , 2002, ICML.

[3]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[4]  Tomer Hertz,et al.  Learning a Mahalanobis Metric from Equivalence Constraints , 2005, J. Mach. Learn. Res..

[5]  Hong Chang,et al.  Extending the relevant component analysis algorithm for metric learning using both positive and negative equivalence constraints , 2006, Pattern Recognit..

[6]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[7]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Avrim Blum,et al.  Correlation Clustering , 2004, Machine Learning.

[9]  David J. Miller,et al.  Mixture Modeling with Pairwise, Instance-Level Class Constraints , 2005, Neural Computation.

[10]  Xuelong Li,et al.  Supervised deep hashing with a joint deep network , 2020, Pattern Recognit..

[11]  Anil K. Jain,et al.  Model-based Clustering With Probabilistic Constraints , 2005, SDM.

[12]  Alexander M. Bronstein,et al.  Topologically Constrained Isometric Embedding , 2006, Human Motion.

[13]  Dit-Yan Yeung,et al.  Locally linear metric adaptation with application to semi-supervised clustering and image retrieval , 2006, Pattern Recognit..

[14]  Hong Chang,et al.  A Kernel Approach for Semisupervised Metric Learning , 2007, IEEE Transactions on Neural Networks.

[15]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[16]  Anthony Wirth,et al.  Correlation Clustering , 2010, Encyclopedia of Machine Learning and Data Mining.

[17]  Hong Chang,et al.  Relaxational metric adaptation and its application to semi-supervised clustering and content-based image retrieval , 2006, Pattern Recognit..

[18]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[19]  Zhengdong Lu,et al.  Semi-supervised Learning with Penalized Probabilistic Clustering , 2004, NIPS.

[20]  W. Eric L. Grimson,et al.  Multi-modal Image Registration by Minimising Kullback-Leibler Distance , 2002, MICCAI.

[21]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[22]  Xiaoqiang Lu,et al.  Deep Cross-Modal Image–Voice Retrieval in Remote Sensing , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[23]  D. Yeung,et al.  A Kernel Approach for Semi-Supervised Metric Learning , 2006 .

[24]  P. Groenen,et al.  Modern multidimensional scaling , 1996 .

[25]  Feiping Nie,et al.  Learning a Mahalanobis distance metric for data clustering and classification , 2008, Pattern Recognit..