Joint distance and similarity measure learning based on triplet-based constraints

A novel model is proposed to learn combined distance and similarity measure (CDSM) based on triplet-based constraints.Our CDSM can be kernelized for learning nonlinear measures.Two effective strategies are suggested to speed up the training and testing of kernelized CDSM.Extensive experiments validate the superiority of CDSM and kernelized CDSM. Distance and similarity measures usually are complementary to pattern classification. With pairwise constraints, several approaches have been proposed to combine distance and similarity measures. However, it remains less investigated to use triplets of samples for joint learning of distance and similarity measures. Moreover, the kernel extension of triplet-based model is also nontrivial and computationally expensive. In this paper, we propose a novel method to learn a combined distance and similarity measure (CDSM). By incorporating with the max-margin model, we suggest a triplet-based CDSM learning model with a unified regularizer of the Frobenius norm. A support vector machine (SVM)-based algorithm is then adopted to solve the optimization problem. Furthermore, we extend CDSM for learning nonlinear measures via the kernel trick. Two effective strategies are adopted to speed up training and testing of kernelized CDSM. Experiments on the UCI, handwritten digits and person re-identification datasets demonstrate that CDSM and kernelized CDSM outperform several state-of-the-art metric learning methods.

[1]  Mohammad Shojafar,et al.  FR trust: a fuzzy reputation-based model for trust management in semantic P2P grids , 2014, Int. J. Grid Util. Comput..

[2]  Lei Wang,et al.  A scalable dual approach to semidefinite metric learning , 2011, CVPR 2011.

[3]  Cordelia Schmid,et al.  Is that you? Metric learning approaches for face identification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Peng Li,et al.  Distance Metric Learning with Eigenvalue Optimization , 2012, J. Mach. Learn. Res..

[5]  Shervin Motamedi,et al.  A hybrid SVM-FFA method for prediction of monthly mean global solar radiation , 2015, Theoretical and Applied Climatology.

[6]  Tsuyoshi Kato,et al.  Metric learning for enzyme active-site search , 2010, Bioinform..

[7]  Horst Bischof,et al.  Joint Learning of Discriminative Prototypes and Large Margin Nearest Neighbor Classifiers , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  Qing Tian,et al.  Ordinal margin metric learning and its extension for cross-distribution image data , 2016, Inf. Sci..

[9]  Pradipta Maji,et al.  RelSim: An integrated method to identify disease genes using gene expression profiles and PPIN based similarity measure , 2017, Inf. Sci..

[10]  Qinghua Hu,et al.  Multi-granularity distance metric learning via neighborhood granule margin maximization , 2014, Inf. Sci..

[11]  Marc Sebban,et al.  A Survey on Metric Learning for Feature Vectors and Structured Data , 2013, ArXiv.

[12]  Xiaojing Chen,et al.  Sparse representation matching for person re-identification , 2016, Inf. Sci..

[13]  Joo-Hwee Lim,et al.  Similarity Learning for Nearest Neighbor Classification , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[14]  Abdullah Gani,et al.  A survey on indexing techniques for big data: taxonomy and performance evaluation , 2016, Knowledge and Information Systems.

[15]  Andreas Fischer,et al.  Pairwise support vector machines and their application to large scale problems , 2012, J. Mach. Learn. Res..

[16]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Peng Li,et al.  Similarity Metric Learning for Face Recognition , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Qinghua Hu,et al.  Dynamic time warping constraint learning for large margin nearest neighbor classification , 2011, Inf. Sci..

[20]  Kilian Q. Weinberger,et al.  Fast solvers and efficient implementations for distance metric learning , 2008, ICML '08.

[21]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[22]  David Zhang,et al.  From Point to Set: Extend the Learning of Distance Metrics , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Lei Wang,et al.  Positive Semidefinite Metric Learning Using Boosting-like Algorithms , 2011, J. Mach. Learn. Res..

[24]  Jian Sun,et al.  Bayesian Face Revisited: A Joint Formulation , 2012, ECCV.

[25]  Bernhard Sick,et al.  The responsibility weighted Mahalanobis kernel for semi-supervised training of support vector machines for classification , 2015, Inf. Sci..

[26]  Hui Xiong,et al.  Distance metrics for high dimensional nearest neighborhood recovery: Compression and normalization , 2012, Inf. Sci..

[27]  R. Rodrigo,et al.  Faster human activity recognition with SVM , 2012, International Conference on Advances in ICT for Emerging Regions (ICTer2012).

[28]  Jian Yang,et al.  K-local hyperplane distance nearest neighbor classifier oriented local discriminant analysis , 2013, Inf. Sci..

[29]  Dong Xu,et al.  Twin Mahalanobis distance-based support vector machines for pattern recognition , 2012, Inf. Sci..

[30]  Zhen Li,et al.  Learning Locally-Adaptive Decision Functions for Person Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Du Tran,et al.  Human Activity Recognition with Metric Learning , 2008, ECCV.

[32]  Vinod Nair,et al.  Learning hierarchical similarity metrics , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Xin Gao,et al.  ProDis-ContSHC: learning protein dissimilarity measures and hierarchical context coherently for protein-protein comparison in protein database retrieval , 2012, BMC Bioinformatics.

[34]  Wei Liu,et al.  Semi-supervised distance metric learning for Collaborative Image Retrieval , 2008, CVPR.

[35]  Shahaboddin Shamshirband,et al.  Co-FAIS: Cooperative fuzzy artificial immune system for detecting intrusion in wireless sensor networks , 2014, J. Netw. Comput. Appl..

[36]  William Stafford Noble,et al.  A new pairwise kernel for biological network inference with support vector machines , 2007, BMC Bioinformatics.

[37]  Geoffrey E. Hinton,et al.  Neighbourhood Components Analysis , 2004, NIPS.

[38]  Russell L. Malmberg,et al.  Stable stem enabled Shannon entropies distinguish non-coding RNAs from random backgrounds , 2011, BMC Bioinformatics.

[39]  Alexandros Kalousis,et al.  Parametric Local Metric Learning for Nearest Neighbor Classification , 2012, NIPS.

[40]  Enrique Vidal,et al.  Learning prototypes and distances (LPD). A prototype reduction technique based on nearest neighbor error minimization , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[41]  Samy Bengio,et al.  An Online Algorithm for Large Scale Image Similarity Learning , 2009, NIPS.

[42]  Thomas Villmann,et al.  Metric Learning for Prototype-Based Classification , 2009, Innovations in Neural Information Paradigms and Applications.

[43]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[44]  Bert Huang,et al.  Learning a Distance Metric from a Network , 2011, NIPS.

[45]  Sunju Park,et al.  C-Rank: A link-based similarity measure for scientific literature databases , 2011, Inf. Sci..

[46]  Jun Yu,et al.  Semantic preserving distance metric learning and applications , 2014, Inf. Sci..

[47]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[48]  Éric Gaussier,et al.  Online and Batch Learning of Generalized Cosine Similarities , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[49]  David Zhang,et al.  A Kernel Classification Framework for Metric Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.