A New Similarity Space Tailored for Supervised Deep Metric Learning

We propose a novel deep metric learning method. Differently from many works on this area, we defined a novel latent space obtained through an autoencoder. The new space, namely S-space, is divided into different regions that describe the positions where pairs of objects are similar/dissimilar. We locate makers to identify these regions. We estimate the similarities between objects through a kernel-based t-student distribution to measure the markers' distance and the new data representation. In our approach, we simultaneously estimate the markers' position in the S-space and represent the objects in the same space. Moreover, we propose a new regularization function to avoid similar markers to collapse altogether. We present evidences that our proposal can represent complex spaces, for instance, when groups similar objects are located in disjoint regions. We compare our proposal to 9 different distance metric learning approaches (four of them are based on deep-learning) on 28 real-world heterogeneous datasets. According to the four quantitative metrics used, our method overcomes all the nine strategies from the literature.

[1]  Bernard De Baets,et al.  Supervised distance metric learning through maximization of the Jeffrey divergence , 2017, Pattern Recognit..

[2]  Licheng Jiao,et al.  Hyperspectral imagery classification with deep metric learning , 2019, Neurocomputing.

[3]  Lorenzo Torresani,et al.  Large Margin Component Analysis , 2006, NIPS.

[4]  Xin Gao,et al.  ProDis-ContSHC: learning protein dissimilarity measures and hierarchical context coherently for protein-protein comparison in protein database retrieval , 2012, BMC Bioinformatics.

[5]  Yao Yang,et al.  Triplet Enhanced AutoEncoder: Model-free Discriminative Network Embedding , 2019, IJCAI.

[6]  Jian Wang,et al.  Deep Metric Learning with Angular Loss , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Michael Jones,et al.  An improved deep learning architecture for person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Matthew R. Scott,et al.  Multi-Similarity Loss With General Pair Weighting for Deep Metric Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Silvio Savarese,et al.  Deep Metric Learning via Lifted Structured Feature Embedding , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[11]  G. Priya,et al.  EFFICIENT KNN CLASSIFICATION ALGORITHM FOR BIG DATA , 2017 .

[12]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[13]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[14]  François-Xavier Vialard,et al.  Metric Learning for Image Registration , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Xiantong Zhen,et al.  Model-Agnostic Metric for Zero-Shot Learning , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[16]  Cheng Deng,et al.  Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[19]  J. Mockus,et al.  THE BAYES METHODS FOR SEEKING THE EXTREMAL POINT , 1974 .

[20]  Rongrong Ji,et al.  Pyramidal Person Re-IDentification via Multi-Loss Dynamic Training , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Bo Zhang,et al.  Discriminatively Boosted Image Clustering with Fully Convolutional Auto-Encoders , 2017, Pattern Recognit..

[22]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[23]  Amir Globerson,et al.  Metric Learning by Collapsing Classes , 2005, NIPS.

[24]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[25]  Bernard De Baets,et al.  Kernel-Based Distance Metric Learning for Supervised $k$ -Means Clustering , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[27]  Fei Wang,et al.  Feature Extraction by Maximizing the Average Neighborhood Margin , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[29]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[30]  Tao Zhang,et al.  A hybrid approach with optimization-based and metric-based meta-learner for few-shot learning , 2019, Neurocomputing.

[31]  Nenghai Yu,et al.  Learning Bregman Distance Functions for Semi-Supervised Clustering , 2012, IEEE Transactions on Knowledge and Data Engineering.

[32]  Xian-Sheng Hua,et al.  Deep Siamese Network with Multi-level Similarity Perception for Person Re-identification , 2017, ACM Multimedia.

[33]  Claudine Badue,et al.  Fast(er) Reconstruction of Shredded Text Documents via Self-Supervised Deep Asymmetric Metric Learning , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Gert R. G. Lanckriet,et al.  Metric Learning to Rank , 2010, ICML.

[35]  Bernard De Baets,et al.  Improved deep embedding learning based on stochastic symmetric triplet loss and local sampling , 2020, Neurocomputing.

[36]  Shie-Jue Lee,et al.  A Similarity Measure for Text Classification and Clustering , 2014, IEEE Transactions on Knowledge and Data Engineering.

[37]  Shengcai Liao,et al.  Embedding Deep Metric for Person Re-identification: A Study Against Large Variations , 2016, ECCV.

[38]  Geoffrey E. Hinton,et al.  Neighbourhood Components Analysis , 2004, NIPS.

[39]  Kihyuk Sohn,et al.  Improved Deep Metric Learning with Multi-class N-pair Loss Objective , 2016, NIPS.

[40]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[41]  Hecht-Nielsen Theory of the backpropagation neural network , 1989 .

[42]  Xiaoyan Hong,et al.  A group mobility model for ad hoc wireless networks , 1999, MSWiM '99.

[43]  Stan Sclaroff,et al.  Deep Metric Learning to Rank , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Michel Deudon,et al.  Learning semantic similarity in a continuous space , 2018, NeurIPS.

[46]  Alexander J. Smola,et al.  Sampling Matters in Deep Embedding Learning , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[47]  Gao Cong,et al.  Efficient Similar Region Search with Deep Metric Learning , 2018, KDD.

[48]  Baishakhi Ray,et al.  Metric Learning for Adversarial Robustness , 2019, NeurIPS.

[49]  Feiping Nie,et al.  Learning a Mahalanobis distance metric for data clustering and classification , 2008, Pattern Recognit..

[50]  Jinde Cao,et al.  Effective metric learning with co-occurrence embedding for collaborative recommendations , 2020, Neural Networks.

[51]  D. Massart,et al.  The Mahalanobis distance , 2000 .

[52]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[53]  Feng Zhou,et al.  Fine-Grained Categorization and Dataset Bootstrapping Using Deep Metric Learning with Humans in the Loop , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Zhihai He,et al.  Metric learning-based kernel transformer with triplets and label constraints for feature fusion , 2020, Pattern Recognit..

[55]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[56]  Victor S. Lempitsky,et al.  Learning Deep Embeddings with Histogram Loss , 2016, NIPS.

[57]  María José del Jesús,et al.  KEEL 3.0: An Open Source Software for Multi-Stage Analysis in Data Mining , 2017, Int. J. Comput. Intell. Syst..

[58]  Stéphan Clémençon,et al.  A Probabilistic Theory of Supervised Similarity Learning for Pointwise ROC Curve Optimization , 2018, ICML.

[59]  Chenglin Miao,et al.  Metric Learning from Probabilistic Labels , 2018, KDD.

[60]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[61]  Kourosh Zarringhalam,et al.  A Free Energy Based Approach for Distance Metric Learning , 2019, KDD.

[62]  Yuehui Chen,et al.  Improving Neural-Network Classifiers Using Nearest Neighbor Partitioning , 2017, IEEE Transactions on Neural Networks and Learning Systems.