Deep Convolutional Neural Networks and Maximum-Likelihood Principle in Approximate Nearest Neighbor Search

Deep convolutional neural networks are widely used to extract high-dimensional features in various image recognition tasks. If the count of classes is relatively large, performance of the classifier for such features can be insufficient to be implemented in real-time applications, e.g., in video-based recognition. In this paper we propose the novel approximate nearest neighbor algorithm, which sequentially chooses the next instance from the database, which corresponds to the maximal likelihood (joint density) of distances to previously checked instances. The Gaussian approximation of the distribution of dissimilarity measure is used to estimate this likelihood. Experimental study results in face identification with LFW and YTF datasets are presented. It is shown that the proposed algorithm is much faster than an exhaustive search and several known approximate nearest neighbor methods.

[1]  Leonid Boytsov,et al.  Engineering Efficient and Effective Non-metric Space Library , 2013, SISAP.

[2]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Robert P. W. Duin,et al.  Classifiers for dissimilarity-based pattern recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Claudio Gennaro,et al.  Deep Permutations: Deep Convolutional Neural Networks and Permutation-Based Indexing , 2016, SISAP.

[5]  Sanjiv Kumar,et al.  On the Difficulty of Nearest Neighbor Search , 2012, ICML.

[6]  Andrey V. Savchenko Clustering and maximum likelihood search for efficient statistical classification with medium-sized databases , 2017, Optim. Lett..

[7]  Andrey V. Savchenko,et al.  Maximum Likelihood Directed Enumeration Method in Piecewise-Regular Object Recognition , 2014, Pattern Recognit..

[8]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[9]  Andrey V. Savchenko,et al.  Search Techniques in Intelligent Classification Systems , 2016 .

[10]  Gonzalo Navarro,et al.  Effective Proximity Retrieval by Ordering Permutations , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Richard I. Hartley,et al.  Optimised KD-trees for fast image descriptor matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Arnold W. M. Smeulders,et al.  The Distribution Family of Similarity Distances , 2007, NIPS.