To reduce the computational burden of the nearest neighbor search (NNS) problem, most existing algorithms focus on ‘preprocessing’ the data set to reduce the number of objects to be examined for each querying operation (e.g., efficient data structures, metric space transforms). In this paper we present a quantization based nearest-neighbor-preserving metric approximation algorithm (QNNM) that leads to further complexity reduction by simplifying the metric computation. The proposed algorithm is based on three observations: (i) the query vector is fixed during the entire search process, (ii) the-minimum distance exhibits an extreme value distribution, and (iii) there is high homogeneity of viewpoints. Based on these, QNNM approximates original/benchmark metric in terms of preserving the fidelity of NNS rather than the distance itself, while achieving significantly lower complexity using a query-dependent quantizer. We formulate a quantizer design problem where the goal is to minimize the average NNS error. We show how the query adaptive quantizers can be designed off-line without prior knowledge of the query and present an efficient and specifically tailored off-line optimization algorithm to find such optimal quantizer. Experimental results in a motion estimation (ME) application show minimal performance degradation (average 0.05dB loss) when using optimized 1-bit quantizer.
[1]
Hanan Samet,et al.
Foundations of multidimensional and metric data structures
,
2006,
Morgan Kaufmann series in data management systems.
[2]
O. SIAMJ.,et al.
ON THE CONVERGENCE OF PATTERN SEARCH ALGORITHMS
,
1997
.
[3]
Piotr Indyk,et al.
Approximate nearest neighbors: towards removing the curse of dimensionality
,
1998,
STOC '98.
[4]
Pavel Zezula,et al.
A cost model for similarity queries in metric spaces
,
1998,
PODS '98.
[5]
Jeffrey K. Uhlmann,et al.
Satisfying General Proximity/Similarity Queries with Metric Trees
,
1991,
Inf. Process. Lett..
[6]
Hye-Yeon Cheong,et al.
Distance Quantization Method for Fast Nearest Neighbor Search Computations with applications to Motion Estimation
,
2007,
2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.
[7]
Tamara G. Kolda,et al.
Optimization by Direct Search: New Perspectives on Some Classical and Modern Methods
,
2003,
SIAM Rev..
[8]
Stephen M. Omohundro,et al.
Efficient Algorithms with Neural Network Behavior
,
1987,
Complex Syst..