Reduced complexity quantization under classification constraints

In optimal product vector quantization (VQ) sub-vectors within a vector are encoded separately. Optimal product VQ (PVQ) aims at maximizing the rate-distortion (RD) performance. We consider scenarios where PVQ is used to approximate the labeling obtained from an existing higher dimension quantizer or classifier. We present an efficient design technique under the labeling constraints and we show that performance is significantly improved if these are taken into account. We present two examples where this technique can be used. First we consider a PVQ designed to approximate a higher dimension classifier. In this case we show that with a small penalty in distortion (e.g., 0.04 dB loss) we can reduce significantly the misclassification (e.g., 48% relative reduction, 4.6% absolute reduction) with respect to a standard PVQ design. In our second example we show how hierarchical VQ (HVQ) can be used as a preprocessing stage for a standard unstructured VQ such that the HVQ stage enables a significant reduction of the codeword candidates to be searched in the VQ stage. Here again we show how HVQ designed to optimize the labeling enables a further reduction in complexity as the HVQ partition is designed to approximate the standard VQ partition.

[1]  R. Gray,et al.  Combining Image Compression and Classification Using Vector Quantization , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Robert M. Gray Bayes risk-weighted vector quantization , 1994, Proceedings of 1994 Workshop on Information Theory and Statistics.

[3]  Sanjit K. Mitra,et al.  Optimal variable-rate mean-gain-shape vector quantization for image coding , 1996, IEEE Trans. Circuits Syst. Video Technol..

[4]  Pao-Chi Chang,et al.  Hierarchical vector quantizers with table-lookup encoders , 1985 .

[5]  Robert M. Gray,et al.  Bayes risk weighted vector quantization with posterior estimation for image compression and classification , 1996, IEEE Trans. Image Process..

[6]  Antonio Ortega,et al.  Joint compression-classification with quantizer/classifier dimension mismatch , 2000, IS&T/SPIE Electronic Imaging.

[7]  Wayne E. Stark,et al.  Fine-coarse vector quantization , 1991, IEEE Trans. Signal Process..

[8]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[9]  Kuldip K. Paliwal,et al.  Fast K-dimensional tree algorithms for nearest neighbor search with application to vector quantization encoding , 1992, IEEE Trans. Signal Process..

[10]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[11]  Robert M. Gray,et al.  An Improvement of the Minimum Distortion Encoding Algorithm for Vector Quantization , 1985, IEEE Trans. Commun..

[12]  Robert M. Gray,et al.  Bayes risk weighted tree-structured vector quantization with posterior estimation , 1994, Proceedings of IEEE Data Compression Conference (DCC'94).