Bayes risk weighted tree-structured vector quantization with posterior estimation

The authors investigate a method that combines compression and low-level classification of images by designing codes that contain implicit information regarding classification. The design consists of a tree-structured vector quantizer (TSVQ) that incorporates a Bayes risk term into the distortion measure used in the quantizer design algorithm in order to permit a tradeoff of mean squared error and classification error. Once designed, the quantizer can operate to minimize the Bayes risk weighted distortion measure by incorporating the posterior probabilities into the encoding process. A completely nonparametric design algorithm is constructed by estimating these posterior distributions using a TSVQ that incorporates the classification error into the splitting criterion. This approach is used to analyze simulated data and to identify tumors in CT lung images. Comparisons are made with other vector quantizer based classifiers, including Kohonen's "learning vector quantizer." For the examples considered, their method provided a classification that was superior to the other methods while simultaneously providing close to or superior compression performance.<<ETX>>

[1]  R. Gray,et al.  Combining tree-structured vector quantization with classification and regression trees , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[2]  R. Gray,et al.  Classification using vector quantization , 1991, [1991] Conference Record of the Twenty-Fifth Asilomar Conference on Signals, Systems & Computers.

[3]  R.M. Gray,et al.  A greedy tree growing algorithm for the design of variable rate vector quantizers [image compression] , 1991, IEEE Trans. Signal Process..

[4]  Robert M. Gray,et al.  Minimum Cross-Entropy Pattern Classification and Cluster Analysis , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Robert M. Gray Bayes risk-weighted vector quantization , 1994, Proceedings of 1994 Workshop on Information Theory and Statistics.

[6]  R. Gray,et al.  Combining Image Compression and Classification Using Vector Quantization , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Robert M. Gray,et al.  Combining image classification and image compression using vector quantization , 1993, [Proceedings] DCC `93: Data Compression Conference.

[8]  Andrew B. Nobel,et al.  Termination and continuity of greedy growing for tree-structured vector quantizers , 1996, IEEE Trans. Inf. Theory.

[9]  Richard D. Wesel,et al.  Bayes risk weighted VQ and learning VQ , 1994, Proceedings of IEEE Data Compression Conference (DCC'94).

[10]  G. Lugosi,et al.  Consistency of Data-driven Histogram Methods for Density Estimation and Classification , 1996 .

[11]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[12]  T. Kohonen,et al.  Statistical pattern recognition with neural networks: benchmarking studies , 1988, IEEE 1988 International Conference on Neural Networks.