Hierarchical clustering using deterministic annealing

The authors present a new approach to the problem of hierarchical clustering. The method implements an approximation to joint optimization over all levels of the hierarchy, utilizing deterministic annealing to improve the clustering solution. Similar to the splitting algorithm, cluster nodes at all tree levels are placed at generalized region centroids. In this method, though, the node centroids are updated to explicitly enforce desired classification at the leaves, and to approximate the unconstrained clustering solution. The approach was demonstrated to avoid local minima that trap the splitting algorithm and to obtain a performance improvement for a normal mixture source and a speech source.<<ETX>>

[1]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[2]  R. Sokal,et al.  Principles of numerical taxonomy , 1965 .

[3]  Geoffrey C. Fox,et al.  Vector quantization by deterministic annealing , 1992, IEEE Trans. Inf. Theory.

[4]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[5]  Geoffrey C. Fox,et al.  A deterministic annealing approach to clustering , 1990, Pattern Recognit. Lett..

[6]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[7]  R. Gray,et al.  Speech coding based upon vector quantization , 1980, ICASSP.

[8]  Rose,et al.  Statistical mechanics and phase transitions in clustering. , 1990, Physical review letters.