A generalized family of parameter estimation techniques

The Extended Baum-Welch (EBW) Transformations is one of a variety of techniques to estimate parameters of Gaussian mixture models. In this paper, we provide a theoretical framework for general parameter estimation and show the relationship between these different techniques. We introduce a general family of model parameter updates that generalizes a Baum-Welch (BW) recursive process to an arbitrary objective function of Gaussian Mixture Models, and show how other common parameter estimation techniques belong to this family of model update rules. Furthermore, we formulate the construction of an even more general family of update rules that has any specified value as a gradient steepness which belongs to the family of EBW gradient steepness, measuring how much an initial model is moved to an estimated updated model.

[1]  Jonathan Le Roux,et al.  Discriminative Training for Large-Vocabulary Speech Recognition Using Minimum Classification Error , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Tara N. Sainath,et al.  Broad phonetic class recognition in a Hidden Markov model framework using extended Baum-Welch transformations , 2007, 2007 IEEE Workshop on Automatic Speech Recognition & Understanding (ASRU).

[3]  Dimitri Kanevsky,et al.  An inequality for rational functions with applications to some statistical estimation problems , 1991, IEEE Trans. Inf. Theory.

[4]  Frank K. Soong,et al.  A Constrained Line Search Optimization for Discriminative Training in Speech Recognition , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[5]  Philip C. Woodland,et al.  Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models , 1995, Comput. Speech Lang..

[6]  Dimitri Kanevsky.  Extended Baum transformations for general functions , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Tara N. Sainath,et al.  Gradient steepness metrics using extended Baum-Welch transformations for universal pattern recognition tasks , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Chin-Hui Lee,et al.  Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains , 1994, IEEE Trans. Speech Audio Process..

[9]  Tara N. Sainath,et al.  Audio classification using extended baum-welch transformations , 2007, INTERSPEECH.