Hypothesis comparison guided cross validation for unsupervised signer adaptation

Signer adaptation is important to sign language recognition systems in that a one-size-fits-all model set can not perform well on all kinds of signers. Supervised signer adaptation must utilize the labeled adaptation data that are collected explicitly. To skip the data collecting process in signer adaptation, we propose an unsupervised adaptation method called hypothesis comparison guided cross validation (HC-CV) algorithm. The algorithm not only addresses the problem of overlap between the data set to be labeled and the data set for adaptation, but also employs an additional hypothesis comparison step to decrease the noise rate of the adaptation data set. Experimental results show that the HC-CV adaptation algorithm is superior to the CV adaptation algorithm and the conventional self-teaching algorithm. Though the algorithm is proposed for signer adaptation, it can also be applied to speaker adaptation and writer adaptation straightforwardly.

[1]  Wen Gao,et al.  Generating Data for Signer Adaptation , 2007, Gesture Workshop.

[2]  Zhi-Hua Zhou,et al.  Tri-training: exploiting unlabeled data using three classifiers , 2005, IEEE Transactions on Knowledge and Data Engineering.

[3]  Steve Young,et al.  The HTK book version 3.4 , 2006 .

[4]  Jun-ichi Takahashi,et al.  Vector-field-smoothed Bayesian learning for incremental speaker adaptation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[5]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Philip C. Woodland,et al.  Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models , 1995, Comput. Speech Lang..

[7]  Daniel Schneider,et al.  Rapid Signer Adaptation for Isolated Sign Language Recognition , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[8]  Sadaoki Furui,et al.  Unsupervisec cross-validation adaptation algorithms for improved adaptation performance , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Dana Angluin,et al.  Learning from noisy examples , 1988, Machine Learning.

[10]  Surendra Ranganath,et al.  Deciphering gestures with layered meanings and signer adaptation , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[11]  Karl-Friedrich Kraiss,et al.  Rapid signer adaptation for continuous sign language recognition using a combined approach of eigenvoices, MLLR, and MAP , 2008, 2008 19th International Conference on Pattern Recognition.

[12]  Chin-Hui Lee,et al.  Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains , 1994, IEEE Trans. Speech Audio Process..