Modified Kneser-Ney Smoothing of n-gram Models
暂无分享,去创建一个
This report examines a series of tests that were performed on variations of the modified Kneser-Ney smoothing model outlined in a study by Chen and Goodman. [2] We explore several different ways of choosing and setting the discounting parameters, as well as the exclusion of singleton contexts at various levels of the model.
[1] F ChenStanley,et al. An Empirical Study of Smoothing Techniques for Language Modeling , 1996, ACL.
[2] Daniel Zwillinger,et al. CRC standard mathematical tables and formulae; 30th edition , 1995 .
[3] S. Shapiro,et al. An Analysis of Variance Test for Normality (Complete Samples) , 1965 .
[4] Hermann Ney,et al. Improved backing-off for M-gram language modeling , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.