Multivariate structural Bernoulli mixtures for recognition of handwritten numerals

The structural optimization of a probabilistic neural network can be included into an expectation maximisation (EM) algorithm by introducing a special type of mixtures. The method has been applied to recognize unconstrained handwritten numerals from the database of Concordia University in Montreal. We discuss the possibility of a proper initialization of the EM algorithm for estimating the class-conditional multivariate Bernoulli mixtures.

[1]  Francesc J. Ferri,et al.  Initializing normal mixtures of densities , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[2]  Robert P. W. Duin,et al.  On the Choice of Smoothing Parameters for Parzen Estimators of Probability Density Functions , 1976, IEEE Transactions on Computers.

[3]  R. Fildes Journal of the Royal Statistical Society (B): Gary K. Grunwald, Adrian E. Raftery and Peter Guttorp, 1993, “Time series of continuous proportions”, 55, 103–116.☆ , 1993 .

[4]  Jirí Grim Maximum-likelihood design of layered neural networks , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[5]  Ching Y. Suen,et al.  A generalized knowledge-based system for the recognition of unconstrained handwritten numerals , 1990, IEEE Trans. Syst. Man Cybern..

[6]  Ching Y. Suen,et al.  Contour Tracing and parametric Approximations for Digitized Patterns , 1989, Computer Vision and Shape Recognition.

[7]  이성환,et al.  유전자 알고리즘과 결합된 다층 역전파 신경망을 이용한 무제약 필기체 숫자의 오프라인 인식 ( Off-Line Recognition of Unconstrained Handwritten Digits Using Multilayer Backpropagation Neural Network Combined With Genetic Algorithm ) , 1994 .

[8]  Sung-Bae Cho,et al.  Neural-network classifiers for recognizing totally unconstrained handwritten numerals , 1997, IEEE Trans. Neural Networks.

[9]  Ching Y. Suen,et al.  Structural classification and relaxation matching of totally unconstrained handwritten zip-code numbers , 1988, Pattern Recognit..

[10]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[11]  Seong-Whan Lee,et al.  Multilayer cluster neural network for totally unconstrained handwritten numeral recognition , 1995, Neural Networks.

[12]  Sung Yang Bang,et al.  An efficient method to construct a radial basis function neural network classifier and its application to unconstrained handwritten digit recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.