Similar Pattern Discrimination by Filter Mask Learning with Probabilistic Descent

The purpose of this research was to examine the learning system for a feature extraction unit in OCR. Average Risk Criterion and Probabilistic Descent (basic model of MCE/GPD) are employed in the character recognition system which consists of feature extraction with filters and Euclidian distance. The learning process was applied to the similar character discrimination problem and the effects were shown as the accuracy improvement.

[1]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[2]  Yoshihiko Hamamoto,et al.  A gabor filter-based method for recognizing handwritten numerals , 1998, Pattern Recognit..

[3]  Shun-ichi Amari,et al.  A Theory of Adaptive Pattern Classifiers , 1967, IEEE Trans. Electron. Comput..

[5]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[6]  Alain Biem,et al.  Feature extraction based on minimum classification error/generalized probabilistic descent method , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Akinori Kawamura,et al.  Feature-Extraction-Based Character Recognition Using Minimum Classification Error Training , 1998 .

[8]  Kuldip K. Paliwal,et al.  Minimum classification error training algorithm for feature extractor and pattern classifier in speech recognition , 1995, EUROSPEECH.

[9]  Fumitaka Kimura,et al.  Modified Quadratic Discriminant Functions and the Application to Chinese Character Recognition , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[11]  Michiel Bacchiani,et al.  Optimization of time-frequency masking filters using the minimum classification error criterion , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[13]  Jouko Lampinen,et al.  Distortion tolerant pattern recognition based on self-organizing feature extraction , 1995, IEEE Trans. Neural Networks.

[14]  Shigeru Katagiri,et al.  A generalized probabilistic descent method , 1990 .

[15]  Kazuo Kyuma,et al.  Learning algorithm by reinforcement signals for the automatic recognition system , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[16]  Alain Biem,et al.  Filter bank design based on discriminative feature extraction , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Teuvo Kohonen,et al.  Learning vector quantization , 1998 .