A Novel Vision based Finger-writing Character Recognition System

A new vision based finger writing character recognition system (FWCRS) is proposed in this paper. The FWCRS allows people to write characters virtually just using his finger-tip (we call this "finger-writing"). The trajectories of the finger-tip are tracked and reconstructed as a kind of inkless character pattern and finally recognized by a classifier. In this paper, a simple but effective background model is built for the FWCRS to segment human finger from cluttered background. A robust fingertip detection algorithm based on feature matching is presented. The finger-writing character is finally recognized by a DTW classifier. Experiments show that the FWCRS can recognize finger-writing uppercase & lowercase English characters with the accuracy of 95.6%, 98.5% respectively

[1]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  James L. Crowley,et al.  Finger Tracking as an Input Device for Augmented Reality , 1995 .

[4]  Mubarak Shah,et al.  Visual gesture recognition , 1994 .

[5]  Daphna Weinshall,et al.  A computer vision system for on-screen item selection by finger pointing , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Shan Lu,et al.  Color-based hands tracking system for sign language recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Ching Y. Suen,et al.  Online handwriting recognition-a survey , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[8]  Dieter Schmalstieg,et al.  Finger tracking for interaction in augmented environments , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[9]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Yoichi Sato,et al.  Real-Time Fingertip Tracking and Gesture Recognition , 2002, IEEE Computer Graphics and Applications.

[11]  L. Davis,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002, Proc. IEEE.

[12]  Yoichi Sato,et al.  Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[13]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[14]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  R. Ishii,et al.  Hand shape extraction from a sequence of digitized gray-scale images , 1994, Proceedings of IECON'94 - 20th Annual Conference of IEEE Industrial Electronics.

[16]  Thomas Brown,et al.  Finger tracking for the Digital Desk , 2000, Proceedings First Australasian User Interface Conference. AUIC 2000 (Cat. No.PR00515).

[17]  Lianwen Jin,et al.  One stroke cursive character recognition using combination of directional and positional features , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[18]  Pietro Perona,et al.  Visual Input for Pen-Based Computers , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[20]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.