Finger Character Recognition Using 3-Dimensional Template Matching

This paper proposes a method for Japanese finger character recognition, using a 3-dimensional (3D) scanner. A hand is a complex dexterous manipulator, evolved to be more complex than any other animals. The hand, being capable of making many different complex shapes, it is ideal for communicating using gestures. The recognition of a whole language, such as the Japanese finger characters, requires the differentiation of subtle similar positioning of each digit. To know the exact 3D position of the hand’s digits and overall shape, data gloves had been developed, but these are inconvenient to use. 2D image recognition systems struggle with recreating the 3D information. To capture the 3D information, the proposed method uses a 3D scanner, and then makes matches with 3D templates representing each unique character. Experimental results show that the proposed method recognizes a greater number of characters than existing 2D-based systems with recognition accuracy, on average of 93% for 9 testees, and a peak of over 98% for 4 of them.

[1]  Toby Walsh,et al.  Towards an Understanding of Hill-Climbing Procedures for SAT , 1993, AAAI.

[2]  Makoto Yokoo,et al.  Why Adding More Constraints Makes a Problem Easier for Hill-climbing Algorithms: Analyzing Landscapes of CSPs , 1997, CP.

[3]  Jeremy Frank,et al.  When Gravity Fails: Local Search Topology , 1997, J. Artif. Intell. Res..

[4]  Tsukasa Ogasawara,et al.  Hand pose estimation using multi-viewpoint silhouette images , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[5]  Yasushi Yagi,et al.  Gesture recognition using colored gloves , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[6]  Kazuyoshi Yoshino,et al.  Direct Estimation of Human Hand Gesture Using Color Combination , 1996 .

[7]  Yoshiaki Shirai,et al.  Map Generation of a Mobile Robot by Integrating Omnidirectional Stereo and Laser Range Finder , 2003 .

[8]  Yoichi Sato,et al.  Perceptual Glove: Real-time Input of 3D Pose and Configuration of User's Hand Using Multiple Cameras and Its Applications , 2002 .

[9]  Noriyoshi Okamoto,et al.  A Study on Human Extraction Including Overlapped Faces , 2002 .

[10]  Yangsheng Xu,et al.  Online, interactive learning of gestures for human/robot interfaces , 1996, Proceedings of IEEE International Conference on Robotics and Automation.