Gesture recognition approach for sign language using curvature scale space and hidden Markov model

The paper presents a gesture recognition approach for sign language using curvature scale space (CSS) and hidden Markov model (HMM). First, we use the translation, scale and rotation-invariant CSS descriptor to characterize the hand shapes of gestures. Then, we propose a feature-preserving algorithm to allocate CSS features into a one-dimensional and fixed-sized feature vector for HMM since the CSS features are two-dimensional and the number of the extracted CSS features of each hand shape is not fixed. Finally, we apply the HMM to determine hand shape and trajectory transitions among the different hand shapes and trajectories of the gestures for sign language identification. Results show the proposed approach performs well for sign language recognition

[1]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Chung-Lin Huang,et al.  Sign language recognition using model-based tracking and a 3D Hopfield neural network , 1998, Machine Vision and Applications.

[3]  Ying Wu,et al.  View-independent recognition of hand postures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[5]  A.W.G. Duller,et al.  Deformation invariant pattern classification for recognising hand gestures , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[6]  Vladimir Pavlovic,et al.  Hand Gesture Modeling, Analysis, and Synthesis , 1995 .

[7]  Ho-Sub Yoon,et al.  Hand gesture recognition using hidden Markov models , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[8]  Mu-Chun Su,et al.  A static hand gesture recognition system using a composite neural network , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[9]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[10]  Jae-Ho Chung,et al.  Hand gesture recognition using orientation histogram , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).

[11]  Farzin Mokhtarian,et al.  Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Yuntao Cui,et al.  Hand sign recognition from intensity image sequences with complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  Chung-Lin Huang,et al.  Sign language recognition using model-based tracking and a 3 D Hopfield neural network , 1998 .

[14]  T ZahnCharles,et al.  Fourier Descriptors for Plane Closed Curves , 1972 .

[15]  Farzin Mokhtarian,et al.  A Theory of Multiscale, Curvature-Based Shape Representation for Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[17]  Edward Hunter,et al.  Vision based hand gesture interpretation using recursive estimation , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[18]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.