Isolated dynamic Persian sign language recognition based on camshift algorithm and radon transform

Sign language is the initial tool for communication of deaf people in their everyday life. A lot of attention has recently been assigned to sign language recognition (SLR) by researchers in various domains such as computer vision, image processing and pattern recognition. Sign language gestures are divided in two groups, static and dynamic. The former includes the alphabets and the latter presents particular concepts. This paper presents a system for recognizing Persian sign language (PSL) in color video sequences. The system includes three main parts: tracking hand using continuously adaptive mean-shift (CAMSHIFT) algorithm, feature extraction using radon transform and discrete cosine transform (DCT). Finally to evaluate the impact of feature extraction technique on recognition rate, four different classifiers include minimum distance (MD), K-nearest neighbor (KNN), neural network (NN), and support vector machine (SVM) are used. The experimental results show that the suggested system is successfully able to recognize Persian gestures.

[1]  Jinsong Xia,et al.  Face Tracking Based on Camshift Algorithm and Motion Prediction , 2009, 2009 International Workshop on Intelligent Systems and Applications.

[2]  Ayoub Al-Hamadi,et al.  A Robust Method for Hand Tracking Using Mean-shift Algorithm and Kalman Filter in Stereo Color Image Sequences , 2009 .

[3]  Duong Van Hieu,et al.  Image Preprocessing and Trajectory Feature Extraction based on Hidden Markov Models for Sign Language Recognition , 2008, 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing.

[4]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Khaled Assaleh,et al.  Video-based feature extraction techniques for isolated arabic sign language recognition , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[6]  Sudhir Sawarkar,et al.  Hand Gesture Recognition Using CAMSHIFT Algorithm , 2010, 2010 3rd International Conference on Emerging Trends in Engineering and Technology.

[7]  Wei-Yang Lin,et al.  Trajectory-based sign language recognition using Discriminant Analysis in higher-dimensional feature space , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[8]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[9]  Tamer Shanableh,et al.  Spatio-Temporal Feature-Extraction Techniques for Isolated Gesture Recognition in Arabic Sign Language , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Srecko Juric-Kavelj,et al.  An improved CamShift algorithm using stereo vision for object tracking , 2011, 2011 Proceedings of the 34th International Convention MIPRO.