Continuous dynamic Indian Sign Language gesture recognition with invariant backgrounds

Hand gestures are a strong medium of communication for hearing impaired society. It is helpful for establishing interaction between human and computer. In this work we proposed a continuous Indian Sign Language (ISL) gesture recognition system where single hand or both the hands have been used for performing gestures. Our proposed method is also invariant against various backgrounds. Tracking useful frames of gestures from continuous frame, frame overlapping method has been applied. Here we extract those frames which contains maximum information. This is helpful for speedup the recognition process. After that discrete wavelet transform (DWT) is applied for extracting features of an image frame and finally hidden markov model (HMM) is used for testing probe gestures. Experiments are performed on our own continuous ISL dataset which is created using canon EOS camera in Robotics and Artificial Intelligence laboratory (IIIT-A). From experimental results we have found that our proposed method works on various backgrounds like colored background, a background containing multiple objects etc. also this framework provides vary less time complexity as well as space complexity.

[1]  Hermann Hienz,et al.  Video-based continuous sign language recognition using statistical methods , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  P. M. Bentley,et al.  Wavelet transforms: an introduction , 1994 .

[3]  M.K. Bhuyan,et al.  Hand gesture animation by key frame extraction , 2011, 2011 International Conference on Image Information Processing.

[4]  Christian Callegari,et al.  Advances in Computing, Communications and Informatics (ICACCI) , 2015 .

[5]  Manas Kamal Bhuyan FSM-based Recognition of Dynamic Hand Gestures via Gesture Summarization Using Key Video Object Planes , 2012 .

[6]  S. Lawson,et al.  Image compression using wavelets and JPEG2000: a tutorial , 2002 .

[7]  Hermann Hienz,et al.  Relevant features for video-based continuous sign language recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[8]  Kandarpa Kumar Sarma,et al.  Gloved and free hand tracking based hand gesture recognition , 2013, 2013 1st International Conference on Emerging Trends and Applications in Computer Science.

[9]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[10]  Jiangwen Deng,et al.  An HMM-based approach for gesture segmentation and recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[11]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[12]  Kwang-Hyun Park,et al.  Continuous gesture recognition system for Korean sign language based on fuzzy logic and hidden Markov model , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[13]  Yi Li,et al.  Dynamic hand gesture recognition using hidden Markov models , 2012, 2012 7th International Conference on Computer Science & Education (ICCSE).

[14]  Image compression using wavelets and JPEG 2000 : A Tutorial , 2003 .