Bangla sign language interpretation using bag of features and Support Vector Machine

To complete any process, communication is necessary. Deaf and dumb people use special language to communicate which is known as Sign Language. In this paper, we propose an image processing based model for interpretation of Bangla sign language. In the model, initially YCBCR color components are used to detect the skin color of the user and then extract the Bag of features for each input image. Finally extracted features are feed to the Support Vector Machine (SVM) for training and testing. To validate the proposed model, we use our own dataset where both male and female hand gestures are used. Experimental results show that the proposed model exhibited average 86% accuracy for our tested dataset. In addition, the proposed model outperforms than other state-of-art models by exhibiting higher accuracy.

[1]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[3]  J. Hiriart-Urruty,et al.  Generalized Hessian matrix and second-order optimality conditions for problems withC1,1 data , 1984 .

[4]  P. Ganesan,et al.  International Conference on Recent Trends in Computing 2015 ( ICRTC-2015 ) Comparative Study of Skin Color Detection and Segmentation in HSV and YCbCr Color Space , 2015 .

[5]  Jeff Kramer,et al.  Hacking the Kinect , 2012, Apress.

[6]  Raed Abu Zitar,et al.  Recognition of Arabic Sign Language (ArSL) Using Recurrent Neural Networks , 2012 .

[7]  Atiqur Rahman Recognition of Static Hand Gestures of Alphabet in Bangla Sign Language , 2012 .

[8]  M. Maraqa,et al.  Recognition of Arabic Sign Language (ArSL) using recurrent neural networks , 2008, 2008 First International Conference on the Applications of Digital Information and Web Technologies (ICADIWT).

[9]  Cheryl M Lange,et al.  American Sign Language/english Bilingual Model: a Longitudinal Study of Academic Growth Metro Deaf School American Sign Language/english Bilingual Education Need for Model-specific Studies , 2022 .

[10]  Tarek M. Mahmoud A New Fast Skin Color Detection Technique , 2008 .

[11]  Yingli Tian,et al.  Multi-modality American Sign Language recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[12]  Shayhan Ameen Chowdhury,et al.  Hand sign language recognition for Bangla alphabet using Support Vector Machine , 2016, 2016 International Conference on Innovations in Science, Engineering and Technology (ICISET).

[13]  Khaled Assaleh,et al.  User-Dependent Sign Language Recognition Using Motion Detection , 2016, 2016 International Conference on Computational Science and Computational Intelligence (CSCI).