Sign language recognition of invariant features based on multiclass support vector machine with beam ECOC optimization

This paper presents a recognition system for understanding the American Sign Language using Support Vector Machine (SVM) and Error Correcting Output Codes (ECOC). In the pre-processing stage, invariant local features were extracted to develop the recognition system using multi-class support vector machine. The binary classifier of SVM employed with ECOC framework to deal multi-class problems. In ECOC, the encoding matrix was designed using various coding strategy such as one versus one, one versus all and random matrix. The data has trained based on coding matrix with set of dichotomizes independently and classify the data using loss-based decoding method to obtain efficient accuracy. In this paper, performance of recognition rate has been improved by updating given ECOC matrix from the original matrix using beam ECOC optimization. By employing beam ECOC, classification accuracy was increased from 70 to 80% than the state-of-art coding strategy.

[1]  M. Hrúz,et al.  Local binary pattern based features for sign language recognition , 2011, Pattern Recognition and Image Analysis.

[2]  Kumud Tripathi,et al.  Continuous Indian Sign Language Gesture Recognition and Sentence Formation , 2015 .

[3]  Maya Ingle,et al.  Vision-based approach for American Sign Language recognition using Edge Orientation Histogram , 2016, 2016 International Conference on Image, Vision and Computing (ICIVC).

[4]  Emil M. Petriu,et al.  Hand gesture detection and recognition using principal component analysis , 2011, 2011 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA) Proceedings.

[5]  Cordelia Schmid,et al.  Aggregating local descriptors into a compact image representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  J. Trojanová,et al.  Local Binary Pattern based features for sign language recognition , 2012, Pattern Recognition and Image Analysis.

[7]  Ito Takahiro,et al.  Histogram of oriented gradients for human detection in video , 2018, 2018 5th International Conference on Business and Industrial Research (ICBIR).

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[10]  Frédéric Jurie,et al.  Creating efficient codebooks for visual recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Sergio Escalera,et al.  On the Decoding Process in Ternary Error-Correcting Output Codes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).