American Sign Language Recognition: Algorithm and Experimentation System

The objective of this paper is an attempt to take part in the fast development of computer science, especially machine learning, in the field of finding the tools for supporting the disabled people. Speech-and–hearing impaired people are the part of our society and it would be a great convenience both for them and for speaking people, who would have an opportunity for a better communication using computer technology. In this paper, the results of the research concerning recognition of sign language have been provided. The research includes experimenting with the images transformations and the usage of different learning and feature detecting algorithms to obtain the best quality of signs recognition. In addition, the recommendations based on results of experiments can be applied in practical issues, for example, in determining hands rotations used in sign language, which can improve the accuracy of recognition.

[1]  Leszek Koszalka,et al.  Multi-agent pathfinding in the crowded environment with obstacles: Algorithms and experimentation system , 2017, J. Intell. Fuzzy Syst..

[2]  Debi Prosad Dogra,et al.  Coupled HMM-based multi-sensor data fusion for sign language recognition , 2017, Pattern Recognit. Lett..

[3]  IV CyrilHöschl,et al.  Recognition of Images Degraded by Gaussian Blur , 2016, IEEE Transactions on Image Processing.

[4]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[5]  Feng Ran,et al.  Gesture recognition based on parallel hardware neural network implemented with stochastic logics , 2016, 2016 International Conference on Audio, Language and Image Processing (ICALIP).

[6]  Lior Rokach,et al.  Data Mining And Knowledge Discovery Handbook , 2005 .

[7]  M. Sundarambal,et al.  FPGA implementation of hand gesture recognition system using neural networks , 2017, 2017 11th International Conference on Intelligent Systems and Control (ISCO).

[8]  Marek Kraft,et al.  Comparative assessment of point feature detectors in the context of robot navigation , 2013 .

[9]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[10]  Guang-Zhong Yang,et al.  Structure adaptive anisotropic filtering , 1995 .

[11]  Federico Sandoval-Ibarra,et al.  American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network , 2017, Sensors.

[12]  Leszek Koszalka,et al.  Evaluation of strip nesting algorithms: An experimentation system for the practical users , 2014, J. Intell. Fuzzy Syst..

[13]  Wenjin Tao,et al.  American Sign Language alphabet recognition using Convolutional Neural Networks with multiview augmentation and inference fusion , 2018, Eng. Appl. Artif. Intell..

[14]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.