Sign Language Recognition System Using Deep Neural Network

In the current fast-moving world, human-computer- interactions (HCI) is one of the main contributors towards the progress of the country. Since the conventional input devices limit the naturalness and speed of human-computer- interactions, Sign Language recognition system has gained a lot of importance. Different sign languages can be used to express intentions and intonations or for controlling devices such as home robots. The main focus of this work is to create a vision based system, a Convolutional Neural Network (CNN) model, to identify six different sign languages from the images captured. The two CNN models developed have different type of optimizers, the Stochastic Gradient Descent (SGD) and Adam.

[1]  Vijay John,et al.  Deep Learning-Based Fast Hand Gesture Recognition Using Representative Frames , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[2]  C. Jose L. Flores,et al.  Application of convolutional neural networks for static hand gestures recognition under different invariant features , 2017, 2017 IEEE XXIV International Conference on Electronics, Electrical Engineering and Computing (INTERCON).

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  P. V. V. Kishore,et al.  Deep convolutional neural networks for sign language recognition , 2018, 2018 Conference on Signal Processing And Communication Engineering Systems (SPACES).

[5]  Wang Ping,et al.  Research on data augmentation for image classification based on convolution neural networks , 2017, 2017 Chinese Automation Congress (CAC).

[6]  Peng Zhang,et al.  Vision-Based Human-Computer System Using Hand Gestures , 2009, 2009 International Conference on Computational Intelligence and Security.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Houqiang Li,et al.  Sign Language Recognition using 3D convolutional neural networks , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[9]  Josef Sivic,et al.  Convolutional Neural Network Architecture for Geometric Matching , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Aarti G. Ambekar,et al.  Sign language recognition using image based hand gesture recognition techniques , 2016, 2016 Online International Conference on Green Engineering and Technologies (IC-GET).