RETRACTED ARTICLE: Machine learning based sign language recognition: a review and its research frontier

In the recent past, research in the field of automatic sign language recognition using machine learning methods have demonstrated remarkable success and made momentous progression. This research article investigates the impact of machine learning in the state of the art literature on sign language recognition and classification. It highlights the issues faced by the present recognition system for which the research frontier on sign language recognition intends the solutions. In this article, around 240 different approaches have been compared that explore sign language recognition for recognizing multilingual signs. The research done by various authors is also studied, and some of the important research articles are also discussed in this article. Based on the inferences from these approaches, this article discussed how machine learning methods could benefit the field of automatic sign language recognition and the potential gaps that machine learning approaches need to address for the real-time sign language recognition.

[1]  Andrew Zisserman,et al.  Minimal Training, Large Lexicon, Unconstrained Sign Language Recognition , 2004, BMVC.

[2]  Dimitris N. Metaxas,et al.  Handshapes and movements: Multiple-channel ASL recognition , 2004 .

[3]  Ayoub Al-Hamadi,et al.  A Hidden Markov Model-based continuous gesture recognition system for hand motion trajectory , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Swapnil Belhe,et al.  Indian Sign Language Recognition Using Kinect Sensor , 2015, ICIAR.

[5]  Soumik Mondal,et al.  Recognition of Isolated Indian Sign Language Gesture in Real Time , 2010, BAIP.

[6]  Christophe Collet,et al.  Robust Tracking for Processing of Videos of Communication's Gestures , 2009, Gesture Workshop.

[7]  Dimitris N. Metaxas,et al.  A Framework for Recognizing the Simultaneous Aspects of American Sign Language , 2001, Comput. Vis. Image Underst..

[8]  Bruno J. T. Fernandes,et al.  An Effective Dynamic Gesture Recognition System Based on the Feature Vector Reduction for SURF and LCS , 2013, ICANN.

[9]  Dimitris N. Metaxas,et al.  Tracking Facial Features Using Mixture of Point Distribution Models , 2006, ICVGIP.

[10]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[11]  Wen Gao,et al.  A novel approach to automatically extracting basic units from Chinese sign language , 2004, ICPR 2004.

[12]  Nathaniel Rossol,et al.  A Multisensor Technique for Gesture Recognition Through Intelligent Skeletal Pose Analysis , 2016, IEEE Transactions on Human-Machine Systems.

[13]  Stan Sclaroff,et al.  Exploiting phonological constraints for handshape inference in ASL video , 2011, CVPR 2011.

[14]  Ahmad Zaki Shukor,et al.  A New Data Glove Approach for Malaysian Sign Language Detection , 2015 .

[15]  Hermann Ney,et al.  Geometric Features for Improving Continuous Appearance-based Sign Language Recognition , 2006, BMVC.

[16]  Anand Kannan,et al.  Intelligent System for Human Computer Interface Using Hand Gesture Recognition , 2012 .

[17]  Jovan Popović,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH 2009.

[18]  M. B. Waldron,et al.  Isolated ASL sign recognition system for deaf persons , 1995 .

[19]  Dimitris N. Metaxas,et al.  Parallel hidden Markov models for American sign language recognition , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  Hong Liu,et al.  Human activity prediction by mapping grouplets to recurrent Self-Organizing Map , 2016, Neurocomputing.

[21]  Wen Gao,et al.  Expanding Training Set for Chinese Sign Language Recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[22]  Yoshua Bengio,et al.  Input-output HMMs for sequence processing , 1996, IEEE Trans. Neural Networks.

[23]  Hermann Ney,et al.  Extensions of the Sign Language Recognition and Translation Corpus RWTH-PHOENIX-Weather , 2014, LREC.

[24]  Ayoub Al-Hamadi,et al.  Data Gathering for Gesture Recognition Systems Based on Mono Color-, Stereo Color- and Thermal Cameras , 2009, FGIT.

[25]  Gora Chand Nandi,et al.  An efficient gesture based humanoid learning using wavelet descriptor and MFCC techniques , 2017, Int. J. Mach. Learn. Cybern..

[26]  Sébastien Marcel,et al.  Hand gesture recognition using input-output hidden Markov models , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[27]  Khaled Assaleh,et al.  Low Complexity Classification System for Glove-Based Arabic Sign Language Recognition , 2012, ICONIP.

[28]  Maja Pantic,et al.  Fully Automatic Recognition of the Temporal Phases of Facial Actions , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  M. Vafadoost,et al.  3D Pose Estimation via Elliptical Fourier Descriptors for Deformable Hand Representations , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[30]  R. Elakkiya,et al.  An Active Learning Framework for Human Hand Sign Gestures and Handling Movement Epenthesis Using Enhanced Level Building Approach , 2015 .

[31]  A. Abdelbaky Ahmed,et al.  Appearance-based Arabic Sign Language recognition using Hidden Markov Models , 2014, 2014 International Conference on Engineering and Technology (ICET).

[32]  Shaogang Gong,et al.  Resolving Visual Uncertainty and Occlusion through Probabilistic Reasoning , 2000, BMVC.

[33]  Petros Maragos,et al.  Dynamic-static unsupervised sequentiality, statistical subunits and lexicon for sign language recognition , 2014, Image Vis. Comput..

[34]  Surendra Ranganath,et al.  Towards subject independent continuous sign language recognition: A segment and merge approach , 2014, Pattern Recognit..

[35]  Tarik Arici,et al.  Gesture Recognition using Skeleton Data with Weighted Dynamic Time Warping , 2013, VISAPP.

[36]  Raúl Rojas,et al.  Sign Language Recognition Using Kinect , 2012, ICAISC.

[37]  Pietro Zanuttigh,et al.  Hand gesture recognition with leap motion and kinect devices , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[38]  Björn Stenger,et al.  Template-Based Hand Pose Recognition Using Multiple Cues , 2006, ACCV.

[39]  Gary R. Bradski,et al.  Stereo based gesture recognition invariant to 3D pose and lighting , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[40]  Mohamed A. Deriche,et al.  Arabic sign language recognition using the leap motion controller , 2014, 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE).

[41]  Peng Liu,et al.  Using eye gaze, head pose, and facial expression for personalized non-player character interaction , 2011, CVPR 2011 WORKSHOPS.

[42]  W. Stokoe,et al.  A dictionary of American sign language on linguistic principles , 1965 .

[43]  Stan Sclaroff,et al.  Estimating 3D hand pose from a cluttered image , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[44]  Mariusz Oszust,et al.  Recognition of Hand Gestures Observed by Depth Cameras , 2015 .

[45]  R. Elakkiya,et al.  An intelligent framework for recognizing sign language from continuous video sequence using boosted subunits , 2013 .

[46]  Richard Bowden,et al.  Sign Language Recognition , 2011, Visual Analysis of Humans.

[47]  Petros Maragos,et al.  Advances in phonetics-based sub-unit modeling for transcription alignment and sign language recognition , 2011, CVPR 2011 WORKSHOPS.

[48]  Agnès Just,et al.  HMM and IOHMM for the Recognition of Mono- and Bi-Manual 3D Hand Gestures , 2004, BMVC.

[49]  Robyn A. Owens,et al.  Visual Sign Language Recognition , 2000, Theoretical Foundations of Computer Vision.

[50]  Ali Karami,et al.  Persian sign language (PSL) recognition using wavelet transform and neural networks , 2011, Expert Syst. Appl..

[51]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Michael I. Jordan,et al.  Factorial Hidden Markov Models , 1995, Machine Learning.

[53]  KwangYun Wohn,et al.  Recognition of space-time hand-gestures using hidden Markov model , 1996, VRST.

[54]  Alistair Sutherland,et al.  Transformation Invariance in Hand Shape Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[55]  Hermann Ney,et al.  Modality Combination Techniques for Continuous Sign Language Recognition , 2013, IbPRIA.

[56]  D. J. Salmond,et al.  A particle filter for track-before-detect , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[57]  Scott K. Liddell,et al.  American Sign Language: The Phonological Base , 2013 .

[58]  Ok-Hue Cho,et al.  A Study about Honey Bee Dance Serious Game for Kids Using Hand Gesture , 2014, MUE 2014.

[59]  Lalit Gupta,et al.  Gesture-based interaction and communication: automated classification of hand gesture contours , 2001, IEEE Trans. Syst. Man Cybern. Syst..

[60]  Mariusz Oszust,et al.  Modelling and Recognition of Signed Expressions Using Subunits Obtained by Data-Driven Approach , 2012, AIMSA.

[61]  Pietro Zanuttigh,et al.  Hand gesture recognition with jointly calibrated Leap Motion and depth sensor , 2015, Multimedia Tools and Applications.

[62]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[63]  Roberto Cipolla,et al.  Real-Time Adaptive Hand Motion Recognition Using a Sparse Bayesian Classifier , 2005, ICCV-HCI.

[64]  Surendra Ranganath,et al.  Tracking facial features under occlusions and recognizing facial expressions in sign language , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[65]  Hermann Ney,et al.  May the force be with you: Force-aligned signwriting for automatic subunit annotation of corpora , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[66]  Tamer Shanableh,et al.  Spatio-Temporal Feature-Extraction Techniques for Isolated Gesture Recognition in Arabic Sign Language , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[67]  Jiangwen Deng,et al.  A novel two-layer PCA/MDA scheme for hand posture recognition , 2002, Object recognition supported by user interaction for service robots.

[68]  John K. Tsotsos,et al.  Definition and recovery of kinematic features for recognition of American sign language movements , 2008, Image Vis. Comput..

[69]  Wen Gao,et al.  Synthetic data generation technique in Signer-independent sign language recognition , 2009, Pattern Recognit. Lett..

[70]  Mariusz Oszust,et al.  Polish sign language words recognition with Kinect , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[71]  Yan Wen,et al.  A robust method of detecting hand gestures using depth sensors , 2012, 2012 IEEE International Workshop on Haptic Audio Visual Environments and Games (HAVE 2012) Proceedings.

[72]  Debi Prosad Dogra,et al.  Independent Bayesian classifier combination based sign language recognition using facial expression , 2018, Inf. Sci..

[73]  Yuntao Cui,et al.  Appearance-Based Hand Sign Recognition from Intensity Image Sequences , 2000, Comput. Vis. Image Underst..

[74]  Eli Hagen,et al.  Towards an American Sign Language interface , 1994, Artificial Intelligence Review.

[75]  Wen Gao,et al.  A Chinese sign language recognition system based on SOFM/SRN/HMM , 2004, Pattern Recognit..

[76]  Xuan Wang,et al.  Vision-Based Hand Gesture Recognition Using Combinational Features , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[77]  W. Stokoe.  Semantic Phonology , 2013 .

[78]  Mauro Donadeo,et al.  Combining multiple depth-based descriptors for hand gesture recognition , 2014, Pattern Recognit. Lett..

[79]  Lale Akarun,et al.  A belief-based sequential fusion approach for fusing manual signs and non-manual signals , 2009, Pattern Recognit..

[80]  Suharjito,et al.  Sign Language Recognition Application Systems for Deaf-Mute People: A Review Based on Input-Process-Output , 2017, ICCSCI.

[81]  Ching-Hua Chuan,et al.  American Sign Language Recognition Using Leap Motion Sensor , 2014, 2014 13th International Conference on Machine Learning and Applications.

[82]  Seong-Whan Lee,et al.  Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine , 2013, Pattern Recognit. Lett..

[83]  Kiyoshi Hoshino.  Dexterous Robot Hand Control with Data Glove by Human Imitation , 2006, IEICE Trans. Inf. Syst..

[84]  Z. Zenn Bien,et al.  A dynamic gesture recognition system for the Korean sign language (KSL) , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[85]  Lale Akarun,et al.  STARS: Sign tracking and recognition system using input-output HMMs , 2009, Pattern Recognit. Lett..

[86]  Narendra Ahuja,et al.  Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[87]  Aaron F. Bobick,et al.  Parametric Hidden Markov Models for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[88]  Petros Maragos,et al.  Model-level data-driven sub-units for signs in videos of continuous Sign Language , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[89]  Wen Gao,et al.  Recognition of strong and weak connection models in continuous sign language , 2002, Object recognition supported by user interaction for service robots.

[90]  Elakkiya R,et al.  Extricating Manual and Non-Manual Features for Subunit Level Medical Sign Modelling in Automatic Sign Language Classification and Recognition , 2017, Journal of medical systems.

[91]  Hans-Peter Kriegel,et al.  The (black) art of runtime evaluation: Are we comparing algorithms or implementations? , 2017, Knowledge and Information Systems.

[92]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[93]  Khaled Assaleh,et al.  Glove-Based Continuous Arabic Sign Language Recognition in User-Dependent Mode , 2015, IEEE Transactions on Human-Machine Systems.

[94]  Suat Akyol,et al.  Hands Tracking from Frontal View for Vision-Based Gesture Recognition , 2002, DAGM-Symposium.

[95]  Fasheng Wang,et al.  Improving particle filter with a new sampling strategy , 2009, 2009 4th International Conference on Computer Science & Education.

[96]  Mohammed Yeasin,et al.  Visual understanding of dynamic hand gestures , 2000, Pattern Recognit..

[97]  Richard Bowden,et al.  Generalised Pose Estimation Using Depth , 2010, ECCV Workshops.

[98]  Yoshiaki Shirai,et al.  Hand shape estimation under complex backgrounds for sign language recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[99]  Richard Bowden,et al.  Sign Language Recognition Using Boosted Volumetric Features , 2007, MVA.

[100]  Hyung Lee-Kwang,et al.  Modeling and recognition of hand gesture using colored Petri nets , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[101]  Daniel Kelly,et al.  Recognition of Spatiotemporal Gestures in Sign Language Using Gesture Threshold HMMs , 2011 .

[102]  Alberto Del Bimbo,et al.  Automatic facial expression recognition in real-time from dynamic sequences of 3D face scans , 2013, The Visual Computer.

[103]  Shu Wang,et al.  A New Framework for Sign Language Recognition based on 3D Handshape Identification and Linguistic Modeling , 2014, LREC.

[104]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[105]  Kadirvelu Selvamani,et al.  Human Computer Interaction , 2017 .

[106]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[107]  Samir I. Shaheen,et al.  Sign language recognition using a combination of new vision based features , 2011, Pattern Recognit. Lett..

[108]  M. Deriche,et al.  A signer-independent Arabic Sign Language recognition system using face detection, geometric features, and a Hidden Markov Model , 2012, Comput. Electr. Eng..

[109]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[110]  S. Sharma,et al.  Trbaggboost: an ensemble-based transfer learning method applied to Indian Sign Language recognition , 2020, J. Ambient Intell. Humaniz. Comput..

[111]  Shiqing Zhang,et al.  Facial Expression Recognition Based on Local Binary Patterns and Kernel Discriminant Isomap , 2011, Sensors.

[112]  Moritz Knorr,et al.  The significance of facial features for automatic sign language recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[113]  Cheng-Chew Lim,et al.  Segmentation of the face and hands in sign language video sequences using color and motion cues , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[114]  Petros Maragos,et al.  Product-HMMs for automatic sign language recognition , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[115]  Ming Ouhyoung,et al.  A sign language recognition system using hidden markov model and context sensitive search , 1996, VRST.

[116]  Lale Akarun,et al.  Hierarchically constrained 3D hand pose estimation using regression forests from single frame depth data , 2014, Pattern Recognit. Lett..

[117]  Nicolas Pugeault,et al.  Sign Spotting Using Hierarchical Sequential Patterns with Temporal Intervals , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[118]  Clément Chatelain,et al.  Gesture sequence recognition with one shot learned CRF/HMM hybrid model , 2017, Image Vis. Comput..

[119]  N Gamage,et al.  Towards real-time sign language analysis via markerless gesture tracking , 2009, 2009 IEEE Instrumentation and Measurement Technology Conference.

[120]  Fei Yang,et al.  Recognition of Nonmanual Markers in American Sign Language (ASL) Using Non-Parametric Adaptive 2D-3D Face Tracking , 2012, LREC.

[121]  R. Elakkiya,et al.  Extricating Manual and Non-Manual Features for Subunit Level Medical Sign Modelling in Automatic Sign Language Classification and Recognition , 2017, Journal of Medical Systems.

[122]  Chi-Tsun Cheng,et al.  Live demonstration: A HMM-based real-time sign language recognition system with multiple depth sensors , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[123]  Massimo Piccardi,et al.  Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition , 2017, J. Biomed. Informatics.

[124]  Mariusz Oszust,et al.  Some Approaches to Recognition of Sign Language Dynamic Expressions with Kinect , 2014 .

[125]  James M. Rehg,et al.  Learning the basic units in American Sign Language using discriminative segmental feature selection , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[126]  Cristina V. Lopes,et al.  Free-hand interaction with leap motion controller for stroke rehabilitation , 2014, CHI Extended Abstracts.

[127]  Helen Cooper,et al.  University of Surrey , 2019, The Grants Register 2022.

[128]  Ankit Chaudhary,et al.  Tracking of Fingertips and Centers of Palm Using KINECT , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[129]  M. F. Tolba,et al.  Arabic sign language recognition using leap motion sensor , 2014, 2014 9th International Conference on Computer Engineering & Systems (ICCES).

[130]  Ayoub Al-Hamadi,et al.  Real-Time Capable System for Hand Gesture Recognition Using Hidden Markov Models in Stereo Color Image Sequences , 2008, J. WSCG.

[131]  Fernando De la Torre,et al.  Facial Expression Analysis , 2011, Visual Analysis of Humans.

[132]  Nicolas Pugeault,et al.  Sign Language Recognition using Sequential Pattern Trees , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[133]  George Awad,et al.  Boosted subunits: a framework for recognising sign language from videos , 2013, IET Image Process..

[134]  R. Elakkiya,et al.  An Interactive System for Sensory and Gustatory Impaired People Based On Hand Gesture Recognition , 2012 .

[135]  Kostas Karpouzis,et al.  Non-manual cues in automatic sign language recognition , 2011, PETRA '11.

[136]  Hermann Ney,et al.  Efficient approximations to model-based joint tracking and recognition of continuous sign language , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[137]  Dimitris N. Metaxas,et al.  Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[138]  Ayoub Al-Hamadi,et al.  A Hidden Markov Model-Based Isolated and Meaningful Hand Gesture Recognition , 2008 .

[139]  Nicolas Pugeault,et al.  Spelling it out: Real-time ASL fingerspelling recognition , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[140]  R. Elakkiya,et al.  Enhanced dynamic programming approach for subunit modelling to handle segmentation and recognition ambiguities in sign language , 2018, J. Parallel Distributed Comput..

[141]  Alfredo Gardel Vicente,et al.  Unsupervised and adaptive Gaussian skin-color model , 2000, Image Vis. Comput..

[142]  Lale Akarun,et al.  Hand Pose Estimation and Hand Shape Classification Using Multi-layered Randomized Decision Forests , 2012, ECCV.

[143]  Karl-Friedrich Kraiss,et al.  Towards an Automatic Sign Language Recognition System Using Subunits , 2001, Gesture Workshop.

[144]  Marcel J. T. Reinders,et al.  Sign Language Recognition by Combining Statistical DTW and Independent Classification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[145]  Jake Araullo,et al.  The Leap Motion controller: a view on sign language , 2013, OZCHI.

[146]  Stan Sclaroff,et al.  Challenges in development of the American Sign Language Lexicon Video Dataset (ASLLVD) corpus , 2012 .

[147]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[148]  Liya Ding,et al.  Recovering the linguistic components of the manual signs in American Sign Language , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[149]  W. Stokoe.  Sign language structure: an outline of the visual communication systems of the American deaf. 1960. , 1961, Journal of deaf studies and deaf education.

[150]  Omar M. Al-Jarrah,et al.  Recognition of dynamic gestures in arabic sign language using two stages hierarchical scheme , 2010, Int. J. Knowl. Based Intell. Eng. Syst..

[151]  Yi-bo Li,et al.  Real-time tracking method for moving target based on an improved Camshift algorithm , 2011, 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (MEC).

[152]  Kosin Chamnongthai,et al.  Signer-independence finger alphabet recognition using discrete wavelet transform and area level run lengths , 2016, J. Vis. Commun. Image Represent..

[153]  Petros Maragos,et al.  Hand Tracking and Affine Shape-Appearance Handshape Sub-units in Continuous Sign Language Recognition , 2010, ECCV Workshops.

[154]  Michal Kawulok.  Dynamic Skin Detection in Color Images for Sign Language Recognition , 2008, ICISP.

[155]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[156]  Thomas Burger,et al.  Sequential Belief-Based Fusion of Manual and Non-manual Information for Recognizing Isolated Signs , 2007, Gesture Workshop.

[157]  Zhongfu Ye,et al.  Continuous sign language recognition using level building based on fast hidden Markov model , 2016, Pattern Recognit. Lett..

[158]  Hermann Ney,et al.  Continuous sign language recognition: Towards large vocabulary statistical recognition systems handling multiple signers , 2015, Comput. Vis. Image Underst..

[159]  Arputharaj Kannan,et al.  Fuzzy Hand Gesture Recognition based Human Computer Interface Intelligent System , 2012 .

[160]  Mansoor Sarhadi,et al.  A non-linear model of shape and motion for tracking finger spelt American sign language , 2002, Image Vis. Comput..

[161]  Aboul Ella Hassanien,et al.  SIFT-Based Arabic Sign Language Recognition System , 2014, AECIA.

[162]  Toshiaki Ejima,et al.  Hand Gesture Recognition Using Fuzzy Neural Network , 2005 .

[163]  S. Majumder,et al.  Shape, texture and local movement hand gesture features for Indian Sign Language recognition , 2011, 3rd International Conference on Trendz in Information Sciences & Computing (TISC2011).

[164]  Helge J. Ritter,et al.  Visual recognition of continuous hand postures , 2002, IEEE Trans. Neural Networks.

[165]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[166]  Sergio Escalera,et al.  Featureweighting in dynamic timewarping for gesture recognition in depth data , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[167]  Wen Gao,et al.  Large-Vocabulary Continuous Sign Language Recognition Based on Transition-Movement Models , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[168]  Karl-Friedrich Kraiss,et al.  Recent developments in visual sign language recognition , 2008, Universal Access in the Information Society.

[169]  Gregory Shakhnarovich,et al.  Lexicon-free fingerspelling recognition from video: Data, models, and signer adaptation , 2017, Comput. Speech Lang..

[170]  Tomasz Górecki,et al.  Multivariate time series classification with parametric derivative dynamic time warping , 2015, Expert Syst. Appl..

[171]  Chin-Hui Lee,et al.  Sign Transition Modeling and a Scalable Solution to Continuous Sign Language Recognition for Real-World Applications , 2016, ACM Trans. Access. Comput..

[172]  Kazuhiko Yamamoto,et al.  Focus of attention for face and hand gesture recognition using multiple cameras , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[173]  Chung-Lin Huang,et al.  A model-based hand gesture recognition system , 2001, Machine Vision and Applications.

[174]  Stan Sclaroff,et al.  Sign Language Spotting with a Threshold Model Based on Conditional Random Fields , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[175]  Carlos Sagüés,et al.  Human-Computer Interaction Based on Hand Gestures Using RGB-D Sensors , 2013, Sensors.

[176]  Nicolas D. Georganas,et al.  Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques , 2011, IEEE Transactions on Instrumentation and Measurement.

[177]  Eli Hagen,et al.  Towards an American Sign Language interface , 1994 .

[178]  Hermann Ney,et al.  Tracking using dynamic programming for appearance-based sign language recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[179]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[180]  Pooja Mittal,et al.  Developing a Gesture-based Interface , 2002 .

[181]  Vladimir Pavlovic,et al.  Multi-output Laplacian dynamic ordinal regression for facial expression recognition and intensity estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[182]  K. Raimond,et al.  Ethiopian sign language recognition using Artificial Neural Network , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[183]  Debi Prosad Dogra,et al.  A multimodal framework for sensor based sign language recognition , 2017, Neurocomputing.

[184]  Ramesh Raskar,et al.  Exploiting Depth Discontinuities for Vision-Based Fingerspelling Recognition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[185]  Michael N. Mikhael,et al.  A new approach for designing a smart glove for Arabic Sign Language Recognition system based on the statistical analysis of the Sign Language , 2017, 2017 34th National Radio Science Conference (NRSC).

[186]  Rini Akmeliawati,et al.  Dynamic approach for real-time skin detection , 2012, Journal of Real-Time Image Processing.

[187]  Kirsti Grobel,et al.  Video-Based Sign Language Recognition Using Hidden Markov Models , 1997, Gesture Workshop.

[188]  Fei-Fei Li,et al.  What, where and who? Classifying events by scene and object recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[189]  T. O. Halawani,et al.  Automation of the Arabic sign language recognition , 2004, Proceedings. 2004 International Conference on Information and Communication Technologies: From Theory to Applications, 2004..

[190]  Alex Pentland,et al.  Space-time gestures , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[191]  Mazen M. Selim,et al.  An Automatic Arabic Sign Language Recognition System (ArSLRS) , 2017, J. King Saud Univ. Comput. Inf. Sci..

[192]  Surendra Ranganath,et al.  Deciphering gestures with layered meanings and signer adaptation , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[193]  Wen Gao,et al.  Large vocabulary sign language recognition based on fuzzy decision trees , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[194]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[195]  Anant Agarwal,et al.  Sign language recognition using Microsoft Kinect , 2013, 2013 Sixth International Conference on Contemporary Computing (IC3).

[196]  Ruiduo Yang,et al.  Handling Movement Epenthesis and Hand Segmentation Ambiguities in Continuous Sign Language Recognition Using Nested Dynamic Programming , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[197]  Hui Zhang,et al.  Application of gesture recognition based on simulated annealing BP neural network , 2011, Proceedings of 2011 International Conference on Electronic & Mechanical Engineering and Information Technology.

[198]  Jingxin Hong,et al.  Moving object tracking system based on camshift and Kalman filter , 2011, 2011 International Conference on Consumer Electronics, Communications and Networks (CECNet).

[199]  Nianjun Liu,et al.  Gesture Classification Using Hidden Markov Models and Viterbi Path Counting , 2003, DICTA.

[200]  Robyn A. Owens,et al.  Australian sign language recognition , 2005, Machine Vision and Applications.

[201]  Debi Prosad Dogra,et al.  Computer-Vision-Assisted Palm Rehabilitation With Supervised Learning , 2016, IEEE Transactions on Biomedical Engineering.

[202]  Kostas Karpouzis,et al.  Non parametric, self organizing, scalable modeling of spatiotemporal inputs: The sign language paradigm , 2012, Neural Networks.

[203]  Hermann Ney,et al.  RWTH-PHOENIX-Weather: A Large Vocabulary Sign Language Recognition and Translation Corpus , 2012, LREC.

[204]  Karl-Friedrich Kraiss,et al.  Robust Person-Independent Visual Sign Language Recognition , 2005, IbPRIA.

[205]  Frederico G. Guimarães,et al.  Feature extraction in Brazilian Sign Language Recognition based on phonological structure and using RGB-D sensors , 2014, Expert Syst. Appl..

[206]  Hermann Ney,et al.  Combination of Tangent Distance and an Image Distortion Model for Appearance-Based Sign Language Recognition , 2005, DAGM-Symposium.

[207]  Luis A. Guerrero,et al.  Automatic recognition of the American sign language fingerspelling alphabet to assist people living with speech or hearing impairments , 2017, J. Ambient Intell. Humaniz. Comput..

[208]  Pavlo Molchanov,et al.  Hand gesture recognition with 3D convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[209]  Daniel Kelly,et al.  Automatic Recognition of Head Movement Gestures in Sign Language Sentences , 2009 .

[210]  Siome Goldenstein,et al.  The Best of Both Worlds: Combining 3D Deformable Models with Active Shape Models , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[211]  Riccardo Leonardi,et al.  XKin: an open source framework for hand pose and gesture recognition using kinect , 2014, The Visual Computer.

[212]  M. Shah,et al.  Object tracking: A survey , 2006, CSUR.

[213]  Janusz Konrad,et al.  A gesture-driven computer interface using Kinect , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[214]  Nicolas Pugeault,et al.  Sign language recognition using sub-units , 2012, J. Mach. Learn. Res..

[215]  Ming C. Leu,et al.  American Sign Language word recognition with a sensory glove using artificial neural networks , 2011, Eng. Appl. Artif. Intell..

[216]  Robin R. Murphy,et al.  Hand gesture recognition with depth images: A review , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[217]  Hermann Ney,et al.  Automatic Alignment of HamNoSys Subunits for Continuous Sign Language Recognition , 2016 .

[218]  Aboul Ella Hassanien,et al.  ArSLAT: Arabic Sign Language Alphabets Translator , 2010, 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM).

[219]  Hermann Ney,et al.  Speech recognition techniques for a sign language recognition system , 2007, INTERSPEECH.

[220]  Chung-Lin Huang,et al.  Sign language recognition using model-based tracking and a 3D Hopfield neural network , 1998, Machine Vision and Applications.

[221]  Timothy F. Cootes,et al.  Coupled-View Active Appearance Models , 2000, BMVC.

[222]  N. B. Ibrahim,et al.  A dynamic skin detector based on face skin tone color , 2012, 2012 8th International Conference on Informatics and Systems (INFOS).

[223]  Hongxia Chu,et al.  Object Tracking Algorithm Based on Camshift Algorithm Combinating with Difference in Frame , 2007, 2007 IEEE International Conference on Automation and Logistics.

[224]  Zhao Zheng,et al.  Head movement recognition based on LK algorithm and Gentleboost , 2011, The 7th International Conference on Networked Computing and Advanced Information Management.

[225]  Khaled Assaleh,et al.  Video-based signer-independent Arabic sign language recognition using hidden Markov models , 2009, Appl. Soft Comput..

[226]  Junwei Han,et al.  Automatic skin segmentation and tracking in sign language recognition , 2009 .