VISION BASED SIGN LANGUAGE RECOGNITION: MODELING AND RECOGNIZING ISOLATED SIGNS WITH MANUAL AND NON-MANUAL COMPONENTS

[1]  Chung-Hsien Wu,et al.  Error-Tolerant Sign Retrieval Using Visual Features and Maximum A Posteriori Estimation , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Prakash P. Shenoy,et al.  On the plausibility transformation method for translating belief function models to probability models , 2006, Int. J. Approx. Reason..

[3]  Hong Man,et al.  Face recognition based on multi-class mapping of Fisher scores , 2005, Pattern Recognit..

[4]  Lale Akarun,et al.  A belief-based sequential fusion approach for fusing manual signs and non-manual signals , 2009, Pattern Recognit..

[5]  Wen Gao,et al.  A novel approach to automatically extracting basic units from Chinese sign language , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[6]  Pietro Perona,et al.  Combining generative models and Fisher kernels for object recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Alistair D. N. Edwards.  Progress in Sign Languages Recognition , 1997, Gesture Workshop.

[8]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[9]  Milan Daniel.  Probabilistic Transformations of Belief Functions , 2005, ECSQARU.

[10]  Martha E. Tyrone.  Overview of Capture Techniques for Studying Sign Language Phonetics , 2001, Gesture Workshop.

[11]  Wen Gao,et al.  Visual Sign Language Recognition Based on HMMs and Auto-regressive HMMs , 2005, Gesture Workshop.

[12]  Cheng-Chew Lim,et al.  Segmentation of the face and hands in sign language video sequences using color and motion cues , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Antonio Torralba,et al.  An efficient neuromorphic analog network for motion estimation , 1999 .

[14]  Wen Gao,et al.  The Recognition of Finger-Spelling for Chinese Sign Language , 2001, Gesture Workshop.

[15]  Hermann Ney,et al.  Pronunciation Clustering and Modeling of Variability for Appearance-Based Sign Language Recognition , 2005, Gesture Workshop.

[16]  Koray Balci.  Xface: Open Source Toolkit for Creating 3D Faces of an Embodied Conversational Agent , 2005, Smart Graphics.

[17]  Omar M. Al-Jarrah,et al.  Recognition of gestures in Arabic sign language using neuro-fuzzy systems , 2001, Artif. Intell..

[18]  Yuntao Cui,et al.  A Learning-Based Prediction-and-Verification Segmentation Scheme for Hand Sign Image Sequence , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Richard Bowden,et al.  Large Lexicon Detection of Sign Language , 2007, ICCV-HCI.

[20]  Lale Akarun,et al.  A belief-based sequential fusion approach for fusing manual and non-manual signs , 2008 .

[21]  Michael Isard,et al.  BraMBLe: a Bayesian multiple-blob tracker , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[22]  Scott K. Liddell.  Grammar, Gesture, and Meaning in American Sign Language , 2003 .

[23]  Ying Wu,et al.  For Vision-Based Human Computer Interaction , 2001 .

[24]  Prakash P. Shenoy,et al.  Local Computation in Hypertrees , 1991 .

[25]  W. Stokoe,et al.  Sign language structure: an outline of the visual communication systems of the American deaf. 1960. , 1961, Journal of deaf studies and deaf education.

[26]  Alice Caplier,et al.  Head nods analysis: interpretation of non verbal communication gestures , 2005, IEEE International Conference on Image Processing 2005.

[27]  M. C. Jones.  Cued speech. , 1992, ASHA.

[28]  Hermann Ney,et al.  Tracking using dynamic programming for appearance-based sign language recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[29]  Andrew Zisserman,et al.  Minimal Training, Large Lexicon, Unconstrained Sign Language Recognition , 2004, BMVC.

[30]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[31]  Alessandro Saffiotti,et al.  The Transferable Belief Model , 1991, ECSQARU.

[32]  David Haussler,et al.  Using the Fisher Kernel Method to Detect Remote Protein Homologies , 1999, ISMB.

[33]  Lale Akarun,et al.  Speech and sliding text aided sign retrieval from hearing impaired sign news videos , 2007, Journal on Multimodal User Interfaces.

[34]  R.A. Foulds,et al.  Biomechanical and perceptual constraints on the bandwidth requirements of sign language , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Ying Wu,et al.  Hand modeling, analysis and recognition , 2001, IEEE Signal Process. Mag..

[36]  Alistair D. N. Edwards.  Progress in sign language recognition , 1998 .

[37]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[38]  Lale Akarun,et al.  Recognizing Two Handed Gestures with Generative, Discriminative and Ensemble Methods Via Fisher Kernels , 2006, MRCS.

[39]  Surendra Ranganath,et al.  Representations for facial expressions , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[40]  Lale Akarun,et al.  Sequential Belief-Based Fusion of Manual and Non-Manual Signs , 2007 .

[41]  Sotiris Malassiotis,et al.  Comparison of 2D and 3D Analysis For Automated Cued Speech Gesture Recognition , 2004 .

[42]  Yoshiaki Shirai,et al.  Hand shape estimation under complex backgrounds for sign language recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[43]  Francis K. H. Quek.  Eyes in the interface , 1995, Image Vis. Comput..

[44]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[45]  Mohammed Yeasin,et al.  A multiobject tracking framework for interactive multimedia applications , 2004, IEEE Transactions on Multimedia.

[46]  James Ohene-Djan,et al.  An adaptive WWW-based system to teach British sign language , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[47]  Narendra Ahuja,et al.  Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Algirdas Pakstas,et al.  MPEG-4 Facial Animation: The Standard,Implementation and Applications , 2002 .

[49]  Chin-Chen Chang,et al.  Gesture recognition approach for sign language using curvature scale space and hidden Markov model , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[50]  M. Miles,et al.  Signing in the Seraglio: Mutes, dwarfs and jestures at the Ottoman Court 1500-1700 , 2000 .

[51]  Thomas Burger,et al.  Sequential Belief-Based Fusion of Manual and Non-manual Information for Recognizing Isolated Signs , 2007, Gesture Workshop.

[52]  Dimitris N. Metaxas,et al.  Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[53]  J A Robinson,et al.  Practical low-cost visual communication using binary images for deaf sign language. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[54]  H. Man,et al.  Hybrid IMM/SVM approach for wavelet-domain probabilistic model based texture classification , 2005 .

[55]  Mark J. F. Gales,et al.  Using SVMs to classify variable length speech patterns , 2002 .

[56]  Dimitris N. Metaxas,et al.  ASL recognition based on a coupling between HMMs and 3D motion analysis , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[57]  George Awad,et al.  A Unified System for Segmentation and Tracking of Face and Hands in Sign Language Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[58]  Stan Sclaroff,et al.  Automatic detection of relevant head gestures in American Sign Language communication , 2002, Object recognition supported by user interaction for service robots.

[59]  Jürg Kohlas,et al.  Theory of evidence — A survey of its mathematical foundations, applications and computational aspects , 1994, Math. Methods Oper. Res..

[60]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[61]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[62]  Scott K. Liddell,et al.  American Sign Language: The Phonological Base , 2013 .

[63]  George Sperling,et al.  Video Transmission of American Sign Language and Finger Spelling: Present and Projected Bandwidth Requirements , 1981, IEEE Trans. Commun..

[64]  Wen Gao,et al.  A Comparison Between Etymon- and Word-Based Chinese Sign Language Recognition Systems , 2005, Gesture Workshop.

[65]  Richard Bowden,et al.  A boosted classifier tree for hand shape detection , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[66]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[67]  Mark J. F. Gales,et al.  Speech Recognition using SVMs , 2001, NIPS.

[68]  W. Stokoe.  Sign language structure: an outline of the visual communication systems of the American deaf. 1960. , 1961, Journal of deaf studies and deaf education.

[69]  Thomas Burger,et al.  Cued speech hand shape recognition - belief functions as a formalism to fuse svms and expert systems , 2007, VISAPP.

[70]  Min C. Shin,et al.  Effect of colorspace transformation, the illuminance component, and color modeling on skin detection , 2004, CVPR 2004.

[71]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[72]  Lale Akarun,et al.  Gestural Interfaces for Hearing-Impaired Communication , 2008 .

[73]  Mohammed Waleed Kadous,et al.  Machine Recognition of Auslan Signs Using PowerGloves: Towards Large-Lexicon Recognition of Sign Lan , 1996 .

[74]  Pedro J. Moreno,et al.  Using the Fisher kernel method for Web audio classification , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[75]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[76]  L. Akarun,et al.  A particle filter based algorithm for robust tracking of hands and face under occlusion , 2008, 2008 IEEE 16th Signal Processing, Communication and Applications Conference.

[77]  Yoshiaki Shirai,et al.  Real-time 3D hand posture estimation based on 2D appearance retrieval using monocular camera , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[78]  Shan Lu,et al.  Color-based hands tracking system for sign language recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[79]  David Windridge,et al.  A Linguistic Feature Vector for the Visual Interpretation of Sign Language , 2004, ECCV.

[80]  Ulrike Zeshan.  Aspects of Türk Işaret Dili (Turkish Sign Language) , 2003 .

[81]  Dimitris N. Metaxas,et al.  Handshapes and Movements: Multiple-Channel American Sign Language Recognition , 2003, Gesture Workshop.

[82]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  P. Smets.  Decision Making in a Context where Uncertainty is Represented by Belief Functions , 2002 .

[84]  Masaru Takeuchi,et al.  Methods to describe and recognize sign language based on gesture components represented by symbols and numerical values , 1998, Knowl. Based Syst..

[85]  Branko Ristic,et al.  A particle filter for joint detection and tracking of color objects , 2007, Image Vis. Comput..

[86]  Wen Gao,et al.  Signer-Independent Continuous Sign Language Recognition Based on SRN/HMM , 2001, Gesture Workshop.

[87]  Kostas Karpouzis,et al.  Educational resources and implementation of a Greek sign language synthesis architecture , 2007, Comput. Educ..

[88]  Stan Sclaroff,et al.  The American Sign Language Lexicon Video Dataset , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[89]  Lale Akarun,et al.  Multi-class classification strategies for Fisher scores of gesture and sign sequences , 2008, 2008 19th International Conference on Pattern Recognition.

[90]  Y. V. Venkatesh,et al.  Understanding gestures with systematic variations in movement dynamics , 2006, Pattern Recognit..

[91]  Thomas Burger,et al.  Modeling Hesitation and Conflict: A Belief-Based Approach for Multi-class Problems , 2006, 2006 5th International Conference on Machine Learning and Applications (ICMLA'06).

[92]  Muhammad Sarfraz,et al.  A system for sign language recognition using fuzzy object similarity tracking , 2005, Ninth International Conference on Information Visualisation (IV'05).

[93]  P. P. Shenoy,et al.  On Transforming Belief Function Models to Probability Models , 2003 .

[94]  Emilio Maggio,et al.  Hybrid particle filter and mean shift tracker with adaptive transition model , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[95]  Wen Gao,et al.  Large-Vocabulary Continuous Sign Language Recognition Based on Transition-Movement Models , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[96]  Siddika Parlak,et al.  Spoken term detection for Turkish Broadcast News , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[97]  Munib Qutaishat,et al.  American sign language (ASL) recognition based on Hough transform and neural networks , 2007, Expert Syst. Appl..

[98]  Avinash C. Kak,et al.  Purdue RVL-SLLL American Sign Language Database , 2006 .

[99]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[100]  Arthur P. Dempster,et al.  A Generalization of Bayesian Inference , 1968, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[101]  Kirsti Grobel,et al.  Automatic Estimation of Body Regions from Video Images , 1997, Gesture Workshop.

[102]  Wen Gao,et al.  A Parallel Multistream Model for Integration of Sign Language Recognition and Lip Motion , 2000, ICMI.

[103]  Tomoko Matsui,et al.  A Kernel for Time Series Based on Global Alignments , 2006, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[104]  Francis K. H. Quek,et al.  Toward a vision-based hand gesture interface , 1994 .

[105]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[106]  Dimitris N. Metaxas,et al.  Parallel hidden Markov models for American sign language recognition , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[107]  Dimitris N. Metaxas,et al.  Toward Scalability in ASL Recognition: Breaking Down Signs into Phonemes , 1999, Gesture Workshop.

[108]  Shan Lu,et al.  Recognition of local features for camera-based sign language recognition system , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[109]  Wen Gao,et al.  Large vocabulary sign language recognition based on fuzzy decision trees , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[110]  Ming Xu,et al.  A Vision-Based Method for Recognizing Non-manual Information in Japanese Sign Language , 2000, ICMI.

[111]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[112]  Wu Chou,et al.  Discriminative learning in sequential pattern recognition , 2008, IEEE Signal Processing Magazine.

[113]  Robyn A. Owens,et al.  Australian sign language recognition , 2005, Machine Vision and Applications.

[114]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[115]  D. McNeill.  Hand and Mind: What Gestures Reveal about Thought , 1992 .

[116]  Daijin Kim,et al.  Real-time multiple people tracking using competitive condensation , 2002, Object recognition supported by user interaction for service robots.

[117]  Dimitrios Tzovaras.  Multimodal user interfaces : from signals to interaction , 2008 .

[118]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[119]  Chung-Hsien Wu,et al.  Joint Optimization of Word Alignment and Epenthesis Generation for Chinese to Taiwanese Sign Synthesis , 2007 .

[120]  Nianjun Liu,et al.  Model structure selection & training algorithms for an HMM gesture recognition system , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[121]  Wen Gao,et al.  Recognition of sign language subwords based on boosted hidden Markov models , 2005, ICMI '05.

[122]  Bülent Sankur,et al.  SignTutor: An Interactive System for Sign Language Tutoring , 2009, IEEE Multimedia.

[123]  Beth Levy,et al.  Conceptual Representations in Lan-guage Activity and Gesture , 1980 .

[124]  Kirsti Grobel,et al.  Video-Based Sign Language Recognition Using Hidden Markov Models , 1997, Gesture Workshop.

[125]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .