On the use of graph parsing for recognition of isolated hand postures of Polish Sign Language

A novel method of recognition of hand postures of Polish Sign Language (PSL) is presented in the paper. The method is based on a syntactic pattern recognition paradigm. A construction of algorithms for generating a structural (graph) description of hand postures that can be analyzed with the ETPL(k) graph grammar parsing model has been a main objective of the research. A structural description generated with these algorithms is unique and unambiguous that results in good discriminative properties of the method.

[1]  William K. Pratt,et al.  Digital Image Processing: PIKS Inside , 2001 .

[2]  King-Sun Fu,et al.  Syntactic Pattern Recognition And Applications , 1968 .

[3]  Baozong Yuan,et al.  A novel approach for human face detection from color images under complex background , 2001, Pattern Recognit..

[4]  Horst Bunke.  Programmed Graph Grammars , 1978, Graph-Grammars and Their Application to Computer Science and Biology.

[5]  Ipke Wachsmuth,et al.  Interpretation of Shape-Related Iconic Gestures in Virtual Environments , 2001, Gesture Workshop.

[6]  Mariusz Flasiński.  Parsing of edNLC-graph grammars for scene analysis , 1988, Pattern Recognit..

[7]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[8]  Mariusz Flasinski.  Power Properties of NLC Graph Grammars with a Polynomial Membership Problem , 1998, Theor. Comput. Sci..

[9]  Marc Erich Latoschik,et al.  Processing Iconic Gestures in a Multimodal Virtual Construction Environment , 2007, Gesture Workshop.

[10]  Narendra Ahuja,et al.  Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Mariusz Flasinski,et al.  Dynamically programmed automata for quasi context sensitive languages as a tool for inference support in pattern recognition-based real-time control expert systems , 1999, Pattern Recognit..

[12]  Jochen Triesch,et al.  Robust classification of hand postures against complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  Mariusz Flasinski.  On the parsing of deterministic graph languages for syntactic pattern recognition , 1993, Pattern Recognit..

[14]  Y. V. Venkatesh,et al.  Understanding gestures with systematic variations in movement dynamics , 2006, Pattern Recognit..

[15]  Mariusz Flasinski,et al.  Inference of Parsable Graph Grammars for Syntactic Pattern Recognition , 2007, Fundam. Informaticae.

[16]  Stefan Kopp,et al.  Imitation Games with an Artificial Agent: From Mimicking to Understanding Shape-Related Iconic Gestures , 2003, Gesture Workshop.

[17]  Horst Bunke.  Attributed Programmed Graph Grammars and Their Application to Schematic Diagram Interpretation , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Grzegorz Rozenberg,et al.  On sequential and parallel node-rewriting graph grammars , 1982, Comput. Graph. Image Process..

[19]  Salvatore Gaglio,et al.  A Framework for Sign Language Sentence Recognition by Commonsense Context , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Robert Schaefer,et al.  Optimal Stochastic Scaling for CAE Parallel Computations , 1998, Rough Sets and Current Trends in Computing.

[21]  Grzegorz Rozenberg,et al.  Graph grammars with node-label controlled rewriting and embedding , 1982, Graph-Grammars and Their Application to Computer Science.

[22]  Robert S. Ledley,et al.  Programming and Utilizing Digital Computers , 1962 .

[23]  Tony Lindeberg,et al.  Detecting salient blob-like image structures and their scales with a scale-space primal sketch: A method for focus-of-attention , 1993, International Journal of Computer Vision.

[24]  Tamer Shanableh,et al.  Spatio-Temporal Feature-Extraction Techniques for Isolated Gesture Recognition in Arabic Sign Language , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Robyn A. Owens,et al.  Australian sign language recognition , 2005, Machine Vision and Applications.

[26]  Jochen Triesch,et al.  Classification of hand postures against complex backgrounds using elastic graph matching , 2002, Image Vis. Comput..

[27]  Richard Edwin Stearns,et al.  Syntax-Directed Transduction , 1966, JACM.

[28]  D H Ubelaker,et al.  Sex estimation from the metatarsals. , 1997, Journal of forensic sciences.

[29]  Lale Akarun,et al.  A belief-based sequential fusion approach for fusing manual signs and non-manual signals , 2009, Pattern Recognit..

[30]  Mariusz Flasinski.  Use of graph grammars for the description of mechanical parts , 1995, Comput. Aided Des..

[31]  Shinichi Tamura,et al.  Recognition of sign language motion images , 1988, Pattern Recognit..

[32]  Marcel J. T. Reinders,et al.  Sign Language Recognition by Combining Statistical DTW and Independent Classification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Wen Gao,et al.  A Chinese sign language recognition system based on SOFM/SRN/HMM , 2004, Pattern Recognit..

[34]  Ruiduo Yang,et al.  Coupled grouping and matching for sign and gesture recognition , 2009, Comput. Vis. Image Underst..

[35]  Leszek Kotulski,et al.  On the Use of Graph Grammers for the Control of a Distributed Software Allocation , 1992, Comput. J..

[36]  Jian-Gang Wang,et al.  Frontal-view face detection and facial feature extraction using color and morphological operations , 1999, Pattern Recognit. Lett..

[37]  Arthur C. Sanderson,et al.  Multiple Resolution Representation and Probabilistic Matching of 2-D Gray-Scale Shape , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  David Windridge,et al.  A Linguistic Feature Vector for the Visual Interpretation of Sign Language , 2004, ECCV.

[39]  Ali Shokoufandeh,et al.  View-based object recognition using saliency maps , 1999, Image Vis. Comput..

[40]  Surendra Ranganath,et al.  Signing Exact English (SEE): Modeling and recognition , 2008, Pattern Recognit..

[41]  Grzegorz Rozenberg,et al.  On the structure of node-label-controlled graph languages , 1980, Inf. Sci..

[42]  Hermann Ney,et al.  Gesture Recognition Using Image Comparison Methods , 2005, Gesture Workshop.

[43]  Björn W. Schuller,et al.  A real-time system for hand gesture controlled operation of in-car devices , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[44]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Yuntao Cui,et al.  Appearance-Based Hand Sign Recognition from Intensity Image Sequences , 2000, Comput. Vis. Image Underst..

[46]  M. Fatih Demirci,et al.  The representation and matching of categorical shape , 2006, Comput. Vis. Image Underst..

[47]  Daniel J. Rosenkrantz,et al.  Properties of deterministic top down grammars , 1969, STOC.

[48]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[49]  Mariusz Flasinski.  Distorted pattern analysis with the help of node label controlled graph languages , 1990, Pattern Recognit..

[50]  Karl-Friedrich Kraiss,et al.  Video-based sign recognition using self-organizing subunits , 2002, Object recognition supported by user interaction for service robots.

[51]  George Awad,et al.  Modelling and segmenting subunits for sign language recognition based on hand motion analysis , 2009, Pattern Recognit. Lett..

[52]  Omar M. Al-Jarrah,et al.  Recognition of gestures in Arabic sign language using neuro-fuzzy systems , 2001, Artif. Intell..

[53]  Mariusz Flasiński.  SOME NOTES ON A PROBLEM OF CONSTRUCTING THE BEST MATCHED GRAPH , 1991 .

[54]  Gerhard Rigoll,et al.  Static and Dynamic Hand-Gesture Recognition for Augmented Reality Applications , 2007, HCI.

[55]  Stan Sclaroff,et al.  Sign Language Spotting with a Threshold Model Based on Conditional Random Fields , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Mariusz Flasiński.  Characteristics of edNLC-graph grammar for syntactic pattern recognition , 1989, Comput. Vis. Graph. Image Process..

[57]  Yoshisuke Kurozumi,et al.  Polygonal approximation by the minimax method , 1982, Computer Graphics and Image Processing.

[58]  Mariusz Flasinski.  Automata-Based Multi-agent Model as a Tool for Constructing Real-Time Intelligent Control Systems , 2001, CEEMAS.

[59]  Z. Zenn Bien,et al.  A dynamic gesture recognition system for the Korean sign language (KSL) , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[60]  Lars Bretzner,et al.  Qualitative Multi-scale Feature Hierarchies for Object Tracking , 1999, Scale-Space.

[61]  Eiichi Tanaka,et al.  Theoretical aspects of syntactic pattern recognition , 1995, Pattern Recognit..

[62]  John K. Tsotsos,et al.  Definition and recovery of kinematic features for recognition of American sign language movements , 2008, Image Vis. Comput..

[63]  Jochen Triesch,et al.  A System for Person-Independent Hand Posture Recognition against Complex Backgrounds , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  Ipke Wachsmuth,et al.  Gesture Recognition of the Upper Limbs - From Signal to Symbol , 1997, Gesture Workshop.

[65]  Dimitris N. Metaxas,et al.  A Framework for Recognizing the Simultaneous Aspects of American Sign Language , 2001, Comput. Vis. Image Underst..