Cued speech hand shape recognition - belief functions as a formalism to fuse svms and expert systems

As part of our work on hand gesture interpretation, we present our results on hand shape recognition. Our method is based on attribute extraction and multiple binary SVM classification. The novelty lies in the fashion the fusion of all the partial classification results are performed. This fusion is (1) more efficient in terms of information theory and leads to more accurate result, (2) general enough to allow other source of information to be taken into account: Each SVM output is transformed to a belief function, and all the corresponding functions are fused together with some other external evidential sources of information.

[1]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  T. Denœux.  Modeling vague beliefs using fuzzy-valued belief structures , 2000 .

[3]  Konstantinos G. P. Derpanis,et al.  A Review of Vision-Based Hand Gestures , 2004 .

[4]  Ying Wu,et al.  Hand modeling, analysis and recognition , 2001, IEEE Signal Process. Mag..

[5]  D. Buttle.  Joint structure and function. , 1970, Arthritis and rheumatism.

[6]  Christine Fernandez-Maloigne,et al.  Evidential segmentation scheme of multi-echo MR images for the detection of brain tumors using neighborhood information , 2004, Inf. Fusion.

[7]  Thomas Burger,et al.  Modeling Hesitation and Conflict: A Belief-Based Approach for Multi-class Problems , 2006, 2006 5th International Conference on Machine Learning and Applications (ICMLA'06).

[8]  Guojun Lu,et al.  Evaluation of MPEG-7 shape descriptors against other shape descriptors , 2003, Multimedia Systems.

[9]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[10]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Sotiris Malassiotis,et al.  Comparison of 2D and 3D Analysis For Automated Cued Speech Gesture Recognition , 2004 .

[12]  Thierry Denoeux,et al.  Modeling vague beliefs using fuzzy-valued belief structures , 2000, Fuzzy Sets Syst..

[13]  Ying Wu,et al.  For Vision-Based Human Computer Interaction , 2001 .

[14]  Lale Akarun,et al.  Sign Language Tutoring tool , 2005, 2005 13th European Signal Processing Conference.

[15]  Alessandro Saffiotti,et al.  The Transferable Belief Model , 1991, ECSQARU.

[16]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[17]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[18]  Thierry Denoeux,et al.  Pairwise classifier combination using belief functions , 2007, Pattern Recognit. Lett..