A Topological derivative based image segmentation for sign language recognition system using isotropic filter

The need of sign language is increasing radically especially to hearing impaired community. Only few research groups try to automatically recognize sign language from video, colored gloves and etc. Their approach requires a valid segmentation of the data that is used for training and of the data that is used to be recognized. Recognition of a sign language image sequence is challenging because of the variety of hand shapes and hand motions. Here, this paper proposes to apply a combination of image segmentation with restoration using topological derivatives for achieving high recognition accuracy. Image quality measures are conceded here to differentiate the methods both subjectively as well as objectively. Experiments show that the additional use of the restoration before segmenting the postures significantly improves the correct rate of hand detection, and that the discrete derivatives yields a high rate of discrimination between different static hand postures as well as between hand postures and the scene background. Eventually, the research is to contribute to the implementation of automated sign language recognition system mainly established for the welfare purpose.

[1]  I. Larrabide,et al.  An Image Segmentation Method Based on a Discrete Version of the Topological Derivative , 2005 .

[2]  Thomas S. Huang,et al.  Vision based hand modeling and tracking for virtual teleconferencing and telecollaboration , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Yoshiaki Shirai,et al.  Hand shape estimation under complex backgrounds for sign language recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[4]  Mubarak Shah,et al.  Visual gesture recognition , 1994 .

[5]  Bernhard Preim,et al.  Mathematical Methods in Medical Imaging: Analysis of Vascular Structures for Liver Surgery Planning , 2001 .

[6]  R. Wilson,et al.  Anisotropic Nonstationary Image Estimation and Its Applications: Part I - Restoration of Noisy Images , 1983, IEEE Transactions on Communications.

[7]  Takeo Kanade,et al.  DigitEyes: Vision-Based Human Hand Tracking , 1993 .

[8]  Helge J. Ritter,et al.  Detection of Fingertips in Human Hand Movement Sequences , 1997, Gesture Workshop.

[9]  Yoshiaki Shirai,et al.  Extraction of Hand Features for Recognition of Sign Language Words , 2002 .

[10]  Hermann Hienz,et al.  Relevant features for video-based continuous sign language recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[11]  Masmoudi,et al.  Image restoration and classification by topological asymptotic expansion , 2006 .

[12]  M. Strintzis,et al.  Still Image Objective Segmentation Evaluation using Ground Truth , 2003 .

[13]  Ignacio Larrabide,et al.  A MEDICAL IMAGE ENHANCEMENT ALGORITHM BASED ON TOPOLOGICAL DERIVATIVE AND ANISOTROPIC DIFFUSION , 2005 .

[14]  H. Knutsson,et al.  Detection of neural activity in functional MRI using canonical correlation analysis , 2001, Magnetic resonance in medicine.

[15]  Ahmet B. Orun,et al.  Automated identification of man-made textural features on satellite imagery by Bayesian networks , 2004 .

[16]  Edgar Arce Santana,et al.  Hidden Markov Measure Field Models for Image Segmentation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..