Motion Sensitive Glove-Based Korean Fingerspelling Tutor

Korean fingerspelling serves as a more cost effective approach in designing data glove for fingerspelling recognition purpose. This motivates us to develop a system that provides learners with a self learning module and has their own personal tutor - data glove. Therefore, in this paper, we introduce a motion sensitive glove-based Korean Fingerspelling Tutor (KFT) using our invented data glove. The data glove only needs 2 tilt sensors, 5 flex sensors and 3 pressure sensors in order to support motion sensitive glove-based KFT at a reasonable cost. This system achieves an average of accuracy above 80% for the 24 letters of Korean fingerspelling. The KFT contains three learning modules: letters, words, and short sentences, and a fingerspelling game, that both offers effective learning environment and hands-on practice experiences to the learner. This system provides a tremendously fast and effective learning process of Korean fingerspelling throughout the personal tutor - data glove.

[1]  Han Young-Hwan Implementation of Real-time Recognition System for Korean Sign Language , 2005 .

[2]  Zeungnam Bien,et al.  Real-time recognition system of Korean sign language based on elementary components , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[3]  Jose L. Hernandez-Rebollar Gesture-driven American sign language phraselator , 2005, ICMI '05.

[4]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[5]  Se-Jin Jang,et al.  Sign-Language Recognition using the Information of Hand Shape and Moving Direction , 1999 .

[6]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Ming C. Leu,et al.  Recognition of Finger Spelling of American Sign Language with Artificial Neural Network Using Position/Orientation Sensors and Data Glove , 2005, ISNN.

[8]  Wen Gao,et al.  HandTalker II: a Chinese sign language recognition and synthesis system , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[9]  John N. Lygouras,et al.  Data glove with a force sensor , 2003, IEEE Trans. Instrum. Meas..

[10]  Risto Miikkulainen,et al.  Incremental Evolution of Complex General Behavior , 1997, Adapt. Behav..

[11]  Honggang Wang,et al.  American Sign Language Recognition Using Multi-dimensional Hidden Markov Models , 2006, J. Inf. Sci. Eng..

[12]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[13]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[14]  Anna Kucerová,et al.  Improvements of real coded genetic algorithms based on differential operators preventing premature convergence , 2004, ArXiv.

[15]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.