An ARM-based embedded gesture recognition system using a data glove

Gesture is a natural and intuitive mode of interpersonal communication, which can simulate language and behaviors to express certain meanings and words. In this paper, an embedded gesture recognition system has been designed and developed using a data glove. The design of a data glove is aimed at supplying a auxiliary communication tool for deaf people so that there is more social intercourse between them and the normal. The gesture recognition system which can interpret gesture to voice and text messages is mainly composed of four parts: a data glove, an ARM processor, a display module and an audio module. The data glove comprises five unidirectional bend sensors (FLX-03) and a 3-axis accelerometer. The ARM processor receives the data that is transmitted from the sensors of a data glove through I/O ports. And it also analyzes and calculations the data from distinct gestures, then compares the data with the templates to see if the gestures match. The recognition results are displayed on an LCD screen, and the converted voice is outputted through an external speaker. Combined with the hardware, this paper focuses on the template matching algorithm, including data collection, mining and processing. The experimental results show that the recognition accuracy rate of trained gestures is above 91%.

[1]  JunJie Zhang,et al.  Research of Mechanical Arm Control Based on Data Glove , 2008, 2008 International Symposium on Information Science and Engineering.

[2]  Tianmiao Wang,et al.  Design of Data Glove and Arm Type Haptic Interface , 2003, HAPTICS.

[3]  Geoffrey E. Hinton,et al.  Glove-Talk: a neural network interface between a data-glove and a speech synthesizer , 1993, IEEE Trans. Neural Networks.

[4]  Wang Tianmiao,et al.  Design of data glove and arm type haptic interface , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[5]  Yi Zhang,et al.  The Implemented of Information Accessibility Human-Robot Interaction System Based on Data-Glove , 2011 .

[6]  Michael H. F. Wilkinson,et al.  Systems and Informatics (ICSAI), 2012 International Conference on , 2012, ICONS 2012.

[7]  Chin-Shyurng Fahn,et al.  Development of a data glove with reducing sensors based on magnetic induction , 2005, IEEE Transactions on Industrial Electronics.

[8]  Sung-Bae Cho,et al.  Adaptive mixture-of-experts models for data glove interface with multiple users , 2012, Expert Syst. Appl..

[9]  Zongji Li,et al.  Research of using data glove in virtual assembly environment , 2002, Other Conferences.

[10]  Kiyoshi Hoshino.  Dexterous Robot Hand Control with Data Glove by Human Imitation , 2006, IEICE Trans. Inf. Syst..

[11]  Kwang-Seok Hong,et al.  An implementation of an FPGA-based embedded gesture recognizer using a data glove , 2008, ICUIMC '08.

[12]  Nidal S. Kamel,et al.  Signature verification using data glove with prominent sensors , 2009, 2009 Innovative Technologies in Intelligent Systems and Industrial Applications.

[13]  John N. Lygouras,et al.  Data glove with a force sensor , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[14]  Bingen Yang,et al.  Data-glove-based fuzzy control of piezoelectric forceps actuator , 2004, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[15]  H. Teleb,et al.  Data glove integration with 3D virtual environments , 2012, 2012 International Conference on Systems and Informatics (ICSAI2012).

[16]  Lei Yong.  Chinese Finger Alphabet Flow Recognition System Based on Data Glove , 2011 .

[17]  Piyush Kumar,et al.  Hand data glove: A new generation real-time mouse for Human-Computer Interaction , 2012, 2012 1st International Conference on Recent Advances in Information Technology (RAIT).

[18]  Youngmo Han.  A low-cost visual motion data glove as an input device to interpret human hand gestures , 2010, IEEE Transactions on Consumer Electronics.

[19]  Tae-Seong Kim,et al.  3-D hand motion tracking and gesture recognition using a data glove , 2009, 2009 IEEE International Symposium on Industrial Electronics.