A haptic multimedia handwriting learning system

In this paper, we describe a multimedia system for learning handwriting and pronunciation of alphabet letters or characters in different languages. This system provides haptic, audio and visual information according to the desired letter or character chosen by a user. Letters or characters from the Arabic, English, French, Japanese, and Spanish languages have been considered, although the system utilizes an XML-based schema to easily introduce new characters from another language. Three different modes of learning can be chosen in terms of haptic information: full guidance, partial guidance and a no guidance mode (no haptic feedback). The full guidance guides the user to follow a pre-recorded letter trajectory; whereas in partial guidance, a user can freely follow a letter-drawing path, but if the user deviates significantly, the system automatically brings him/her back to the optimal displayed path. The no guidance mode allows users to perform letter handwriting with only visual information. This system guides users to write a character, in a similar way as a teacher holds a student.s hand. Moreover, the character trajectory is displayed as the user is performing it. The results of this system evaluation show its potential as a virtual tool for learning handwriting.

[1]  Larry L. Peterson,et al.  Reasoning about naming systems , 1993, TOPL.

[2]  Tsuneo Yoshikawa,et al.  Virtual lesson and its application to virtual calligraphy system , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[3]  Etienne Burdet,et al.  A robotic teacher of Chinese handwriting , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[4]  S. Rosenblum,et al.  Product and Process Evaluation of Handwriting Difficulties , 2003 .

[5]  E. Gentaz,et al.  The visuo-haptic and haptic exploration of letters increases the kindergarten-children's reading acquisition , 2004 .

[6]  A. Kheddar,et al.  An adaptive haptic guidance software module for I-TOUCH: example through a handwriting teaching simulation and a 3D maze , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[7]  A. El Saddik,et al.  MPEG-7 Description of Haptic Applications Using HAML , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).

[8]  Florence Bara,et al.  A Visuo-Haptic Device - Telemaque - Increases Kindergarten Children's Handwriting Acquisition , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).