Haptic-enabled virtual handwriting: Multimodal handwriting instructions for young students

In this paper, we describe a multimodal system for improving a student's ability to efficiently write printed English letters. The system, overall, provide information from multiple sources by incorporating: a) a visual cue rendered on a computer screen to simulate letters, b) haptic force-feedback in the way of a virtual "physical" representation that users can trace using a PHANToM Omni haptic device, and c) auditory and visual instructions from a teacher who has experience in the difficulties that some students experience when attempting to efficiently write. Our results of user testing show that a kindergarten aged student is able to retain information and recognize the correct process for writing with little to no further instruction following the use of this system. We also use a modified version of the system to more adequately test a student who has a serious deficiency in memorization and retention ability. The student displays a far greater retention following the use of the system, to the point that the student is asked to repeat the process (with no haptic aid) the following day and shows absolutely no issue in doing so.

[1]  Zoran Duric,et al.  Poster: Teaching letter writing using a programmable haptic device interface for children with handwriting difficulties , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[2]  Florence Bara,et al.  A Visuo-Haptic Device - Telemaque - Increases Kindergarten Children's Handwriting Acquisition , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[3]  Abdulmotaleb El-Saddik,et al.  A haptic multimedia handwriting learning system , 2007, Emme '07.

[4]  Beryl Plimmer,et al.  A collaborative multimodal handwriting training environment for visually impaired students , 2008, OZCHI '08.

[5]  John S. Zelek,et al.  Towards an understanding of conventional surgical haptics for use in MIS , 2007, MMVR.

[6]  J. Orliaguet,et al.  Developmental study of visual perception of handwriting movement: Influence of motor competencies? , 2008, Neuroscience Letters.

[7]  Zoran Duric,et al.  Guiding hand: a teaching tool for handwriting , 2009, ICMI-MLMI '09.

[8]  Massimo Bergamasco,et al.  Haptic desktop for assisted handwriting and drawing , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[9]  Zoran Duric,et al.  Demo: Teaching letter writing using a programmable haptic device interface for children with handwriting difficulties , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[10]  Y.K. Kim,et al.  Hand-writing Rehabilitation in the Haptic Virtual Environment , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).