Haptics Assisted Training (HAT) System for children's handwriting

We present Haptics Assisted Training (HAT) System, a force feedback workstation for transferring and improving handwriting skill. The HAT system is the first practical handwriting training system whose usability was tested both in typical and special education classrooms of a local school district. Simulating the role of occupational therapists (OT), the HAT system guides the user's hand along the sequence of strokes of the reference handwriting recorded by an expert or teacher. Since the handwriting data is formatted as a set of ordered paths, it can teach any form of pen strokes, such as words, shapes, and even drawings. Training tasks are presented as a 3D game which captures children's attention and more effective visual motor integration (VMI) is anticipated than traditional paper materials. In this paper we describe the design and implementation of the prototype. We also report a comparative study on handwriting performance of twenty participants grouped into four categories by education types (special vs. typical) and haptic devices (Phantom Omni™ vs. Novint Falcon™). As a result, we observed that the children quickly adjusted themselves to the system, and they sustained engagement at the word-writing tasks without any intervention. Results also showed improvements in tracing precision on the HAT system over time. Details of the results and lessons learned from the study are discussed.

[1]  S. Coquillart,et al.  Haptic Guidance Improves the Visuo-Manual Tracking of Trajectories , 2008, PloS one.

[2]  S. Rosenblum,et al.  Temporal measures of poor and proficient handwriters , 2004 .

[3]  Beryl Plimmer,et al.  Signing on the tactile line: A multimodal system for teaching handwriting to blind children , 2011, TCHI.

[4]  Thenkurussi Kesavadas,et al.  A Visual Haptic System for Children with Learning Disabilities: Software and Hardware Design Considerations , 2012 .

[5]  S. Graham.  Issues in Handwriting Instruction. , 1992 .

[6]  Reepa Sanghavi.  VISUAL-MOTOR INTEGRATION AND LEARNING DISABLED CHILDREN , 2006 .

[7]  Kirsten Risden,et al.  Guidelines for usability testing with children , 1997, INTR.

[8]  Zoran Duric,et al.  Demo: Teaching letter writing using a programmable haptic device interface for children with handwriting difficulties , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[9]  Thenkurussi Kesavadas,et al.  Comparative Study: Virtual Fixtures and Shared Control for Rehabilitation of Fine Motor Skills , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[10]  Feng S. Din,et al.  The Effects of Playing Educational Video Games on Kindergarten Achievement , 2001 .

[11]  Zoran Duric,et al.  Poster: Teaching letter writing using a programmable haptic device interface for children with handwriting difficulties , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[12]  J. A. Lake.  Disappearing act , 2007, Nature.

[13]  Thenkurussi Kesavadas,et al.  Modeling and defining expert handwriting behavior , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[14]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[15]  R.V. Dubey,et al.  Eye-hand coordination assessment/therapy using a robotic haptic device , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[16]  S. Calhoun,et al.  Learning, Attention, Writing, and Processing Speed in Typical Children and Children with ADHD, Autism, Anxiety, Depression, and Oppositional-Defiant Disorder , 2007, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[17]  D. Gentile,et al.  The impact of video games on training surgeons in the 21st century. , 2007, Archives of surgery.

[18]  Tsung-Yen Chuang,et al.  Effect of Computer-Based Video Games on Children: An Experimental Study , 2007, 2007 First IEEE International Workshop on Digital Game and Intelligent Toy Enhanced Learning (DIGITEL'07).

[19]  Florence Bara,et al.  A Visuo-Haptic Device - Telemaque - Increases Kindergarten Children's Handwriting Acquisition , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).