Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback

Three novel interaction methods were designed for reading six-dot Braille characters from the touchscreen of a mobile device. A prototype device with a piezoelectric actuator embedded under the touchscreen was used to create tactile feedback. The three interaction methods, scan, sweep, and rhythm, enabled users to read Braille characters one at a time either by exploring the characters dot by dot or by sensing a rhythmic pattern presented on the screen. The methods were tested with five blind Braille readers as a proof of concept. The results of the first experiment showed that all three methods can be used to convey information as the participants could accurately (91-97 percent) recognize individual characters. In the second experiment the presentation rate of the most efficient and preferred method, the rhythm, was varied. A mean recognition accuracy of 70 percent was found when the speed of presenting a single character was nearly doubled from the first experiment. The results showed that temporal tactile feedback and Braille coding can be used to transmit single-character information while further studies are still needed to evaluate the presentation of serial information, i.e., multiple Braille characters.

[1]  Hong Z. Tan,et al.  Information transmission with a multi-finger tactual display , 1997, Scandinavian audiology. Supplementum.

[2]  Pauli Laitinen,et al.  Designing Haptic Feedback for Touch Display: Experimental Study of Perceived Intensity and Integration of Haptic and Audio , 2006, HAID.

[3]  Alexander H. Waibel,et al.  Multimodal interfaces , 1996, Artificial Intelligence Review.

[4]  Vincent Hayward,et al.  A role for haptics in mobile interaction: initial design using a handheld tactile display prototype , 2006, CHI.

[5]  Vincent Hayward,et al.  Braille Display by Lateral Skin Deformation with the STReSS2 Tactile Transducer , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[6]  Vincent Hayward,et al.  Display of virtual braille dots by lateral skin deformation: feasibility study , 2005, TAP.

[7]  Shun Ishizaki,et al.  English "Oblique" Listening System - Rapid Listening System for the Blind and Visually Impaired, and Its Evaluation , 2006, ICCHP.

[8]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[9]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[10]  Gordon E. Legge,et al.  Measuring Braille reading speed with the MNREAD test , 1999 .

[11]  Toshiaki Sugimura,et al.  Active click: tactile feedback for touch panels , 2001, CHI Extended Abstracts.

[12]  W. M. Rabinowitz,et al.  Information transmission with a multifinger tactual display , 1999, Perception & psychophysics.

[13]  Ivan Poupyrev,et al.  Tactile interfaces for small touch screens , 2003, UIST '03.

[14]  Christophe Ramstein,et al.  Combining haptic and braille technologies: design issues and pilot study , 1996, Assets '96.

[15]  Vincent Hayward,et al.  Haptically Enabled Handheld Information Display With Distributed Tactile Transducer , 2007, IEEE Transactions on Multimedia.

[16]  A. Pisano,et al.  Modeling and optimal design of piezoelectric cantilever microactuators , 1997 .

[17]  John W. Roberts,et al.  49.2: Rotating‐Wheel Braille Display for Continuous Refreshable Braille , 2000 .

[18]  Braille , 1992 .

[19]  Roope Raisamo,et al.  Crossmodal Rhythm Perception , 2008, HAID.

[20]  P. Laitinen,et al.  Enabling mobile haptic design: piezoelectric actuator technology properties in hand held devices , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).

[21]  S. Millar Understanding and Representing Space: Theory and Evidence from Studies with Blind and Sighted Children , 1994 .

[22]  Karon E. MacLean,et al.  Evaluation of haptically augmented touchscreen gui elements under cognitive load , 2007, ICMI '07.