VibHand: On-Hand Vibrotactile Interface Enhancing Non-Visual Exploration of Digital Graphics

Visual graphics are widely spread in digital media and are useful in many contexts of daily life. However, access to this type of graphical information remains a challenging task for people with visual impairments (VI). In this study, we designed and evaluated an on-hand vibrotactile interface that enables users with VI to explore digital graphics presented on tablets. We first conducted a set of exploratory tests with both people with VI and blindfolded (BF) people to investigate several design factors. We then conducted a comparative experiment to verify that on-hand vibrotactile cues (indicating direction and progression) can enhance the non-visual exploration of digital graphics. The results based on 12 participants with VI and 12 BF participants confirmed the usability of the technique and revealed that the visual status of the users does not impact graphics identification and comparison tasks.

[1]  José Pascual Molina,et al.  Identifying Virtual 3D Geometric Shapes with a Vibrotactile Glove , 2016, IEEE Computer Graphics and Applications.

[2]  Jaeha Kim,et al.  Rendering Moving Tactile Stroke on the Palm Using a Sparse 2D Array , 2016, EuroHaptics.

[3]  Jon Froehlich,et al.  Evaluating Wrist-Based Haptic Feedback for Non-Visual Target Finding and Path Tracing on a 2D Surface , 2017, ASSETS.

[4]  Diego Varotto,et al.  Memory for an imagined pathway and strategy effects in sighted and in totally congenitally blind individuals. , 2009, Acta psychologica.

[5]  Richard Chbeir,et al.  Evaluating touch-screen vibration modality for blind users to access simple shapes and graphics , 2018, Int. J. Hum. Comput. Stud..

[6]  John Zelek,et al.  Seeing by touch (haptics) for wayfinding , 2005 .

[7]  Thorsten Schwarz,et al.  Understanding what you feel: A Mobile Audio-Tactile System for Graphics Used at Schools with Students with Visual Impairment , 2020, CHI.

[8]  Nicholas A. Giudice,et al.  Learning non-visual graphical information using a touch-based vibro-audio interface , 2012, ASSETS '12.

[9]  Samuel Lebaz,et al.  Haptic Recognition of Two-Dimensional Raised-Line Patterns by Early-Blind, Late-Blind, and Blindfolded Sighted Adults , 2010, Perception.

[10]  D. S. Alles,et al.  Information Transmission by Phantom Sensations , 1970 .

[11]  Hiroshi Ishii,et al.  ComTouch: design of a vibrotactile communication device , 2002, DIS '02.

[12]  Xing-Dong Yang,et al.  EarTouch: Facilitating Smartphone Use for Visually Impaired People in Mobile and Public Scenarios , 2019, CHI.

[13]  Suranga Nanayakkara,et al.  2bit-TactileHand: Evaluating Tactons for On-Body Vibrotactile Displays on the Hand and Wrist , 2019, AH.

[14]  Lonce L. Wyse,et al.  Effect of temporality, physical activity and cognitive load on spatiotemporal vibrotactile pattern recognition , 2018, AVI.

[15]  Emeline Brulé,et al.  Review of Quantitative Empirical Evaluations of Technology for People with Visual Impairments , 2020, CHI.

[16]  Baoxin Li,et al.  Instant tactile-audio map: enabling access to digital maps for people with visual impairment , 2009, Assets '09.

[17]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[18]  M. Heller.  Picture and Pattern Perception in the Sighted and the Blind: The Advantage of the Late Blind , 1989, Perception.

[19]  Marcos Serrano,et al.  From tactile to virtual: using a smartwatch to improve spatial map exploration for visually impaired users , 2016, MobileHCI.

[20]  Nicholas A. Giudice,et al.  Design Guidelines for Schematizing and Rendering Haptically Perceivable Graphical Elements on Touchscreen Devices , 2020, Int. J. Hum. Comput. Interact..

[21]  Abigale Stangl,et al.  "Person, Shoes, Tree. Is the Person Naked?" What People with Vision Impairments Want in Image Descriptions , 2020, CHI.

[22]  James A. Landay,et al.  ActiVibe: Design and Evaluation of Vibrations for Progress Monitoring , 2016, CHI.

[23]  R. Dan Jacobson.  Navigating maps with little or no sight: An audio-tactile approach , 1998 .

[24]  Elizabeth B.-N. Sanders,et al.  From user-centered to participatory design approaches , 2002 .

[25]  Bodo Urban,et al.  Exploring vibrotactile feedback on the body and foot for the purpose of pedestrian navigation , 2015, iWOAR.

[26]  Anke M. Brock,et al.  Kin'touch: understanding how visually impaired people explore tactile maps , 2012, CHI Extended Abstracts.

[27]  Lu Zhao,et al.  Vibrotactile Wristband for Warning and Guiding in Automated Vehicles , 2019, CHI Extended Abstracts.

[28]  Christophe Jouffrais,et al.  Tactile cues for improving target localization in subjects with tunnel vision , 2015, IHM.

[29]  Martin Pielot,et al.  TouchOver map: audio-tactile exploration of interactive maps , 2011, Mobile HCI.

[30]  Marcos Serrano,et al.  Tangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users , 2016, CHI.

[31]  Anil K. Raj,et al.  Vibrotactile Displays for Improving Spatial Awareness , 2000 .

[32]  R. Sakia.  The Box-Cox transformation technique: a review , 1992 .

[33]  Anke M. Brock,et al.  Towards a Multisensory Augmented Reality Map for Blind and Low Vision People: a Participatory Design Approach , 2018, CHI.

[34]  Kim Marriott,et al.  GraVVITAS: Generic Multi-touch Presentation of Accessible Graphics , 2011, INTERACT.

[35]  Anke M. Brock,et al.  Accessible Interactive Maps for Visually Impaired Users , 2022, ArXiv.

[36]  Sethuraman Panchanathan,et al.  VibroGlove: an assistive technology aid for conveying facial expressions , 2010, CHI Extended Abstracts.

[37]  Morten Fjeld,et al.  OmniVib: Towards Cross-body Spatiotemporal Vibrotactile Notifications for Mobile Phones , 2015, CHI.