RoboGraphics: Dynamic Tactile Graphics Powered by Mobile Robots

Tactile graphics are a common way to present information to people with vision impairments. Tactile graphics can be used to explore a broad range of static visual content but aren't well suited to representing animation or interactivity. We introduce a new approach to creating dynamic tactile graphics that combines a touch screen tablet, static tactile overlays, and small mobile robots. We introduce a prototype system called RoboGraphics and several proof-of-concept applications. We evaluated our prototype with seven participants with varying levels of vision, comparing the RoboGraphics approach to a flat screen, audio-tactile interface. Our results show that dynamic tactile graphics can help visually impaired participants explore data quickly and accurately.

[1]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[2]  Bruce N. Walker,et al.  Solar System Sonification: Exploring Earth and its Neighbors Through Sound , 2017 .

[3]  Lei Shi,et al.  Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations , 2017, UIST.

[4]  Meredith Ringel Morris,et al.  Touchplates: low-cost tactile overlays for visually impaired touch screen users , 2013, ASSETS.

[5]  Aluna Everitt,et al.  PolySurface: A Design Approach for Rapid Prototyping of Shape-Changing Displays Using Semi-Solid Surfaces , 2017, Conference on Designing Interactive Systems.

[6]  Richard E. Ladner,et al.  Tactile Graphics with a Voice , 2016, ACM Trans. Access. Comput..

[7]  M. Sheelagh T. Carpendale,et al.  The Haptic Tabletop Puck: tactile feedback for interactive tabletops , 2009, ITS '09.

[8]  Lawrence H. Kim,et al.  SwarmHaptics: Haptic Display with Swarm Robots , 2019, CHI.

[9]  Sean Follmer,et al.  Visuo-Haptic Illusions for Improving the Perceived Performance of Shape Displays , 2018, CHI.

[10]  Marcos Serrano,et al.  Tangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users , 2016, CHI.

[11]  Stephen A. Brewster,et al.  Feeling what you hear: tactile feedback for navigation of audio graphs , 2006, CHI.

[12]  Mark D. Gross,et al.  FluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markers , 2017, ASSETS.

[13]  Darren Guinness,et al.  GUI Robots: Using Off-the-Shelf Robots as Tangible Input and Output Devices for Unmodified GUI Applications , 2017, Conference on Designing Interactive Systems.

[14]  Aesop,et al.  The fables of Aesop , 1890 .

[15]  Frédéric Valentin,et al.  MapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments , 2016, CHI.

[16]  Stephen A. Brewster,et al.  Comparing two haptic interfaces for multimodal graph rendering , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[17]  Richard E. Ladner,et al.  Access overlays: improving non-visual access to large touch screens for blind users , 2011, UIST.

[18]  Darren Guinness,et al.  The Haptic Video Player: Using Mobile Robots to Create Tangible Video Annotations , 2018, ISS.

[19]  Wafa Johal,et al.  Cellulo: Versatile Handheld Robots for Education , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[20]  Tom Yeh,et al.  3D printed tactile picture books for children with visual impairments: a design probe , 2014, IDC.

[21]  Lawrence H. Kim,et al.  UbiSwarm: Ubiquitous Robotic Interfaces and Investigation of Abstract Motion as a Display , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[22]  Pierre Dragicevic,et al.  Zooids: Building Blocks for Swarm User Interfaces , 2016, UIST.