BotMap

The development of novel shape-changing or actuated tabletop tangible interfaces opens new perspectives for the design of physical and dynamic maps, especially for visually impaired (VI) users. Such maps would allow non-visual haptic exploration with advanced functions, such as panning and zooming. In this study, we designed an actuated tangible tabletop interface, called BotMap, allowing the exploration of geographic data through non-visual panning and zooming. In BotMap, small robots represent landmarks and move to their correct position whenever the map is refreshed. Users can interact with the robots to retrieve the names of the landmarks they represent. We designed two interfaces, named Keyboard and Sliders, which enable users to pan and zoom. Two evaluations were conducted with, respectively, ten blindfolded and eight VI participants. Results show that both interfaces were usable, with a slight advantage for the Keyboard interface in terms of navigation performance and map comprehension, and that, even when many panning and zooming operations were required, VI participants were able to understand the maps. Most participants managed to accurately reconstruct maps after exploration. Finally, we observed three VI people using the system and performing a classical task consisting in finding the more appropriate itinerary for a journey.

[1]  Lars Erik Holmquist,et al.  Token-Based Acces to Digital Information , 1999, HUC.

[2]  Kasper Hornbæk,et al.  Tangible bots: interaction with active tangibles in tabletop interfaces , 2011, CHI.

[3]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[4]  Ina Wagner,et al.  The ColorTable: a design story , 2008, TEI.

[5]  James A. Landay,et al.  Sketching images eyes-free: a grid-based dynamic drawing tool for the blind , 2002, Assets '02.

[6]  Jan Zibuschka,et al.  MT4j - A Cross-platform Multi-touch Development Framework , 2010, ArXiv.

[7]  Roman Rädle,et al.  The effect of egocentric body movements on users' navigation performance and spatial memory in zoomable user interfaces , 2013, ITS.

[8]  André L. M. Santos,et al.  Improving Smartphone Accessibility with Personalizable Static Overlays , 2017, ASSETS.

[9]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[10]  Yves Guiard,et al.  Target acquisition in multiscale electronic worlds , 2004, Int. J. Hum. Comput. Stud..

[11]  M. Blades,et al.  Teaching Visually Impaired Children to Make Distance Judgments from a Tactile Map , 1997 .

[12]  Wafa Johal,et al.  Cellulo: Versatile Handheld Robots for Education , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[13]  Marcos Serrano,et al.  From tactile to virtual: using a smartwatch to improve spatial map exploration for visually impaired users , 2016, MobileHCI.

[14]  Gian Antonio Pangaro,et al.  The actuated Workbench : 2D actuation in tabletop tangible interfaces , 2003 .

[15]  Alistair A. Young,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2017, MICCAI 2017.

[16]  Marcos Serrano,et al.  Tangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users , 2016, CHI.

[17]  Ulrike Lucke,et al.  Pre-journey Visualization of Travel Routes for the Blind on Refreshable Interactive Tactile Displays , 2014, ICCHP.

[18]  Jeff Sauro,et al.  Average task times in usability tests: what to report? , 2010, CHI 2010.

[19]  A. Kappers,et al.  The Influence of Picture Size on Recognition and Exploratory Behaviour in Raised-Line Drawings , 2008, Perception.

[20]  Gerhard Weber,et al.  ATMap: Annotated Tactile Maps for the Visually Impaired , 2011, COST 2102 Training School.

[21]  G. Cumming,et al.  The New Statistics , 2014, Psychological science.

[22]  Fabio De Felice,et al.  A haptic/acoustic application to allow blind the access to spatial information , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[23]  R. Klatzky,et al.  Similarity of Tactual and Visual Picture Recognition with Limited Field of View , 1991, Perception.

[24]  George W. Furnas,et al.  Critical zones in desert fog: aids to multiscale navigation , 1998, UIST '98.

[25]  Harald Reiterer,et al.  Does (multi-)touch aid users' spatial memory and navigation in 'panning' and in 'zooming & panning' UIs? , 2012, AVI.

[26]  Florence Gaunet,et al.  Early-Blind Subjects' Spatial Representation of Manipulatory Space: Exploratory Strategies and Reaction to Change , 1997, Perception.

[27]  S. Ungar,et al.  Mental Rotation of a Tactile Layout by Young Visually Impaired Children , 1995, Perception.

[28]  Catherine Plaisant,et al.  Navigation patterns & usability of zoomable user interfaces: with and without an overview , 2003, INTR.

[29]  Anke M. Brock,et al.  Accessible Interactive Maps for Visually Impaired Users , 2022, ArXiv.

[30]  Meredith Ringel Morris,et al.  Touchplates: low-cost tactile overlays for visually impaired touch screen users , 2013, ASSETS.

[31]  Olivier Chapuis,et al.  Mid-air pan-and-zoom on wall-sized displays , 2011, CHI.

[32]  Dinesh Manocha,et al.  The Hybrid Reciprocal Velocity Obstacle , 2011, IEEE Transactions on Robotics.

[33]  Catherine Plaisant,et al.  Non-visual exploration of geographic maps: Does sonification help? , 2010, Disability and rehabilitation. Assistive technology.

[34]  Saiganesh Swaminathan,et al.  Linespace: A Sensemaking Platform for the Blind , 2016, CHI.

[35]  Thomas Ertl,et al.  Making Digital Maps Accessible Using Vibrations , 2010, ICCHP.

[36]  R. Dan Jacobson Navigating maps with little or no sight: An audio-tactile approach , 1998 .

[37]  E. Berlá,et al.  Tactual Distinctive Features Analysis: Training Blind Students in Shape Recognition and in Locating Shapes On a Map , 1977 .

[38]  Pierre Dragicevic,et al.  Zooids: Building Blocks for Swarm User Interfaces , 2016, UIST.

[39]  Ben Shneiderman,et al.  Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data , 2008, TCHI.

[40]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[41]  Thomas Ertl,et al.  Interactively Displaying Maps on a Tactile Graphics Display , 2012 .

[42]  R. Klatzky,et al.  Haptic identification of objects and their depictions , 1993, Perception & psychophysics.

[43]  Stephen A. Brewster,et al.  Feeling what you hear: tactile feedback for navigation of audio graphs , 2006, CHI.

[44]  Christopher R. Bennett,et al.  Touch-screen technology for the dynamic display of -2D spatial information without vision: promise and progress. , 2014, Multisensory research.

[45]  Eckard Riedenklau,et al.  Development of actuated Tangible User Interfaces: new interaction concepts and evaluation methods , 2016 .

[46]  Hiroshi Ishii,et al.  Tangible User Interfaces (TUIs): A Novel Paradigm for GIS , 2004, Trans. GIS.

[47]  Nicholas A. Giudice,et al.  Evaluation of Non-visual Zooming Operations on Touchscreen Devices , 2016, HCI.

[48]  Nicholas A. Giudice,et al.  Representing 3D Space in Working Memory: Spatial Images from Vision, Hearing, Touch, and Language , 2013 .

[49]  Martin Pielot,et al.  TouchOver map: audio-tactile exploration of interactive maps , 2011, Mobile HCI.

[50]  Ivan Poupyrev,et al.  Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays , 2007, TEI.

[51]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[52]  Marlien Herselman,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2015 .

[53]  Kate E Decleene,et al.  Publication Manual of the American Psychological Association , 2011 .

[54]  Gunnar Jansson,et al.  Reading virtual maps with a haptic mouse: Effects of some modifications of the tactile and audio-tactile information , 2006 .

[55]  Simon Ungar,et al.  Cognitive mapping without visual experience , 2018, Cognitive Mapping.

[56]  Valerie S Morash,et al.  Effects of Using Multiple Hands and Fingers on Haptic Performance in Individuals Who are Blind , 2014, Perception.

[57]  Ravi Rastogi,et al.  Intuitive Tactile Zooming for Graphics Accessed by Individuals Who are Blind and Visually Impaired , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[58]  Jaime Sánchez,et al.  Autonomous navigation through the city for the blind , 2010, ASSETS '10.

[59]  Gordon E. Legge,et al.  Designing Media for Visually-Impaired Users of Refreshable Touch Displays: Possibilities and Pitfalls , 2015, IEEE Transactions on Haptics.

[60]  Editorial Preface to Tobler's “Bidimensional Regression” , 2010 .

[61]  Rob Kitchin,et al.  Collecting and analysing cognitive mapping data , 2018, Cognitive Mapping.

[62]  Richard E. Ladner,et al.  Access overlays: improving non-visual access to large touch screens for blind users , 2011, UIST.

[63]  B. Tversky Distortions in memory for maps , 1981, Cognitive Psychology.

[64]  Hiroshi Ishii,et al.  Mechanical constraints as computational constraints in tabletop tangible interfaces , 2007, CHI.

[65]  Stephen A. Brewster,et al.  Clutching at straws: using tangible interaction to provide non-visual access to graphs , 2010, CHI.

[66]  S Millar,et al.  Illusions in reading maps by touch: reducing distance errors. , 2001, British journal of psychology.

[67]  Helge J. Ritter,et al.  An integrated multi-modal actuated tangible user interface for distributed collaborative planning , 2012, Tangible and Embedded Interaction.

[68]  M. Gardner,et al.  Confidence intervals rather than P values: estimation rather than hypothesis testing. , 1986, British medical journal.

[69]  Anke M. Brock,et al.  Interactivity Improves Usability of Geographic Maps for Visually Impaired People , 2015, Hum. Comput. Interact..

[70]  Valérie Maquil,et al.  Towards Geospatial Tangible User Interfaces: An Observational User Study Exploring Geospatial Interactions of the Novice , 2015 .

[71]  Fritz Zobl,et al.  Accessible Web Maps for Visually Impaired Users: Recommendations and Example Solutions , 2017 .

[72]  Helge Ritter,et al.  TANGIBLE ACTIVE OBJECTS AND INTERACTIVE SONIFICATION AS A SCATTER PLOT ALTERNATIVE FOR THE VISUALLY IMPAIRED , 2010, ICAD 2010.

[73]  M. Gross,et al.  MouseHaus Table , a Physical Interface for Urban Design , 2003 .

[74]  John J. Rieser,et al.  Blindness and Brain Plasticity in Navigation and Object Perception , 2007 .

[75]  Benjamin B. Bederson The promise of zoomable user interfaces , 2010, VINCI '10.

[76]  Pierre Dragicevic,et al.  HCI Statistics without p-values , 2015 .

[77]  LazarJonathan,et al.  Data Sonification for Users with Visual Impairment , 2008 .