Tactile Fixations: A Behavioral Marker on How People with Visual Impairments Explore Raised-line Graphics

Raised-line graphics are tactile documents made for people with visual impairments (VI). Their exploration relies on a complex two-handed behavior. To better understand the cognitive processes underlying this exploration, we proposed a new method based on “tactile fixations”. A tactile fixation occurs when a finger is stationary within a specific spatial and temporal window. It is known that stationary fingers play an active role when exploring tactile graphics, but they have never been defined or studied before. In this study, we first defined the concept of tactile fixation, then we conducted a behavioral study with ten participants with VI in order to assess the role of tactile fixations under different conditions. The results show that tactile fixations vary according to different factors such as the graphic type as well as the involved hand and the aim of the exploration.

[1]  Kyle Montague,et al.  Blind People Interacting with Large Touch Surfaces: Strategies for One-handed and Two-handed Exploration , 2015, ITS.

[2]  Anke M. Brock,et al.  Interactivity Improves Usability of Geographic Maps for Visually Impaired People , 2015, Hum. Comput. Interact..

[3]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[4]  D. Stea.  Cognitive Maps in Rats and Men , 2017 .

[5]  Kang Chen,et al.  Visual Attention and Eye Movements , 2008 .

[6]  Fang Jiang,et al.  Feasibility of using haptic directions through maps with a tablet and smart watch for people who are blind and visually impaired , 2016, MobileHCI.

[7]  Meredith Ringel Morris,et al.  What do you see when you're surfing?: using eye tracking to predict salient regions of web pages , 2009, CHI.

[8]  Emeline Brulé,et al.  Review of Quantitative Empirical Evaluations of Technology for People with Visual Impairments , 2020, CHI.

[9]  R. Klatzky,et al.  Visual mediation and the haptic recognition of two-dimensional pictures of common objects , 1990, Perception & psychophysics.

[10]  R. Jacobson,et al.  Cognitive Mapping Without Sight: four preliminary studies of spatial learning , 1998 .

[11]  Marcos Serrano,et al.  VibHand: On-Hand Vibrotactile Interface Enhancing Non-Visual Exploration of Digital Graphics , 2020, Proc. ACM Hum. Comput. Interact..

[12]  J. M. Tellevik.  Influence of Spatial Exploration Patterns on Cognitive Mapping by Blindfolded Sighted Persons , 1992 .

[13]  David Mioduser,et al.  Haptic-feedback support for cognitive mapping of unknown spaces by people who are blind , 2008, Int. J. Hum. Comput. Stud..

[14]  R. Klatzky,et al.  Similarity of Tactual and Visual Picture Recognition with Limited Field of View , 1991, Perception.

[15]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[16]  S J Lederman,et al.  Exploring environments by hand or foot: time-based heuristics for encoding distance in movement space. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[17]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[18]  T. Martin.  American Printing House for the Blind , 2014 .

[19]  J. Rieser,et al.  How Persons with Visual Impairments Explore Novel Spaces: Strategies of Good and Poor Performers , 1993 .

[20]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[21]  Richard E. Ladner,et al.  Access overlays: improving non-visual access to large touch screens for blind users , 2011, UIST.

[22]  C. Thinus-Blanc,et al.  Early-Blind Subjects' Spatial Abilities in the Locomotor Space: Exploratory Strategies and Reaction-to-Change Performance , 1996, Perception.

[23]  Anke M. Brock,et al.  Kin'touch: understanding how visually impaired people explore tactile maps , 2012, CHI Extended Abstracts.

[24]  R. Sakia.  The Box-Cox transformation technique: a review , 1992 .

[25]  Bongshin Lee,et al.  Glanceable Visualization: Studies of Data Comparison Performance on Smartwatches , 2019, IEEE Transactions on Visualization and Computer Graphics.

[26]  B Richardson,et al.  Raised Line Drawings are Spontaneously Explored with a Single Finger , 2000, Perception.

[27]  A. Kappers,et al.  The Influence of Picture Size on Recognition and Exploratory Behaviour in Raised-Line Drawings , 2008, Perception.

[28]  Marcos Serrano,et al.  Identifying how Visually Impaired People Explore Raised-line Diagrams to Improve the Design of Touch Interfaces , 2017, CHI.

[29]  Morton A. Heller,et al.  Pattern Perception and Pictures for the Blind , 2005 .

[30]  M. Heller.  Picture and Pattern Perception in the Sighted and the Blind: The Advantage of the Late Blind , 1989, Perception.

[31]  Anke M. Brock,et al.  Accessible Interactive Maps for Visually Impaired Users , 2022, ArXiv.

[32]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. , 1980 .

[33]  R. Klatzky,et al.  Haptic identification of objects and their depictions , 1993, Perception & psychophysics.

[34]  John M Kennedy,et al.  Haptic Pictures: Fit Judgments Predict Identification, Recognition Memory, and Confidence , 2002, Perception.

[35]  Samuel Lebaz,et al.  Haptic identification of raised-line drawings: high visuospatial imagers outperform low visuospatial imagers , 2012, Psychological research.

[36]  A. Streri,et al.  Touching for knowing : cognitive psychology of haptic manual perception , 2003 .

[37]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[38]  Marcos Serrano,et al.  Investigating Feedback for Two-Handed Exploration of Digital Maps Without Vision , 2019, INTERACT.

[39]  David Beymer,et al.  An Eye Tracking Study of How Pictures Influence Online Reading , 2007, INTERACT.

[40]  Marcos Serrano,et al.  Tangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users , 2016, CHI.

[41]  Leanne Thompson,et al.  Enhancing 2-D Tactile Picture Design from Knowledge of 3-D Haptic Object Recognition , 2006 .

[42]  Timo Götzelmann,et al.  Towards Automatically Generated Tactile Detail Maps by 3D Printers for Blind Persons , 2014, ICCHP.