Haptic Interfaces for Individuals with Visual Impairments

Vision enables a person to simultaneously perceive all parts of an object in its totality, relationships to other objects for scene navigation, identification and planning. These types of perceptual processes are especially important for comprehending scenes in gaming environments and virtual representations. While individuals with visual impairments may have reduced abilities to visualize objects using conventional sight, an increasing body of evidence indicates that compensatory neural mechanisms exist whereby tactile stimulation and additional senses can activate visual pathways to generate accurate representations. The current thrust to develop and deploy virtual and augmented reality systems capable of transporting users to different worlds has been associated with a push to include additional senses for even greater immersion. Clearly, the inclusion of these additional modalities will provide a method for individuals with visual impairments to enjoy and interact with the virtual worlds and content in general. Importantly, adoption and development of these methods will have a dramatic impact on inclusion in gaming and learning environments, and especially in relation to science, technology, engineering, and mathematical (STEM) education. While the development, standardization and implementation of these systems is still in the very early stages, gaming devices and open source tools are continuing to emerge that will accelerate the adoption and integration of the novel modes of computer interaction and provide new ways for individuals (with visual impairments) to experience digital content. Here we present the rationale and benefits for using this type of multimodal interaction for individuals with visual impairments as well as the current state of the art in haptic interfaces for gaming, education and the relationships to enhanced end user immersion and learning outcomes. As these technologies and devices are adopted and evolve, they are poised to have a dramatic impact on entertainment, education and quality of life of individuals with visual impairments.

[1]  Abdulmotaleb El Saddik,et al.  The Role of Haptics in Games , 2012 .

[2]  Paul B. Hounshell,et al.  Using three-dimensional models to teach molecular structures in high school chemistry , 1995 .

[3]  Richard Chbeir,et al.  Evaluation of touch screen vibration accessibility for blind users , 2013, ASSETS.

[4]  Eyal Ofek,et al.  Demonstration of Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation , 2018, CHI Extended Abstracts.

[5]  Eyal Ofek,et al.  Demonstration of Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a VR Controller , 2018, CHI Extended Abstracts.

[6]  Clément Gosselin,et al.  Development and Experimental Validation of a Haptic Compass Based on Asymmetric Torque Stimuli , 2017, IEEE Transactions on Haptics.

[7]  Peter Jamieson,et al.  READY , 2019, Postgraduate medicine.

[8]  Thomas R. Tretter,et al.  A comparison of learning with haptic and visual modalities. , 2005 .

[9]  M. Žefran,et al.  Assessment of faculty perception of content validity of PerioSim, a haptic-3D virtual reality dental training simulator. , 2007, Journal of dental education.

[10]  Anne C Brawand,et al.  Effective Methods for Delivering Mathematics Instruction to Students with Visual Impairments , 2016 .

[11]  Patrick Hartling,et al.  Open source virtual reality , 2002, Proceedings IEEE Virtual Reality 2002.

[12]  Christopher Buswell,et al.  Feeling is believing. , 1998, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[13]  Orly Lahav,et al.  A Virtual Environment for People Who Are Blind - A Usability Study. , 2012, Journal of assistive technologies.

[14]  Renan G. Cattelan,et al.  Technology-enhanced assessment visualization for smart learning environments , 2019, Smart Learning Environments.

[15]  Aquinas Benedict Pather.  The Innovative Use of Vector-based Tactile Graphics Design Software to Automate the Production of Raised-line Tactile Graphics in Accordance with BANA’s Newly Adopted Guidelines and Standards for Tactile Graphics, 2010. , 2014 .

[16]  H. Burton,et al.  Cortical activity to vibrotactile stimulation: An fMRI study in blind and sighted individuals , 2004, Human brain mapping.

[17]  M. Strintzis,et al.  CyberGrasp and PHANTOM Integration : Enhanced Haptic Access for Visually Impaired Users , 2004 .

[18]  H Burton,et al.  Reading embossed capital letters: An fMRI study in blind and sighted individuals , 2006, Human brain mapping.

[19]  Michael A. Kolitsky.  3D Printed Tactile Learning Objects: Proof of Concept Abstract , 2014 .

[20]  Robert J. Clements,et al.  A Virtual Haptic Platform to Assist Seeing Impaired Learning: Proof of Concept , 2017 .

[21]  Jeremy R. Cooperstock,et al.  Touch Is Everywhere: Floor Surfaces as Ambient Haptic Interfaces , 2009, IEEE Transactions on Haptics.

[22]  Dimitrios Tzovaras,et al.  Haptic Access to Conventional 2D Maps for the Visually Impaired , 2007 .

[23]  Tony Morelli,et al.  Vi-bowling: a tactile spatial exergame for individuals with visual impairments , 2010, ASSETS '10.

[24]  Matthew D'Souza,et al.  Navigation for the blind using a wireless sensor haptic glove , 2015, 2015 4th Mediterranean Conference on Embedded Computing (MECO).

[25]  J. Norman,et al.  Blindness enhances tactile acuity and haptic 3-D shape discrimination , 2011, Attention, perception & psychophysics.

[26]  David J. Brown,et al.  An interface to virtual environments for people who are blind using Wii technology ‐ mental models and navigation , 2009 .

[27]  Christopher R. Bennett,et al.  Touch-screen technology for the dynamic display of -2D spatial information without vision: promise and progress. , 2014, Multisensory research.

[28]  Antonella Nota,et al.  3D Printing Technology: A Unique Way of Making Hubble Space Telescope Images Accessible to Non-Visual Learners , 2015 .

[29]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[30]  Megan Holt,et al.  Making Physics Courses Accessible for Blind Students: strategies for course administration, class meetings and course materials , 2017 .

[31]  F Rösler,et al.  Different cortical activation patterns in blind and sighted humans during encoding and transformation of haptic images. , 1997, Psychophysiology.