Echo-house: exploring a virtual environment by using echolocation

The graphics-intensive nature of most virtual environments (VEs) prevents many people with visual impairment from being able to successfully explore them. A percentage of the population of people with visual impairment are known to use echolocation -sound waves and their reflections- to better explore their surroundings. In this paper, we describe the development of an echolocation-enabled VE (Echo-House) and evaluate the feasibility of using echolocation as a novel technique to explore this environment. Results showed that echolocation gave participants an improved sense of space in the VE. However, the evaluation also identified a range of orientation and mobility issues and found that participants needed additional support to gain confidence in their use of echolocation in the VE. Our findings suggest that with proper support, echolocation has the potential to improve access to VEs for people who are blind or visually impaired by revealing features that would be otherwise inaccessible.

[1]  Pablo Luis López Espí,et al.  Physical Analysis of Several Organic Signals for Human Echolocation: Oral Vacuum Pulses , 2009 .

[2]  P. Bach-y-Rita.  Theoretical aspects of sensory substitution and of neurotransmission-related reorganization in spinal cord injury , 1999, Spinal Cord.

[3]  Shachar Maidenbaum,et al.  Perception of Graphical Virtual Environments by Blind Users via Sensory Substitution , 2016, PloS one.

[4]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[5]  B. Belland.  Scaffolding: Definition, Current Debates, and Future Directions , 2014 .

[6]  Paul Bach-y-Rita,et al.  Seeing with the Brain , 2003, Int. J. Hum. Comput. Interact..

[7]  C. Boddy.  Sample size for qualitative research , 2016 .

[8]  M. Crouch,et al.  The logic of small samples in interview-based qualitative research , 2006 .

[9]  P Bach-Y-Rita.  Conservation of space and energy in the brain. , 1996, Restorative neurology and neuroscience.

[10]  Bruno Sinopoli,et al.  EchoExplorer(TM): A Game App for Understanding Echolocation and Learning to Navigate Using Echo Cues , 2017 .

[11]  Christ Glorieux,et al.  Interactive auralization of self-generated oral sounds in virtual acoustic environments for research in human echolocation , 2014 .

[12]  Jodi Aronson.  A Pragmatic View of Thematic Analysis , 1995 .

[13]  Dan Gärdenfors,et al.  Audio games: new perspectives on game audio , 2004, ACE '04.

[14]  Timo Götzelmann,et al.  LucentMaps: 3D Printed Audiovisual Tactile Maps for Blind and Visually Impaired People , 2016, ASSETS.

[15]  Raja Syamsul Azmir Raja Abdullah,et al.  Mouth-clicks used by blind expert human echolocators – signal description and model based signal synthesis , 2017, PLoS Comput. Biol..

[16]  K. A. Kaczmarek.  Effect of Electrode Geometry and Intensity Control Method on Comfort of Electrotactile Stimulation on the Tongue , 2000, Dynamic Systems and Control: Volume 2.

[17]  Y. Iwaya,et al.  Cognitive-map forming of the blind in virtual sound environment , 2006 .

[18]  Lore Thaler,et al.  Echolocation in humans: an overview. , 2016, Wiley interdisciplinary reviews. Cognitive science.

[19]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[20]  Werner Scholl,et al.  Measurement and testing of the acoustic properties of materials: a review , 2010 .

[21]  Lei Shi,et al.  Designing Interactions for 3D Printed Models with Blind People , 2017, ASSETS.

[22]  Olivier Collignon,et al.  Is there a future for sensory substitution outside academic laboratories? , 2014, Multisensory research.

[23]  Michel Denis,et al.  Exploration of architectural spaces by blind people using auditory virtual reality for the construction of spatial knowledge , 2014, Int. J. Hum. Comput. Stud..

[24]  Daniel P. Siewiorek,et al.  Customizable 3D Printed Tactile Maps as Interactive Overlays , 2016, ASSETS.

[25]  Lore Thaler,et al.  Echolocation may have real-life advantages for blind people: an analysis of survey data , 2013, Front. Physiol..

[26]  Jaime Sánchez,et al.  Action video game play and transfer of navigation and spatial cognition skills in adolescents who are blind , 2014, Front. Hum. Neurosci..

[27]  P. Bach-y-Rita,et al.  Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. , 1998, Journal of rehabilitation research and development.

[28]  Kelly Caine,et al.  Local Standards for Sample Size at CHI , 2016, CHI.

[29]  Julien Nelson,et al.  6DoF navigation in virtual worlds: comparison of joystick-based and head-controlled paradigms , 2013, VRST '13.

[30]  Mauricio Sáenz,et al.  Enhancing navigation skills through audio gaming , 2010, CHI EA '10.

[31]  Brian C. J. Moore,et al.  A summary of research investigating echolocation abilities of blind and sighted humans , 2014, Hearing Research.

[32]  Laura Johnson,et al.  How Many Interviews Are Enough? , 2006 .

[33]  Nashwa El-Bendary,et al.  Virtual Reality Technology for Blind and Visual Impaired People: Reviews and Recent Advances , 2012 .

[34]  S. Hayes,et al.  Alternating treatments design: one strategy for comparing the effects of two treatments in a single subject. , 1979, Journal of applied behavior analysis.

[35]  Rafaello Bergonse,et al.  Fifty Years on, What Exactly is a Videogame? An Essentialistic Definitional Approach , 2017, The Computer Games Journal.

[36]  Saniye Tugba Bulu,et al.  Place presence, social presence, co-presence, and satisfaction in virtual worlds , 2012, Comput. Educ..

[37]  M. Ptito,et al.  Compensatory plasticity and cross-modal reorganization following early visual deprivation , 2014, Neuroscience & Biobehavioral Reviews.

[38]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[39]  Shachar Maidenbaum,et al.  Increasing Accessibility to the Blind of Virtual Environments, Using a Virtual Mobility Aid Based On the "EyeCane": Feasibility Study , 2013, PloS one.

[40]  Baltasar Fernández-Manjón,et al.  Evaluation of semi-automatically generated accessible interfaces for educational games , 2015, Comput. Educ..

[41]  Geraldine Fitzpatrick,et al.  Toward accessible 3D virtual environments for the blind and visually impaired , 2008, DIMEA.

[42]  Jaime Sánchez,et al.  Multimodal Videogames for the Cognition of People Who Are Blind: Trends and Issues , 2015, HCI.

[43]  E. Fess,et al.  Determining sample size. , 1995, Journal of hand therapy : official journal of the American Society of Hand Therapists.