Game design for visually-impaired individuals: Creativity and innovation theories and sensory substitution devices influence on virtual and physical navigation skills

This action research study examined the design elements of three VR games that used an HTC VIVE VR helmet, two HTC game controllers, and a VR horse simulator for functionality and transferability to orientation and mobility (O&M) education for visually impaired individuals. The functionality of the VR games was tested with a visually-impaired individual based upon five characteristics that are important to O&M education: perimeter scanning then grid scanning, hearing, touch, smell, and perceptions of body positions. The horse simulator has potential benefits for proprioception and kinesthesia development. The inconsistent haptic feedback requires redesign consideration for inclusion within VR games and systems for O&M education.

[1]  Arianna Menciassi,et al.  Neuromorphic Vibrotactile Stimulation of Fingertips for Encoding Object Stiffness in Telepresence Sensory Substitution and Augmentation Applications , 2018, Sensors.

[2]  M. West,et al.  Innovation at work:psychological perspectives , 1989 .

[3]  Malika Auvray,et al.  Perception With Compensatory Devices: From Sensory Substitution to Sensorimotor Extension , 2009, Cogn. Sci..

[4]  Karon E. MacLean,et al.  Exploiting haptic facets: Users' sensemaking schemas as a path to design and personalization of experience , 2017, Int. J. Hum. Comput. Stud..

[5]  Mandayam A. Srinivasan,et al.  BlindAid: Virtual environment system for self-reliant trip planning and orientation and mobility training , 2010, 2010 IEEE Haptics Symposium.

[6]  Meredith Ringel Morris,et al.  Demonstration of Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation , 2018, CHI Extended Abstracts.

[7]  Shachar Maidenbaum,et al.  EyeMusic: Introducing a "visual" colorful experience for the blind using auditory sensory substitution. , 2014, Restorative neurology and neuroscience.

[8]  Francesco Masulli,et al.  An assistive mobile system supporting blind and visual impaired people when are outdoor , 2017, 2017 IEEE 3rd International Forum on Research and Technologies for Society and Industry (RTSI).

[9]  Jaime Sánchez,et al.  Development of an audio-based virtual gaming environment to assist with navigation skills in the blind. , 2013, Journal of visualized experiments : JoVE.

[10]  Jaime Sánchez,et al.  Teaching the Blind to Find Their Way by Playing Video Games , 2012, PloS one.

[11]  Amy Zhang,et al.  A user-centered design and analysis of an electrostatic haptic touchscreen system for students with visual impairments , 2018, Int. J. Hum. Comput. Stud..

[12]  Brockenbrough S. Allen,et al.  MEDIA AS LIVED ENVIRONMENTS: THE ECOLOGICAL PSYCHOLOGY OF EDUCATIONAL TECHNOLOGY , 1996 .

[13]  Shachar Maidenbaum,et al.  Perception of Graphical Virtual Environments by Blind Users via Sensory Substitution , 2016, PloS one.

[14]  Yvette Hatwell,et al.  The Effects of Visual Experience and Training in Raised-Line Materials on the Mental Spatial Imagery of Blind Persons , 2006 .

[15]  Charles Lenay,et al.  Chapter 16. Sensory substitution: Limits and perspectives , 2003 .

[16]  Luigi F. Cuturi,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[17]  Jaime Sánchez,et al.  Enhancing orientation and mobility skills in learners who are blind through video gaming , 2013, Creativity & Cognition.

[18]  I. Spence,et al.  Video Games and Spatial Cognition , 2010 .

[19]  Anatole Lécuyer,et al.  HOMERE: a multimodal system for visually impaired people to explore virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[20]  L. Finlay.  Negotiating the swamp: the opportunity and challenge of reflexivity in research practice , 2002 .

[21]  Ricky W. Griffin,et al.  Toward a Theory of Organizational Creativity , 1993 .

[22]  Mark Bolas,et al.  Designing informed game-based rehabilitation tasks leveraging advances in virtual reality , 2012, Disability and rehabilitation.

[23]  Jonathan C. Roberts,et al.  Prototyping 3D haptic data visualizations , 2013, Comput. Graph..

[24]  David Mioduser,et al.  Haptic-feedback support for cognitive mapping of unknown spaces by people who are blind , 2008, Int. J. Hum. Comput. Stud..

[25]  Olivier Collignon,et al.  Is there a future for sensory substitution outside academic laboratories? , 2014, Multisensory research.

[26]  Michel Denis,et al.  Exploration of architectural spaces by blind people using auditory virtual reality for the construction of spatial knowledge , 2014, Int. J. Hum. Comput. Stud..