The Perception of Space and Form Recognition in a Simulated Environment: The Case of Minimalist Sensory-Substitution Devices

Whenever we explore a simulated environment, the sensorimotor interactions that underlie our perception of space may be modified. We investigated the conditions under which it is possible to acquire the mastery of new sensorimotor laws and thereby to infer new perceptual spaces. A computer interface, based on the principles of minimalist sensory-substitution devices, was designed to enable different possible links between a user's actions (manipulation of a mouse and/or keys of a keyboard) and the resulting pattern of sensory stimulation (visual or auditory) to be established. The interface generated an all-or-none stimulus whose activation varied as a function of the participant's exploration of a hidden form. In this study we addressed the following questions: What are the conditions necessary for participants to understand their actions as constituting a displacement in a simulated space? What are the conditions required for participants to conceive of sensations as originating from the encounter with an object situated in this space? Finally, what are the conditions required for participants to recognise forms within this space? The results of the two experiments reported here show that, under certain conditions, participants can interpret the new sensorimotor laws as movements in a new perceptual space and can recognise simple geometric forms, and that this occurs no matter whether the sensory stimulation is presented in the visual or auditory modality.

[1]  J. Stewart.  Cognition = life: Implications for higher-level cognition , 1995, Behavioural Processes.

[2]  C. Spence,et al.  Beyond the body schema: Visual, prosthetic, and technological contributions to bodily perception and awareness , 2006 .

[3]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[4]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[5]  Giuseppe Riva,et al.  Real Presence: How Different Ontologies Generate Different Criteria for Presence, Telepresence, and Virtual Presence , 1999, Presence.

[6]  J. O'Regan,et al.  Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’ , 2007, Perception.

[7]  P. Bach-y-Rita,et al.  Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. , 1998, Journal of rehabilitation research and development.

[8]  J. Wilder.  The Origins of Intelligence in Children , 1954 .

[9]  C. Trullemans,et al.  A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution , 1998, IEEE Transactions on Biomedical Engineering.

[10]  J. Cronly-Dillon,et al.  The perception of visual images encoded in musical form: a study in cross-modality information transfer , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[11]  L. Kay.  An ultrasonic sensing probe as a mobility aid for the blind , 1964 .

[12]  K. O’regan,et al.  There is something out there: distal attribution in sensory substitution, twenty years later. , 2005, Journal of integrative neuroscience.

[13]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[14]  J. Piaget.  The construction of reality in the child , 1954 .

[15]  B Hughes,et al.  Is There Anything out There?: A Study of Distal Attribution in Response to Vibrotactile Stimulation , 1986, Perception.

[16]  C. Lenay,et al.  SENSORY SUBSTITUTION: LIMITS AND PERSPECTIVES , 2003 .

[17]  Paul Bach-y-Rita.  Sensory substitution and qualia , 2002 .

[18]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[19]  Jack M. Loomis,et al.  Distal Attribution and Presence , 1992, Presence: Teleoperators & Virtual Environments.