Sensory substitution information informs locomotor adjustments when walking through apertures

AbstractThe study assessed the ability of the central nervous system (CNS) to use echoic information from sensory substitution devices (SSDs) to rotate the shoulders and safely pass through apertures of different width. Ten visually normal participants performed this task with full vision, or blindfolded using an SSD to obtain information regarding the width of an aperture created by two parallel panels. Two SSDs were tested. Participants passed through apertures of +0, +18, +35 and +70 % of measured body width. Kinematic indices recorded movement time, shoulder rotation, average walking velocity across the trial, peak walking velocities before crossing, after crossing and throughout a whole trial. Analyses showed participants used SSD information to regulate shoulder rotation, with greater rotation associated with narrower apertures. Rotations made using an SSD were greater compared to vision, movement times were longer, average walking velocity lower and peak velocities before crossing, after crossing and throughout the whole trial were smaller, suggesting greater caution. Collisions sometimes occurred using an SSD but not using vision, indicating that substituted information did not always result in accurate shoulder rotation judgements. No differences were found between the two SSDs. The data suggest that spatial information, provided by sensory substitution, allows the relative position of aperture panels to be internally represented, enabling the CNS to modify shoulder rotation according to aperture width. Increased buffer space indicated by greater rotations (up to approximately 35 % for apertures of +18 % of body width) suggests that spatial representations are not as accurate as offered by full vision.

[1]  U. Neisser The Perceived Self: Ecological and Interpersonal Sources of Self Knowledge , 2006 .

[2]  W. N. Kellogg,et al.  Sonar system of the blind. , 1962, Science.

[3]  G. Yavuzer,et al.  Effect of an arm sling on gait pattern in patients with hemiplegia. , 2002, Archives of physical medicine and rehabilitation.

[4]  B Hughes,et al.  Active artificial echolocation and the nonvisual perception of aperture passability. , 2001, Human movement science.

[5]  M. Goodale,et al.  Citation for Published Item: Use Policy Neural Correlates of Natural Human Echolocation in Early and Late Blind Echolocation Experts , 2022 .

[6]  Nancy Melin Nelson Adaptive technology , 1993 .

[7]  T. Higuchi,et al.  Action‐oriented representation of peripersonal and extrapersonal space: Insights from manual and locomotor actions1 , 2006 .

[8]  Brian C J Moore,et al.  Using Acoustic Information to Perceive Room Size: Effects of Blindness, Room Reverberation Time, and Stimulus , 2013, Perception.

[9]  Jeanine K. Stefanucci,et al.  Duck! Scaling the height of a horizontal barrier to body height , 2010, Attention, perception & psychophysics.

[10]  Brett R Fajen,et al.  Static and Dynamic Visual Information about the Size and Passability of an Aperture , 2011, Perception.

[11]  P. Worchel,et al.  The perception of obstacles by the blind. , 1950, Journal of experimental psychology.

[12]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[13]  A. D. Little,et al.  Effects of Room Reflectance and Background Noise on Perceived Auditory Distance , 1989, Perception.

[14]  C E RICE,et al.  Sonar System of the Blind: Size Discrimination , 1965, Science.

[15]  W. Warren,et al.  Visual guidance of walking through apertures: body-scaled information for affordances. , 1987, Journal of experimental psychology. Human perception and performance.

[16]  David Whitney,et al.  Ultrafine spatial acuity of blind expert human echolocators , 2012, Experimental Brain Research.

[17]  Andrew J. Kolarik,et al.  Discrimination of virtual auditory distance using level and direct-to-reverberant ratio cues. , 2013, The Journal of the Acoustical Society of America.

[18]  L. Kay An ultrasonic sensing probe as a mobility aid for the blind , 1964 .

[19]  R. Welsh Foundations of Orientation and Mobility , 1979 .

[20]  J. B. Pittenger,et al.  Human Echolocation as a Basic Form of Perception and Action , 1995 .

[21]  David N. Lee The perceived self: Body–environment coupling , 1994 .

[22]  G. Gelderblom,et al.  The Impact of Electronic Mobility Devices for Persons who are Visually Impaired: A Systematic Review of Effects and Effectiveness , 2009 .

[23]  R P Power,et al.  Echo Perception of Shape and Texture by Sighted Subjects , 1982, Perceptual and motor skills.

[24]  R D Easton Inherent problems of attempts to apply sonar and vibrotactile sensory aid technology to the perceptual needs of the blind. , 1992, Optometry and vision science : official publication of the American Academy of Optometry.

[25]  K. M. Dallenbach,et al.  "Facial Vision": The Perception of Obstacles by the Blind , 1944 .

[26]  Mats E Nilsson,et al.  Human Echolocation: Blind and Sighted Persons' Ability to Detect Sounds Recorded in the Presence of a Reflecting Object , 2010, Perception.

[27]  Michael E. Cinelli,et al.  Locomotion through apertures when wider space for locomotion is necessary: adaptation to artificially altered bodily states , 2006, Experimental Brain Research.

[28]  Mats E Nilsson,et al.  Human Echolocation: Pitch versus Loudness Information , 2011, Perception.

[29]  J. O'Regan,et al.  Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’ , 2007, Perception.

[30]  R. Klatzky,et al.  Nonvisual navigation by blind and sighted: assessment of path integration ability. , 1993, Journal of experimental psychology. General.

[31]  Kate Wilmut,et al.  Locomotor adjustments when navigating through apertures. , 2010, Human movement science.

[32]  B. Day,et al.  Insights into the neural control of locomotion from walking through doorways in Parkinson's disease , 2010, Neuropsychologia.

[33]  Audrey L. H. van der Meer,et al.  Visual guidance of passing under a barrier , 1997 .

[34]  John M. Franchak,et al.  Perception of passage through openings depends on the size of the body in motion , 2012, Experimental Brain Research.

[35]  Andrew J. Kolarik,et al.  Evidence for enhanced discrimination of virtual auditory distance among blind listeners using level and direct-to-reverberant cues , 2012, Experimental Brain Research.

[36]  Claude Veraart,et al.  Changes in occipital cortex activity in early blind humans using a sensory substitution device , 1999, Brain Research.

[37]  Bitjoka Laurent,et al.  A sonar system modeled after spatial hearing and echolocating bats for blind mobility aid , 2007 .

[38]  Whitlow W L Au,et al.  Echo features used by human listeners to discriminate among objects that vary in material or wall thickness: implications for echolocating dolphins. , 2007, The Journal of the Acoustical Society of America.

[39]  Shane D Pinder,et al.  What's that sound? Distance determination and aperture passage from ultrasound echoes , 2011, Disability and rehabilitation. Assistive technology.

[40]  Jung-Kyong Kim,et al.  Generalized Learning of Visual-to-auditory Substitution in Sighted Individuals , 2008 .

[41]  Lawrence D. Rosenblum,et al.  Echolocating Distance by Moving and Stationary Listeners , 2000 .

[42]  Malika Auvray,et al.  Perception With Compensatory Devices: From Sensory Substitution to Sensorimotor Extension , 2009, Cogn. Sci..

[43]  Anne Bol,et al.  Cross-modal activation of visual cortex during depth perception using auditory substitution of vision , 2005, NeuroImage.

[44]  Gert Jan Gelderblom,et al.  Inventory of Electronic Mobility Aids for Persons with Visual Impairments: A Literature Review , 2008 .