Using virtual reality to augment perception, enhance sensorimotor adaptation, and change our minds

Technological advances that involve human sensorimotor processes can have both intended and unintended effects on the central nervous system (CNS). This mini review focuses on the use of virtual environments (VE) to augment brain functions by enhancing perception, eliciting automatic motor behavior, and inducing sensorimotor adaptation. VE technology is becoming increasingly prevalent in medical rehabilitation, training simulators, gaming, and entertainment. Although these VE applications have often been shown to optimize outcomes, whether it be to speed recovery, reduce training time, or enhance immersion and enjoyment, there are inherent drawbacks to environments that can potentially change sensorimotor calibration. Across numerous VE studies over the years, we have investigated the effects of combining visual and physical motion on perception, motor control, and adaptation. Recent results from our research involving exposure to dynamic passive motion within a visually-depicted VE reveal that short-term exposure to augmented sensorimotor discordance can result in systematic aftereffects that last beyond the exposure period. Whether these adaptations are advantageous or not, remains to be seen. Benefits as well as risks of using VE-driven sensorimotor stimulation to enhance brain processes will be discussed.

[1]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[2]  W. Wright Using virtual reality to induce cross-axis adaptation of postural control: Implications for rehabilitation , 2013, 2013 International Conference on Virtual Rehabilitation (ICVR).

[3]  J. F. Soechting,et al.  Postural readjustments induced by linear motion of visual scenes , 1977, Experimental Brain Research.

[4]  Juno Kim,et al.  Vection in Depth during Consistent and Inconsistent Multisensory Stimulation , 2011, Perception.

[5]  Ernst Mach,et al.  Grundlinien der Lehre von den Bewegungsempfindungen , 1967 .

[6]  Stephen Palmisano,et al.  Consistent Stereoscopic Information Increases the Perceived Speed of Vection in Depth , 2002, Perception.

[7]  Gin McCollum,et al.  Head tilt–translation combinations distinguished at the level of neurons , 2006, Biological Cybernetics.

[8]  U. Castiello,et al.  Improving left hemispatial neglect using virtual reality , 2004, Neurology.

[9]  R. Held,et al.  PLASTICITY IN HUMAN SENSORIMOTOR CONTROL. , 1963, Science.

[10]  A. Berthoz,et al.  Linear Acceleration Modifies the Perceived Velocity of a Moving Visual Scene , 1977, Perception.

[11]  Gavriel Salvendy,et al.  Aftereffects and Sense of Presence in Virtual Environments: Formulation of a Research and Development Agenda , 1998, Int. J. Hum. Comput. Interact..

[12]  E. Keshner,et al.  Head Stabilization Shows Visual and Inertial Dependence During Passive Stimulation: Implications for Virtual Rehabilitation , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  L R Young,et al.  Spatial orientation in weightlessness and readaptation to earth's gravity. , 1984, Science.

[14]  J V Cohn,et al.  Reaching during virtual rotation: context specific compensations for expected coriolis forces. , 2000, Journal of neurophysiology.

[15]  S. Glasauer,et al.  Subjective somatosensory vertical during dynamic tilt is dependent on task, inertial condition, and multisensory concordance , 2006, Experimental Brain Research.

[16]  F. Guedry Psychophysics of Vestibular Sensation , 1974 .

[17]  B. Riecke,et al.  Cognitiveand higher-level contributions to illusory self-motion ' perception ( " vection " ) Does the possibility ' of actual motion affect vection ? , 2014 .

[18]  L. Young,et al.  Subjective detection of vertical acceleration: a velocity-dependent response? , 1978, Acta oto-laryngologica.

[19]  A. Delorme,et al.  Roll, pitch, longitudinal and yaw vection visually induced by optical flow in flight simulation conditions. , 1992, Perceptual and motor skills.

[20]  Paul DiZio,et al.  Perceived self-motion in two visual contexts: dissociable mechanisms underlie perception. , 2006, Journal of vestibular research : equilibrium & orientation.

[21]  G. Stratton Some preliminary experiments on vision without inversion of the retinal image. , 1896 .

[22]  A. Berthoz,et al.  Perception of linear horizontal self-motion induced by peripheral vision (linearvection) basic characteristics and visual-vestibular interactions , 1975, Experimental Brain Research.

[23]  Bernhard E. Riecke Cognitive and higher-level contributions to illusory self-motion perception ("vection"): does the possibility of actual motion affect vection? ([日本基礎心理学会]第27回大会 シンポジウム マルチモーダル感覚情報の時空間統合をめぐって) , 2009 .

[24]  L. Harris,et al.  Visual and non-visual cues in the perception of linear self motion , 2000, Experimental Brain Research.

[25]  J. Lishman,et al.  The Autonomy of Visual Kinaesthesis , 1973, Perception.

[26]  P. L. Weiss,et al.  Kinematics of Reaching Movements in a 2-D Virtual Environment in Adults With and Without Stroke , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Head stabilization shows multisensory dependence on spatiotemporal characteristics of visual and inertial passive stimulation , 2011, 2011 International Conference on Virtual Rehabilitation.

[28]  W. Bles,et al.  Cognitive Suppression of Tilt Sensations during Linear Horizontal Self-Motion in the Dark , 2001, Perception.

[29]  Emily A Keshner,et al.  Postural responses exhibit multisensory dependencies with discordant visual and support surface motion. , 2004, Journal of vestibular research : equilibrium & orientation.

[30]  E. Schneider,et al.  Manual motor control during “virtual” self-motion: Implications for VR rehabilitation , 2009, 2009 Virtual Rehabilitation International Conference.

[31]  G. McCollum,et al.  Constructive perception of self-motion. , 2009, Journal of vestibular research : equilibrium & orientation.

[32]  M F Reschke,et al.  Otolith tilt-translation reinterpretation following prolonged weightlessness: implications for preflight training. , 1985, Aviation, space, and environmental medicine.

[33]  L R Young,et al.  Interaction of optokinetic and vestibular stimuli in motion perception. , 1973, Acta oto-laryngologica.

[34]  Stefan Glasauer,et al.  Haptic subjective vertical shows context dependence: task and vision play a role during dynamic tilt stimulation. , 2003, Annals of the New York Academy of Sciences.

[35]  Robert V. Kenyon,et al.  Effects of roll visual motion on online control of arm movement: reaching within a dynamic virtual environment , 2009, Experimental Brain Research.

[36]  J. Lackner,et al.  Vertical linear self-motion perception during visual and inertial motion: more than weighted summation of sensory inputs. , 2005, Journal of vestibular research : equilibrium & orientation.

[37]  Daniel M Merfeld,et al.  Vestibular perception and action employ qualitatively different mechanisms. II. VOR and perceptual responses during combined Tilt&Translation. , 2005, Journal of neurophysiology.

[38]  R Held,et al.  Adaptation to displaced vision: a change in the central control of sensorimotor coordination. , 1971, Journal of Experimental Psychology.

[39]  M. Sanders Handbook of Sensory Physiology , 1975 .

[40]  P. Cz. Handbuch der physiologischen Optik , 1896 .

[41]  J. Gibson The visual perception of objective motion and subjective movement. , 1994, Psychological review.

[42]  M. Perenin,et al.  Prism adaptation to a rightward optical deviation rehabilitates left hemispatial neglect , 1998, Nature.

[43]  Dora E. Angelaki,et al.  Cross-axis adaptation of the translational vestibulo-ocular reflex , 2001, Experimental Brain Research.

[44]  Stefan Glasauer,et al.  Compensatory manual motor responses while object wielding during combined linear visual and physical roll tilt stimulation , 2008, Experimental Brain Research.

[45]  R. Pigassou The functional treatment of strabismus. , 1972, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[46]  W. Geoffrey Wright,et al.  Linear vection in virtual environments can be strengthened by discordant inertial input , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[47]  B J Frost,et al.  Linear Vection in the Central Visual Field Facilitated by Kinetic Depth Cues , 1992, Perception.

[48]  W. Warren,et al.  The role of central and peripheral vision in perceiving the direction of self-motion , 1992, Perception & psychophysics.