On the importance of reliable real-time sensorimotor dependencies for establishing telepresence

In the current paper we review the concept of (tele)presence as it relates to the active exploration of the virtual, remote, or real environments. The same sensory and brain systems responsible for a flexible mapping of our position within a spatial layout are also remarkably adaptable to include non-biological elements in the perceptual-motor loop, provided reliable, real-time sensorimotor correlations can be established. Telepresence technologies, especially those used in fluent teleoperation, essentially enable the remapping of far space to near space. The importance of actively exploring the environment through tele-bodily actions will be discussed, in particular as they relate to appropriate haptic feedback patterns for telepresence.

[1]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[2]  Terry Winograd,et al.  Understanding computers and cognition - a new foundation for design , 1987 .

[3]  Michael P. Snow,et al.  Empirical Models Based on Free-Modulus Magnitude Estimation of Perceived Presence in Virtual Environments , 1998, Hum. Factors.

[4]  C J Overbeeke,et al.  Depth on a Flat Screen , 1987, Perceptual and motor skills.

[5]  Wijnand A. IJsselsteijn,et al.  Presence: concept, determinants, and measurement , 2000, Electronic Imaging.

[6]  Wijnand A. IJsselsteijn,et al.  Presence: Where Are We? , 2001, Cyberpsychology Behav. Soc. Netw..

[7]  G Rizzolatti,et al.  The Space Around Us , 1997, Science.

[8]  M. Goodale,et al.  Active manual control of object views facilitates visual recognition , 1999, Current Biology.

[9]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[10]  R. Held.  Plasticity in sensory-motor systems. , 1965, Scientific American.

[11]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[12]  Mel Slater,et al.  Presence and The Sixth Sense , 2002, Presence: Teleoperators & Virtual Environments.

[13]  Ian Glynn.  An anatomy of thought , 1999 .

[14]  Pavel Zahorik,et al.  Presence as Being-in-the-World , 1998, Presence.

[15]  Miriam Reiner,et al.  The role of haptics in immersive telecommunication environments , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Bernhard E. Riecke,et al.  Qualitative Modeling of Spatial Orientation Processes using Logical Propositions: Interconnecting Spatial Presence, Spatial Updating, Piloting, and Spatial Cognition , 2002 .

[17]  Lawrence W. Stark,et al.  How virtual reality works: illusions of vision in "real" and virtual environments , 1995, Electronic Imaging.

[18]  Ken Eason,et al.  Analysis, design and evaluation of man-machine systems: Pergamon, Oxford, 1983, xvii + 424 pages, £60.00 , 1985 .

[19]  G. Edelman.  Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[20]  John M. Flach,et al.  The Reality of Experience: Gibson's Way , 1998, Presence.

[21]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[22]  O. Grüsser,et al.  Multimodal Structure of the Extrapersonal Space , 1983 .

[23]  R. M. Siegel,et al.  Foundations of Cognitive Science , 1990, Journal of Cognitive Neuroscience.

[24]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[25]  Andy Clark,et al.  Natural-Born Cyborgs? , 2001, Cognitive Technology.

[26]  Jack M. Loomis,et al.  Distal Attribution and Presence , 1992, Presence: Teleoperators & Virtual Environments.

[27]  V. Ramachandran,et al.  Projecting sensations to external objects: evidence from skin conductance response , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[28]  W. IJsselsteijn,et al.  Elements of a multi-level theory of presence: phenomenology, mental processing and neural correlates , 2002 .

[29]  Mark L. Johnson.  The body in the mind: the bodily basis of meaning , 1987 .

[30]  Charles Samuel Harris,et al.  Visual coding and adaptability , 1980 .

[31]  H. G. Stassen,et al.  Telemanipulation and Telepresence , 1995 .

[32]  A. Clark,et al.  Books , 2004, INTR.

[33]  Holger Regenbrecht,et al.  Real and Illusory Interactions Enhance Presence in Virtual Environments , 2002, Presence: Teleoperators & Virtual Environments.

[34]  Claudio M. Privitera,et al.  Representation of human vision in the brain: How does human perception recognize images? , 2001, J. Electronic Imaging.

[35]  C J Overbeeke,et al.  Depth on a Flat Screen: II , 1987, Perceptual and motor skills.

[36]  R. Gregory.  Perceptions as hypotheses. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[37]  Susan J. Lederman,et al.  Exploring Environments by Hand or Foot: Time-Based Heuristics for Encoding Distance in Movement Space , 1987 .

[38]  Carrie Heeter,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[39]  G. Rizzolatti,et al.  Neural Circuits for Spatial Attention and Unilateral Neglect , 1987 .

[40]  R. Held,et al.  Adaptation of Disarranged Hand-Eye Coordination Contingent upon Re-Afferent Stimulation , 1958 .

[41]  A. Berti,et al.  When Far Becomes Near: Remapping of Space by Tool Use , 2000, Journal of Cognitive Neuroscience.

[42]  Fred H. Previc,et al.  The Neuropsychology of 3-D Space , 1998 .

[43]  Lawrence W. Stark,et al.  The Effects of Pictorial Realism, Delay of Visual Feedback, and Observer Interactivity on the Subjective Sense of Presence , 1996, Presence: Teleoperators & Virtual Environments.

[44]  M. Jeannerod.  Neurophysiological and neuropsychological aspects of spatial neglect. , 1987 .