Behind the scenes of virtual reality: vision and motion

The phrase "Concealing Telecommunications Networks" is first introduced as an ultimate philosophical concept in human-to-human or physically evolving "multimedia" communications by employing the same face-to-face mode that is used in natural communications. Then virtual reality (VR) technologies and their current applications are introduced, followed by an introduction of cutting-edge research on "Teleconferencing with Realistic Sensations", which is a communications system that conceals the existence of telecommunications networks. Next, research activities on "vision" and "motion", the most important underlying human functions supporting technologies such as VR, are presented. These activities consist of 1) a perception model that explains how human beings mentally reconstruct 3-D shapes from 2-D information projected on the retina, and 2) research on the close relationship between the senses, i.e., auditory and visual perception, visual information, and muscular motion stimuli. As a practical application, an example of measuring eye movements for early detection of Alzheimer's disease is briefly introduced. Finally, some fundamental problems with stereoscopic 3-D displays on 2-D screens, which can make them more fatiguing than the natural environment, are discussed.

[1]  Kazuo Tanie,et al.  High resolution, wide view angle head mounted display using eye movement tracking: system structure and evaluation experiments , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[2]  David Zeltzer,et al.  Autonomy, Interaction, and Presence , 1992, Presence: Teleoperators & Virtual Environments.

[3]  Fumio Kishino,et al.  Virtual Space Teleconferencing: Real-Time Reproduction of 3D Human Images , 1995, J. Vis. Commun. Image Represent..

[4]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[5]  Keith Duncan,et al.  Cognitive Engineering , 2017, Encyclopedia of GIS.

[6]  Mitsuo Kawato,et al.  A forward-inverse optics model of reciprocal connections between visual cortical areas , 1993 .

[7]  M. Bergamasco,et al.  Haptic interfaces: the study of force and tactile feedback systems , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[8]  Fumio Hara,et al.  A basic study on dynamic control of facial expressions for Face Robot , 1994, Proceedings of 1994 3rd IEEE International Workshop on Robot and Human Communication.

[9]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .

[10]  Grigore C. Burdea,et al.  Integration of the Rutgers Master II in a virtual reality simulation , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[11]  Hiroo Iwata,et al.  Artificial reality with force-feedback: development of desktop virtual space with compact master manipulator , 1990, SIGGRAPH.

[12]  James M. Calvin,et al.  The SIMNET virtual world architecture , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[13]  Tsutomu Miyasato,et al.  Virtual space teleconferencing "Communication with realistic sensations" , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[14]  M. Kawato,et al.  The cerebellum and VOR/OKR learning models , 1992, Trends in Neurosciences.

[15]  N. Terashima,et al.  Virtual space teleconferencing system , 1994, 5th IEEE COMSOC International Workshop on Multimedia Communications.

[16]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[17]  Kellogg S. Booth,et al.  Evaluating 3D task performance for fish tank virtual worlds , 1993, TOIS.

[18]  T. Aritake,et al.  A simple Darwinian agent of active human interface for robot-human communication , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[19]  Michael Zyda,et al.  NPSNET:A Network Software Architecture for LargeScale Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[20]  Hitoshi Hongo,et al.  Analysis of Head and Eye Coordination in Patients with Alzheimer's Disease , 1994 .

[21]  Frank Biocca,et al.  Quantification of adaptation to virtual-eye location in see-thru head-mounted displays , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[22]  Fumio Kishino,et al.  A Kalman Filtering with a Gaze-Holding Algorithm for Intentionally Controlling a Displayed Object by the Line-of-Gaze , 1993 .

[23]  Joseph Rosen,et al.  The virtual sailor: An implementation of interactive human body modeling , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[24]  Michael Zyda,et al.  Exploiting reality with multicast groups: a network architecture for large-scale virtual environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[25]  K. Habara.  ISDN: a look at the future through the past , 1988, IEEE Communications Magazine.

[26]  Hiroshi Harashima,et al.  Intelligent Image Coding and Communications with Realistic Sensations --Recent Trends-- , 1991 .

[27]  F. Kishino,et al.  Wide-screen autostereoscopic display system employing head-position tracking , 1994 .

[28]  Shumin Zhai,et al.  Virtual reality for palmtop computers , 1993, TOIS.

[29]  T. Maeda,et al.  Tele-existence simulator with artificial reality (1)- design and evaluation of a binocular visual display using solid models- , 1988, IEEE International Workshop on Intelligent Robots.

[30]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[31]  V S Ramachandran,et al.  Perceiving shape from shading. , 1988, Scientific American.

[32]  Nobuyoshi Terashima.  Telesensation - Distributed Interactive Virtual Reality - Overview and Prospects , 1994, IFIP Congress.

[33]  Paul Milgram,et al.  Telerobotic control using augmented reality , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[34]  Hiroshi Harashima,et al.  Facial expression synthesis based on natural voice for virtual face-to-face communication with machine , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[35]  M. Kawato,et al.  Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum , 1993, Nature.

[36]  Warren Robinett,et al.  Virtual environment display system , 1987, I3D '86.

[37]  James T. Todd,et al.  Ordinal structure in the visual perception and cognition of smoothly curved surfaces. , 1989 .

[38]  Frederick P. Brooks,et al.  Project GROPEHaptic displays for scientific visualization , 1990, SIGGRAPH.