Enhancing Human Computer Interaction in Networked Hapto-Acoustic Virtual Reality Environments on the CeNTIE Network

We discuss some recent advances made to our Virtual Reality system which includes touch feedback in a networked environment. Some issues which affect the realisation and implementation of the Hapto-Acoustic Virtual Reality Environment and human-computer interaction (HCI) are mentioned, as well as networking issues. Our system is called a “haptic workbench” which combines 3D graphics visualisation, touch (haptics) and audio interaction with a computer generated model. The aim is to produce a semi-immersive 3D environment, experienced in real time by the user. Networking two or more systems makes it possible to collaborate in the virtual space and achieve a sense of perceived virtual presence. Recent additions to the system in the form of real time video with audio is demonstrated and shown to enhance the level of virtual presence in the networked environment. Such face to face communication with the remote user in addition to haptic and audio collaboration with the virtual model adds to the sense of presence between users. Two methods of sending video over the internet are compared and our example implementation is described. These additions make it possible to add value in learning scenarios and opens up the possibility of increasing participation during a training session.

[1]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[2]  T. L. Brooks,et al.  Telerobotic response requirements , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[3]  W. M. Rabinowitz,et al.  Manual discrimination and identification of length by the finger-span method , 1989, Perception & psychophysics.

[4]  Thomas A. DeFanti,et al.  Virtual Reality Over High-Speed Networks , 1996, IEEE Computer Graphics and Applications.

[5]  Jack McLaughlin,et al.  Haptic Workbench: a multisensory virtual environment , 1999, Electronic Imaging.

[6]  Scott T. Grafton,et al.  Involvement of visual cortex in tactile discrimination of orientation , 1999, Nature.

[7]  Joseph J. LaViola,et al.  Hands-free multi-scale navigation in virtual environments , 2001, I3D '01.

[8]  Greg Welch,et al.  Toward a compelling sensation of telepresence: demonstrating a portal to a distant (static) office , 2000 .

[9]  Bruno H. Repp,et al.  Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. , 2002, Journal of experimental psychology. Human perception and performance.