Hybrid Nodes with Sensors – Architecture for Interactive Distributed Mixed and Virtual Reality Environments

A distributed mixed-reality (MR) or virtual reality (VR) environment implies the cooperative engagement of a set of software and hardware resources. With the advances in sensors and computer networks we have seen an increase in the number of potential MR/VR applications that require large amounts of information from the real world collected through sensors (e.g. position and orientation tracking sensors). These sensors collect data from the real environment in real-time at different locations and a distributed environment connecting them must assure data distribution among collaborative sites at interactive speeds. With the advances in sensor technology, we envision that in future systems a significant amount of data will be collected from sensors and devices attached to the participating nodes This paper proposes a new architecture for sensor based interactive distributed MR/VR environments that falls inbetween the atomistic peer-to-peer model and the traditional client-server model. Each node is autonomous and fully manages its resources and connectivity. The dynamic behavior of the nodes is dictated by the human participants that manipulate the sensors attached to these nodes.

[1]  H Fuchs,et al.  Virtual environments technology to aid needle biopsies of the breast. An example of real-time data fusion. , 1996, Studies in health technology and informatics.

[2]  Sandeep K. Singhal,et al.  Log-based receiver-reliable multicast for distributed interactive simulation , 1995, SIGCOMM '95.

[3]  Michael Zyda,et al.  NPSNET: constructing a 3D virtual world , 1992, I3D '92.

[4]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[5]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[6]  Klara Nahrstedt,et al.  The QOS Broker , 1995, IEEE Multim..

[7]  Chris Greenhalgh,et al.  Inside MASSIVE-3: flexible support for data consistency and world structuring , 2000, CVE '00.

[8]  Jason Daly,et al.  Development of a training tool for endotracheal intubation: distributed augmented reality. , 2003, Studies in health technology and informatics.

[9]  Charles E. Hughes,et al.  Applying Mixed Reality to Entertainment , 2002, Computer.

[10]  M Fair,et al.  Atlas, a Platform for Distributed Graphics Applications , .

[11]  Sandeep K. Singhal,et al.  InVerse: Designing an interactive universe architecture for scalability and extensibility , 1997, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).

[12]  Sandeep K. Singhal,et al.  Exploiting Position History for Efficient Remote Rendering in Networked Virtual Reality , 1995, Presence: Teleoperators & Virtual Environments.

[13]  Philip Koopman,et al.  The Amaranth framework: Probabilistic, utility-based quality of service management for high-assurance computing , 1999, Proceedings 4th IEEE International Symposium on High-Assurance Systems Engineering.

[14]  Frank Biocca,et al.  Teleportal Augmented Reality System: Integrating Virtual Objects, Remote Collaborators, and Physical Reality for Distributed Networked Manufacturing , 2004 .

[15]  Felix G. Hamza-Lup,et al.  Adaptive scene synchronization for virtual and mixed reality environments , 2004, IEEE Virtual Reality 2004.

[16]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[17]  D. C. Miller,et al.  SIMNET: the advent of simulator networking , 1995, Proc. IEEE.

[18]  Steve Pettifer,et al.  DEVA3: architecture for a large-scale distributed virtual reality system , 2000, VRST '00.

[19]  Deborah Hix,et al.  An Augmented Reality System for Military Operations in Urban Terrain , 2002 .

[20]  Steven K. Feiner,et al.  A distributed 3D graphics library , 1998, SIGGRAPH.

[21]  William Ribarsky,et al.  Evaluation of the effects of frame time variation on VR task performance , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[22]  Glenn A. Martin,et al.  VESS: coordinating graphics, audio, and user interaction in virtual reality applications , 2002, Proceedings IEEE Virtual Reality 2002.

[23]  Lixia Zhang,et al.  Resource ReSerVation Protocol (RSVP) - Version 1 Functional Specification , 1997, RFC.

[24]  D. Schmalstieg,et al.  Distributed applications for collaborative augmented reality , 2002, Proceedings IEEE Virtual Reality 2002.

[25]  Farhad Arbab,et al.  Sixth Eurographics Workshop on Programming Paradigms in Graphics (WPPG97) , 1998 .

[26]  Steven K. Feiner,et al.  Augmented Reality in Architectural Construction, Inspection, and Renovation , 1996 .

[27]  Larry S. Davis,et al.  Enabling a Continuum of Virtual Environment Experiences , 2003, IEEE Computer Graphics and Applications.

[28]  P.M. Sharkey,et al.  A local perception filter for distributed virtual environments , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[29]  Hideyuki Tamura,et al.  Overview and Final Results of the MR Project , 2001 .

[30]  Michael Zyda,et al.  Exploiting reality with multicast groups , 1995, IEEE Computer Graphics and Applications.

[31]  Henrik Tramberend,et al.  Avocado: a distributed virtual reality framework , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).