Mixed Reality: A Survey

A multi-point-to-point conferencing system comprising a plurality of terminals connected by a network including data and control channels is disclosed. In a particular embodiment, the network is an Integrated Services Digital Network (ISDN) having data (B) channels and a control (D) channel. The conference is established in a manner that does not waste connection setup attempts or data channel connect time by attempting to establish a conference when a participating terminal does not have the necessary data channels available. The terminal initiating the conference communicates with at least one participating terminal to determine the use status, or availability, of the required number of data channels. If a participating terminal decides to join the conference, either automatically or through user confirmation, the participating terminal (1) reserves the required data channels for a limited time such that connection requests are only accepted from conference terminals and (2) communicates its decision to the initiating terminal. Now knowing that data channel connections can be successfully established between those terminals ready to participate, the initiating terminal initiates a conference using normal multi-point-to-point connection procedures.

[1]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[2]  Mark Billinghurst,et al.  Communication Behaviors in Colocated Collaborative AR Interfaces , 2003, Int. J. Hum. Comput. Interact..

[3]  Jae Yeol Lee,et al.  Context-aware 3D visualization and collaboration services for ubiquitous cars using augmented reality , 2008 .

[4]  Bruce H. Thomas,et al.  First Person Indoor/Outdoor Augmented Reality Application: ARQuake , 2002, Personal and Ubiquitous Computing.

[5]  Luc Van Gool,et al.  Blue-c: a spatially immersive display and 3D video portal for telepresence , 2003, IPT/EGVE.

[6]  Morten Fjeld,et al.  Usability and collaborative aspects of augmented reality , 2004, INTR.

[7]  Martin Bauer,et al.  Fata Morgana - a presentation system for product design , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[8]  Paul Dourish,et al.  Where the action is , 2001 .

[9]  David Renshaw,et al.  1st European Conference on Visual Media Production (CVMP) , 2004 .

[10]  Philippe C. Cattin,et al.  Camera-marker alignment framework and comparison with hand-eye calibration for augmented reality applications , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[11]  Michael Harrington,et al.  Constellation: a wide-range wireless motion-tracking system for augmented reality and virtual set applications , 1998, SIGGRAPH.

[12]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[13]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[14]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[15]  K. Satoh,et al.  A hybrid and linear registration method utilizing inclination constraint , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[16]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[17]  Andreas M. Kunz,et al.  HoloPort - A Device for Simultaneous Video and Data Conferencing Featuring Gaze Awareness , 2006, IEEE Virtual Reality Conference (VR 2006).

[18]  Bruce H. Thomas,et al.  A wearable computer system with augmented reality to support terrestrial navigation , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[19]  Anthony Steed Supporting Mobile Applications with Real-Time Visualisation of GPS Availability , 2004, Mobile HCI.

[20]  I.A. Getting,et al.  Perspective/navigation-The Global Positioning System , 1993, IEEE Spectrum.

[21]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[22]  T. Alt,et al.  Augmented Reality for manufacturing planning , 2003, IPT/EGVE.

[23]  Katashi Nagao,et al.  The world through the computer: computer augmented interaction with real world environments , 1995, UIST '95.

[24]  Morten Fjeld,et al.  Tangible user interface for chemistry education: comparative evaluation and re-design , 2007, CHI.

[25]  Taku Komura,et al.  Computing inverse kinematics with linear programming , 2005, VRST '05.

[26]  Michael Gervautz,et al.  Collaborative gaming in augmented reality , 1998, VRST '98.

[27]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[28]  Nicholas Ayache,et al.  Medical Image Analysis: Progress over Two Decades and the Challenges Ahead , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Andreas Kunz,et al.  Digital support for net-based teamwork in early design stages , 2007 .

[30]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[31]  Claudio S. Pinhanez Augmenting Reality with Projected Interactive Displays , 2001 .

[32]  Enrico Costanza,et al.  A Region Adjacency Tree Approach to the Detection and Design of Fiducials , 2003, VVG.

[33]  Bruce H. Thomas,et al.  Outdoor Augmented Reality Gaming on Five Dollars a Day , 2005, AUIC.

[34]  Andreas Kunz,et al.  Proceedings of the workshop on Virtual environments 2003 , 2003 .

[35]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Wei Liu,et al.  Human Pacman: a mobile wide-area entertainment system based on physical, social, and ubiquitous computing , 2004, ACE '04.

[37]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[38]  Gábor Székely,et al.  High Precision Augmented Reality Haptics , 2006 .

[39]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[40]  William E. Lorensen,et al.  Enhancing reality in the operating room , 1993, Proceedings Visualization '93.

[41]  Didier Stricker,et al.  Augmented reality for construction tasks: doorlock assembly , 1999 .

[42]  Steven K. Feiner,et al.  Information filtering for mobile augmented reality , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[43]  Olaf Oehme,et al.  Augmented Reality (AR) for Assembly Processes Design and Experimental Evaluation , 2003, Int. J. Hum. Comput. Interact..

[44]  Morten Fjeld,et al.  Physical and Virtual Tools: Activity Theory Applied to the Design of Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[45]  Jun Rekimoto,et al.  NaviCam:A Magnifying Glass Approach to Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[46]  Alex Olwal,et al.  Spatial augmented reality on industrial CNC-machines , 2008, Electronic Imaging.

[47]  Oliver Bimber,et al.  Video see-through AR on consumer cell-phones , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[48]  Alex Olwal,et al.  LightSense: enabling spatially aware handheld interaction devices , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[49]  George Papagiannakis,et al.  Real-time virtual humans in AR sites , 2004 .

[50]  Georges M. Fadel,et al.  Towards Collaboration in Engineering of Tomorrow - Building highly interactive Distributed Collaboration Platforms , 2006 .

[51]  J. Edward Swan,et al.  Survey of User-Based Experimentation in Augmented Reality , 2005 .

[52]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[53]  Dieter Schmalstieg,et al.  MonkeyBridge: autonomous agents in augmented reality games , 2005, ACE '05.

[54]  Henry Fuchs,et al.  Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms , 2002, Medical Image Anal..

[55]  Mark Weiser,et al.  Some computer science issues in ubiquitous computing , 1993, CACM.

[56]  Helmut Krueger,et al.  Activity theory and the practice of design: evaluation of a collaborative tangible user interface , 2004 .

[57]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[58]  C Bungert HMD/headset/VR-helmet Comparison Chart , 2005 .

[59]  Ruigang Yang,et al.  Remote 3D medical consultation , 2005, 2nd International Conference on Broadband Networks, 2005..

[60]  Ivan Poupyrev,et al.  The MagicBook: a transitional AR interface , 2001, Comput. Graph..

[61]  Ronald Azuma,et al.  A frequency-domain analysis of head-motion prediction , 1995, SIGGRAPH.

[62]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[63]  Tsuneo Yoshikawa,et al.  Accurate image overlay on video see-through HMDs using vision and accelerometers , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).