Tangible authoring of 3D virtual scenes in dynamic augmented reality environment

This paper proposes tangible interfaces and interactions for authoring 3D virtual and immersive scenes easily and intuitively in tangible augmented reality (AR) environment. It provides tangible interfaces for manipulating virtual objects in a natural and intuitive manner and supports adaptive and accurate vision-based tracking in AR environments. In particular, RFID is used to directly integrate physical objects with virtual objects and to systematically support the tangible query of the relation between physical objects and virtual ones, which can provide more intuitive tangibility and a new way of virtual object manipulation. Moreover, the proposed approach offers an easy and intuitive switching mechanism between tangible environment and virtual environment. This paper also proposes a context-adaptive marker tracking method which can remove an inconsistent problem while embedding virtual objects into physical ones in tangible AR environments. The context-adaptive tracking method not only adjusts the locations of invisible markers by interpolating the locations of existing reference markers and those of previous ones, but also removes a jumping effect of movable virtual objects when their references are changed from one marker to another. Several case studies for generating tangible virtual scenes and comparison with previous work are given to show the effectiveness and novelty of the proposed approach.

[1]  Hyungjun Park,et al.  Tangible augmented prototyping of digital handheld products , 2009, Comput. Ind..

[2]  M. Fiorentino,et al.  Tangible digital master for product lifecycle management in augmented reality , 2009 .

[3]  Jiejie Zhu,et al.  Virtual Reality and Mixed Reality for Virtual Learning Environments , 2006, Edutainment.

[4]  E. Munoko,et al.  Computers in Industry , 1963, Nature.

[5]  Michael A. Terry,et al.  Jump: a system for interactive, tangible queries of paper , 2007, GI '07.

[6]  Jürgen Gausemeier,et al.  AR-Planning Tool - Designing Flexible Manufacturing Systems with Augmented Reality , 2002, EGVE.

[7]  Hirokazu Kato,et al.  3D live: real time captured content for mixed reality , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[8]  Soh-Khim Ong,et al.  Virtual and Augmented Reality Applications in Manufacturing , 2004, MIM.

[9]  Paul Coulton,et al.  PAC-LAN: mixed-reality gaming with RFID-enabled mobile phones , 2006, CIE.

[10]  Peter Ørbæk,et al.  Physical hypermedia: Augmenting physical material with hypermedia structures , 2003, New Rev. Hypermedia Multim..

[11]  Andrew Y. C. Nee,et al.  Virtual Reality and Augmented Reality Applications in Manufacturing , 2004 .

[12]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[13]  Sung-Hoon Hong,et al.  Authoring Personal Virtual Studio Using Tangible Augmented Reality , 2008 .

[14]  Mark Billinghursta,et al.  COLLABORATION WITH TANGIBLE AUGMENTED REALITY INTERFACES , 2002 .

[15]  Wolfgang Niem,et al.  A Virtual Studio for Live Broadcasting: The Mona Lisa Project , 1996, IEEE Multim..

[16]  Nobuyuki Yagi,et al.  Desktop virtual studio system , 1996 .

[17]  Christian Floerkemeier,et al.  Issues with RFID Usage in Ubiquitous Computing Applications , 2004, Pervasive.

[18]  Sung-Ju Lee,et al.  CDNs for Personal Broadcasting and Individualized Reception , 2002 .

[19]  N. Kim,et al.  3-D Virtual Studio for Natural Inter-“Acting” , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[21]  T. Alt,et al.  Augmented Reality for manufacturing planning , 2003, IPT/EGVE.

[22]  Kwangsoo Kim,et al.  A distributed product development architecture for engineering collaborations across ubiquitous virtual enterprises , 2007 .