A point-based approach to the interposition problem in augmented reality

An innovative solution to the interposition problem in augmented reality is presented. The realistic and physically-consistent embedding of a 3D virtual object (3DVO) into a real scene is accomplished by considering it as a set of points or vertices. Our method deals with stereoscopic views of an unstructured and unknown real scene and avoids explicit 3D reconstruction. Instead, we rely on local stereo matching to decide whether each vertex should be visible or not. After a geometrical analysis of the problem, we detail our solution and present preliminary results of interposition for 3DVOs and real scenes.

[1]  Geb Thomas,et al.  Virtual Tools for Supervisory and Collaborative Control of Robots , 1997, Presence: Teleoperators & Virtual Environments.

[2]  Ming Hou.  Surface effects on alignment of graphic and real objects in a stereoscopic augmented reality environment , 2001, CHI Extended Abstracts.

[3]  Marie-Odile Berger.  Resolving occlusion in augmented reality: a contour based approach without 3D reconstruction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Paul Milgram,et al.  Telerobotic control using augmented reality , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[5]  William B. Thompson,et al.  Visual Cues for Perceiving Distances from Objects to Surfaces , 2002, Presence: Teleoperators & Virtual Environments.

[6]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[7]  Bruce H. Thomas,et al.  Glove Based User Interaction Techniques for Augmented Reality in an Outdoor Environment , 2002, Virtual Reality.

[8]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[9]  Keith Cheverst,et al.  Experiences of developing and deploying a context-aware tourist guide: the GUIDE project , 2000, MobiCom '00.

[10]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[11]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[12]  Ronald Azuma,et al.  Making augmented reality work outdoors requires hybrid tracking , 1999 .

[13]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[14]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[15]  Bruce H. Thomas,et al.  Tinmith-Metro: new outdoor techniques for creating city models with an augmented reality wearable computer , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[16]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[17]  Axel Pinz.  Consistent Visual Information Processing Applied to Object Recognition Landmark Definition and Real-Time Tracking , 2001, VMV.

[18]  Michael Gervautz,et al.  Occlusion in collaborative augmented environments , 1999, Comput. Graph..

[19]  Geoffrey S. Hubona,et al.  The relative contributions of stereo, lighting, and background scenes in promoting 3D depth visualization , 1999, TCHI.

[20]  Laurent Moll,et al.  Real time correlation-based stereo: algorithm, implementations and applications , 1993 .

[21]  Matthias M. Wloka,et al.  Resolving occlusion in augmented reality , 1995, I3D '95.

[22]  Paul Milgram,et al.  Telerobotic control with stereoscopic augmented reality , 1996, Electronic Imaging.

[23]  Shumin Zhai,et al.  The partial-occlusion effect: utilizing semitransparency in 3D human-computer interaction , 1996, TCHI.

[24]  Hideyuki Tamura,et al.  A hybrid registration method for outdoor augmented reality , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[25]  Won S. Kim.  Computer vision assisted virtual reality calibration , 1999, IEEE Trans. Robotics Autom..

[26]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[27]  Daniel C. Robbins,et al.  Interactive shadows , 1992, UIST '92.

[28]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[30]  Jannick P. Rolland,et al.  A Survey of Tracking Technologies for Virtual Environments , 2001 .

[31]  Steven K. Feiner,et al.  Steps Toward Accommodating Variable Position Tracking Accuracy in a Mobile Augmented Reality System , 2001 .

[32]  David E. Breen,et al.  Interactive Occlusion and Automatic Object Placement for Augmented Reality , 1996, Comput. Graph. Forum.

[33]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[34]  David E. Breen,et al.  Confluence of Computer Vision and Interactive Graphies for Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[35]  Reinhold Behringer,et al.  Registration for outdoor augmented reality applications using computer vision techniques and hybrid sensors , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[36]  Suya You,et al.  Fusion of vision and gyro tracking for robust augmented reality registration , 2001, Proceedings IEEE Virtual Reality 2001.

[37]  Simon J. Julier,et al.  Authoring of physical models using mobile computers , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[38]  M. A. Snyder.  On the Mathematical Foundations of Smoothness Constraints for the Determination of Optical Flow and for Surface Reconstruction , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Douglas A. Bowman,et al.  Interaction Techniques For Common Tasks In Immersive Virtual Environments - Design, Evaluation, And , 1999 .

[40]  Alex Pentland,et al.  Realtime personal positioning system for a wearable computer , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[41]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[42]  A. Chapanis,et al.  Interposition as a Cue for the Perception of Relative Distance , 1953 .

[43]  Suya You,et al.  Natural Feature Tracking for Augmented Reality , 1999, IEEE Trans. Multim..

[44]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[45]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[46]  Ronald Azuma,et al.  Hybrid inertial and vision tracking for augmented reality registration , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[47]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[48]  Gregory D. Abowd,et al.  Cyberguide: A mobile context‐aware tour guide , 1997, Wirel. Networks.

[49]  Axel Pinz,et al.  A new optical tracking system for virtual and augmented reality applications , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[50]  Harvey S. Hecht,et al.  Perceiving pictures : An interdisciplinary approach to pictorial space , 2001 .