Scalable Algorithm for Resolving Incorrect Occlusion in Dynamic Augmented Reality Engineering Environments

@Augmented reality (AR) offers significant potential in construction, manufacturing, and other en- gineering disciplines that employ graphical visualization to plan and design their operations. As a result of intro- ducing real-world objects into the visualization, less vir- tual models have to be deployed to create a realistic visual output that directly translates into less time and effort re- quired to create, render, manipulate, manage, and update three-dimensional (3D) virtual contents (CAD model en- gineering) of the animated scene. At the same time, us- ing the existing layout of land or plant as the background of visualization significantly alleviates the need to collect data about the surrounding environment prior to creat- ing the final visualization while providing visually con- vincing representations of the processes being studied. In an AR animation, virtual and real objects must be simultaneously managed and accurately displayed to a user to create a visually convincing illusion of their co- existence and interaction. A critical challenge impeding this objective is the problem of incorrect occlusion that manifests itself when real objects in an AR scene par- tially or wholly block the view of virtual objects. In the ∗ To whom correspondence should be addressed. E-mail: vkamat

[1]  Carlos H. Caldas,et al.  Experiments in real-time spatial data acquisition for obstacle detection , 2005 .

[2]  Frederick P. Brooks What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[3]  Amir H. Behzadan ARVISCOPE: Georeferenced Visualization of Dynamic Construction Processes in Three-Dimensional Outdoor Augmented Reality. , 2008 .

[4]  Vineet R. Kamat VITASCOPE: Extensible and Scalable 3D Visualization of Simulated Construction Operations , 2003 .

[5]  Holger Regenbrecht,et al.  Detecting Dynamic Occlusion in front of Static Backgrounds for AR Scenes , 2003, IPT/EGVE.

[6]  Carlos H. Caldas,et al.  Real-Time 3D Modeling for Accelerated and Safer Construction Using Emerging Technology , 2005 .

[7]  Christo Panchev,et al.  Occlusion, attention and object representations , 2006, Integr. Comput. Aided Eng..

[8]  Daniel Thalmann,et al.  Motion Control in Animation, Simulation and Visualization * , 1989 .

[9]  Emmanuel Dubois,et al.  Augmented reality: which augmentation for which reality? , 2000, DARE '00.

[10]  Matthias M. Wloka,et al.  Resolving occlusion in augmented reality , 1995, I3D '95.

[11]  Vineet R. Kamat,et al.  Interactive Augmented Reality Visualization for Improved Damage Prevention and Maintenance of Underground Infrastructure , 2009 .

[12]  Steven K. Feiner,et al.  Augmented Reality in Architectural Construction, Inspection, and Renovation , 1996 .

[13]  Carlos H. Caldas,et al.  Real-Time Three-Dimensional Occupancy Grid Modeling for the Detection and Tracking of Construction Resources , 2007 .

[14]  Hojjat Adeli,et al.  A New Approach for Health Monitoring of Structures: Terrestrial Laser Scanning , 2007, Comput. Aided Civ. Infrastructure Eng..

[15]  Augusto Op den Bosch Design/construction processes simulation in real-time object-oriented environments , 1994 .

[16]  Matthew W. Rohrer Seeing is believing: the importance of visualization in manufacturing simulation , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[17]  Dirk Langer,et al.  Imaging Ladar for 3-D Surveying and CAD Modeling of Real-World Environments , 2000, Int. J. Robotics Res..

[18]  Vincent Lepetit,et al.  A semi-automatic method for resolving occlusion in augmented reality , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Yan Feng,et al.  Realization of Multilayer Occlusion between Real and Virtual Scenes in Augmented Reality , 2006, 2006 10th International Conference on Computer Supported Cooperative Work in Design.

[20]  Vineet R. Kamat,et al.  Automated Generation of Operations Level Construction Animations in Outdoor Augmented Reality , 2009 .

[21]  W. Sardha Wijesoma,et al.  Road-boundary detection and tracking using ladar sensing , 2004, IEEE Transactions on Robotics and Automation.

[22]  Deborah Hix,et al.  An Augmented Reality System for Military Operations in Urban Terrain , 2002 .

[23]  Vineet R. Kamat,et al.  General-purpose modular hardware and software framework for mobile outdoor augmented reality applications in engineering , 2008, Adv. Eng. Informatics.

[24]  Patrick Hébert,et al.  Handling Occlusions in Real-time Augmented Reality : Dealing with Movable Real and Virtual Objects , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[25]  Michael Gervautz,et al.  Occlusion in collaborative augmented environments , 1999, Comput. Graph..

[26]  Vineet R. Kamat,et al.  Georeferenced Registration of Construction Graphics in Mobile Outdoor Augmented Reality , 2007 .

[27]  Bruce H. Thomas,et al.  ARQuake: an outdoor/indoor augmented reality first person application , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[28]  David E. Breen,et al.  Interactive Occlusion and Collision of Real and Virtual Objects in Augmented Reality , 2000 .

[29]  John L. Bishop,et al.  General Purpose Visual Simulation System: A functional description , 1990, 1990 Winter Simulation Conference Proceedings.

[30]  Patrick Dähne,et al.  Design and implementation of a mobile device for outdoor augmented reality in the archeoguide project , 2001, VAST '01.

[31]  Tsutomu Miyasato,et al.  A palmtop display for dextrous manipulation with haptic sensation , 1996, CHI.

[32]  Martin R. Barnes An introduction to QUEST , 1997, WSC '97.

[33]  M. W. Rohrer,et al.  Simulating reality using AutoMod , 2002, Proceedings of the Winter Simulation Conference.