Occlusion in augmented reality

Augmented reality in video-based display simply overlay virtual objects on real environment. In many cases this does not represent the actual situation in AR scene. When a real object supposes to occlude a virtual object, the augmented image may cause confusion in users' perception. This incorrect display contributes to misconceptions and wrong operations of task amongst users. The scenario of occlusion in AR application is discussed in this paper. Next, the main method used by other researchers to resolve occlusion problem was discussed. This is followed by a discussion about dependency factors and characteristics that influence the selection of occlusion handling approach and a comparison between a model-based and depth-based approach. Finally, a conclusion and proposed work are presented.

[1]  Haslina Arshad,et al.  Binary search tree traversal for Arrick Robot virtual assembly training module , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[2]  Jiejie Zhu,et al.  Handling occlusions in video‐based augmented reality using depth information , 2010, Comput. Animat. Virtual Worlds.

[3]  G. Baratoff,et al.  Detecting dynamic occlusion in front of static backgrounds for AR scenes , 2003, IPT/EGVE.

[4]  Michael Alexander Bajura,et al.  Merging real and virtual environments with video see-through head-mounted displays , 1997 .

[5]  Didier Stricker,et al.  Augmented Reality for Exterior Construction Applications , 2001 .

[6]  Mikko Sairio.  1 Augmented Reality , 2001 .

[7]  Dirk Bartz,et al.  Occlusion handling for medical augmented reality using a volumetric phantom model , 2004, VRST '04.

[8]  Yan Feng,et al.  Realization of Multilayer Occlusion between Real and Virtual Scenes in Augmented Reality , 2006, 2006 10th International Conference on Computer Supported Cooperative Work in Design.

[9]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[10]  Rajeev Sharma,et al.  Computer vision and augmented reality for guiding assembly , 2002 .

[11]  Amir H. Behzadan.  ARVISCOPE: Georeferenced Visualization of Dynamic Construction Processes in Three-Dimensional Outdoor Augmented Reality. , 2008 .

[12]  Junfeng Wang,et al.  Occlusion Handling in Augmented Reality System for Human-Assisted Assembly Task , 2008, ICIRA.

[13]  Gudrun Klinker,et al.  Augmented Reality: A Problem in Need of Many Computer Vision-Based Solutions , 2000, Confluence of Computer Vision and Computer Graphics.

[14]  Naokazu Yokoya,et al.  Passive Range Sensing Techniques: Depth from Images , 1999 .

[15]  Dieter Schmalstieg,et al.  Visual tracking for Augmented Reality , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[16]  Gérald Bianchi,et al.  Exploration of augmented reality technology for surgical training simulators , 2007 .

[17]  Vincent Lepetit,et al.  A semi-automatic method for resolving occlusion in augmented reality , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[18]  Michael Gervautz,et al.  Occlusion in collaborative augmented environments , 1999, Comput. Graph..

[19]  Kevin Michael Baird.  EVALUATING THE EFFECTIVENESS OF AUGMENTED REALITY AND WEARABLE COMPUTING FOR A MANUFACTURING ASSEMBLY TASK , 1999 .

[20]  Sun Hanxu,et al.  Research on fast and accurate occlusion detection technology of augmented reality system , 2008, 2008 6th IEEE International Conference on Industrial Informatics.

[21]  Cheng Wang,et al.  Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach , 2010, Sensors.

[22]  Jiejie Zhu,et al.  Occlusion registration in video-based augmented reality , 2008, VRCAI '08.

[23]  Donggang Yu,et al.  A Useful Visualization Technique: A Literature Review for Augmented Reality and its Application, limitation & future direction , 2009, VINCI.

[24]  Didier Stricker,et al.  The Use of Reality Models in Augmented Reality Applications , 1998, SMILE.

[25]  Vineet R. Kamat,et al.  Scalable Algorithm for Resolving Incorrect Occlusion in Dynamic Augmented Reality Engineering Environments , 2010, Comput. Aided Civ. Infrastructure Eng..

[26]  David E. Breen,et al.  Interactive Occlusion and Collision of Real and Virtual Objects in Augmented Reality , 2000 .

[27]  Yan Wang,et al.  Object Tracking with Appearance-based Kalman Particle Filter in Presence of Occlusions , 2009, 2009 WRI Global Congress on Intelligent Systems.

[28]  Patrick Hébert,et al.  Handling Occlusions in Real-time Augmented Reality : Dealing with Movable Real and Virtual Objects , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[29]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[30]  Shogo Nishida,et al.  Occlusion detection of real objects using contour based stereo matching , 2005, ICAT '05.

[31]  Christopher M. Brown,et al.  Interactive Augmented Reality , 1998 .

[32]  M. Fiala.  Dark Matter Method for Correct Augmented Reality Occlusion Relationships , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).

[33]  Matthias M. Wloka,et al.  Resolving occlusion in augmented reality , 1995, I3D '95.

[34]  Yuan Shen,et al.  Key Technique of Assembly System in an Augmented Reality Environment , 2010, 2010 Second International Conference on Computer Modeling and Simulation.

[35]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[36]  Jan Fischer,et al.  Using time-of-flight range data for occlusion handling in augmented reality , 2007, EGVE'07.

[37]  Marie-Odile Berger.  Resolving occlusion in augmented reality: a contour based approach without 3D reconstruction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.