Importance masks for revealing occluded objects in augmented reality

When simulating "X-ray vision" in Augmented Reality, a critical aspect is ensuring correct perception of the occluded objects position. Naïve overlay rendering of occluded objects on top of real-world occluders can lead to a misunderstanding of the visual scene and a poor perception of the depth. We present a simple technique to enhance the perception of the spatial arrangements in the scene. An importance mask associated with occluders informs the rendering what information can be overlaid and what should be preserved. This technique is independent of scene properties such as illumination and surface properties, which may be unknown. The proposed solution is computed efficiently in a single-pass fragment shaders on the GPU.

[1]  Nassir Navab,et al.  Contextual Anatomic Mimesis Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[2]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[3]  Jens Schneider,et al.  ClearView: An Interactive Context Preserving Hotspot Visualization Technique , 2006, IEEE Transactions on Visualization and Computer Graphics.

[4]  Dieter Schmalstieg,et al.  Interactive Focus and Context Visualization for Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[5]  Dieter Schmalstieg,et al.  Comprehensible Visualization for Augmented Reality , 2009, IEEE Transactions on Visualization and Computer Graphics.

[6]  Victoria Interrante,et al.  Illustrating transparency: communicating the 3D shape of layered transparent surfaces via texture , 1996 .