Geometric Modifications Applied to Real Elements in Augmented Reality

augmented reality applications overlap virtual objects over a real scene considering the context. Today, more advanced applications also make use of diminished reality, which removes real objects from a scene. This paper describes a novel approach that combines augmented reality and diminished reality techniques to modify real objects in augmented reality applications. The proposed approach removes an object and replaces it with its purposely-modified replica. The solution uses dynamic texture techniques and inpaint to enhance the visual response of the performed modification. The results are promising considering both realism of the modified real object and performance of the application.

[1]  Wolfgang Broll,et al.  Advanced self-contained object removal for realizing real-time Diminished Reality in unconstrained environments , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[2]  Veronica Teichrieb,et al.  Photorealistic rendering for Augmented Reality: A global illumination and BRDF solution , 2010, 2010 IEEE Virtual Reality Conference (VR).

[3]  Kazuhiro Otsuka,et al.  Real-time Visual Tracker by Stream Processing , 2009, J. Signal Process. Syst..

[4]  Hideo Saito,et al.  Online video synthesis for removing occluding objects using multiple uncalibrated cameras via plane sweep algorithm , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[5]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[7]  Scott E. Hudson,et al.  Moveable interactive projected displays using projector based tracking , 2005, UIST.

[8]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[9]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  J. Lima,et al.  APPLICATIONS IN ENGINEERING USING AUGMENTED REALITY TECHNOLOGY , 2008 .

[11]  Veronica Teichrieb,et al.  Illumination Techniques for Photorealistic Rendering in Augmented Reality , 2008 .

[12]  J. Kelner,et al.  miva: Constructing a Wearable Platform Prototype , 2007 .

[13]  R. Takei,et al.  Image Inpainting with the Navier-Stokes Equations , 2005 .

[14]  Charles E. Hughes,et al.  Spatial Augmented Reality , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[15]  P. Bose,et al.  Machine Vision and Applications DOI 10.1007/s00138-007-0108-9 ORIGINAL PAPER Augmented reality on cloth with realistic illumination , 2022 .