Marker Hiding Methods: Applications in Augmented Reality

In augmented reality, the markers are noticeable by their simple design of a rectangular image with black and white areas that disturb the reality of the overall view. As the markerless techniques are not usually robust enough, hiding the markers has a valuable usage, which many researchers have focused on. Categorizing the marker hiding methods is the main motivation of this study, which explains each of them in detail and discusses the advantages and shortcomings of each. The main ideas, enhancements, and future works of the well-known techniques are also comprehensively summarized and analyzed in depth. The main goal of this study is to provide researchers who are interested in markerless or hiding-marker methods an easier approach for choosing the method that is best suited to their aims. This work reviews the different methods that hide the augmented reality marker by using information from its surrounding area. These methods have considerable differences in their smooth continuation of the textures that hide the marker area as well as their performance to hide the augmented reality marker in real time. It is also hoped that our analysis helps researchers find solutions to the drawbacks of each method.

[1]  Folkmar Bornemann,et al.  Fast Image Inpainting Based on Coherence Transport , 2007, Journal of Mathematical Imaging and Vision.

[2]  Naokazu Yokoya,et al.  [Paper] Diminished Reality for AR Marker Hiding Based on Image Inpainting with Reflection of Luminance Changes , 2013 .

[3]  David Tschumperlé,et al.  Fast Anisotropic Smoothing of Multi-Valued Images using Curvature-Preserving PDE's , 2006, International Journal of Computer Vision.

[4]  Kyungdahm Yun.  Patch-based Texture Synthesis for Marker Concealment , 2007 .

[5]  H. Saito,et al.  Diminished Reality using Multiple Handheld Cameras , 2007 .

[6]  Charles Woodward,et al.  Augmented interiors with digital camera images , 2006, AUIC.

[7]  P. Sengottuvelan,et al.  Combined Structure and Texture Image Inpainting Algorithm for Natural Scene Image Completion , 2011 .

[8]  Daut Daman,et al.  Close Spanning Tree (CST) Approach for Error Detection and Correction for 2D CAD Drawing , 2010 .

[9]  Borko Furht,et al.  Handbook of Augmented Reality , 2011 .

[10]  Yongtian Wang,et al.  Infrared Marker Based Augmented Reality System for Equipment Maintenance , 2008, 2008 International Conference on Computer Science and Software Engineering.

[11]  Naokazu Yokoya,et al.  AR marker hiding based on image inpainting and reflection of illumination changes , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[12]  Amjad Rehman,et al.  Neural networks for document image preprocessing: state of the art , 2014, Artificial Intelligence Review.

[13]  Habibollah Haron,et al.  Improved vertex chain code based mapping algorithm for curve length estimation , 2011 .

[14]  Wolfgang Broll,et al.  Advanced self-contained object removal for realizing real-time Diminished Reality in unconstrained environments , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[15]  Mohd Shahrizal Sunar,et al.  Covering photo-realistic properties of outdoor components with the effects of sky color in mixed reality , 2013, Multimedia Tools and Applications.

[16]  Miika Aittala,et al.  Light-weight marker hiding for augmented reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[17]  Naokazu Yokoya,et al.  Image Inpainting Considering Brightness Change and Spatial Locality of Textures , 2009, VISAPP.

[18]  Sanni Siltanen,et al.  Texture generation over the marker area , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[19]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[20]  V. Lepetit,et al.  An intuitive tool for outlining objetcs in video sequences: applications to augmented and diminished reality , 2001 .

[21]  Blair MacIntyre,et al.  A non-photorealistic rendering framework with temporal coherence for augmented reality , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[22]  Modified Image Exemplar-Based Inpainting , 2013 .

[23]  Mohd Shahrizal Sunar,et al.  Survey of Shadow Volume Algorithms in Computer Graphics , 2013 .

[24]  Hebert Pérez-Rosés,et al.  Jittering Reduction in Marker-Based Augmented Reality Systems , 2006, ICCSA.

[25]  Nassir Navab,et al.  Multiview paraperspective projection model for diminished reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[26]  J. Charles,et al.  A Sino-German λ 6 cm polarization survey of the Galactic plane I . Survey strategy and results for the first survey region , 2006 .

[27]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[28]  Wei Liu,et al.  Social and physical interactive paradigms for mixed-reality entertainment , 2006, CIE.

[29]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[30]  Amjad Rehman,et al.  Improved quadtree image segmentation approach to region information , 2014 .

[31]  Miika Aittala,et al.  Inverse lighting and photorealistic rendering for augmented reality , 2010, The Visual Computer.

[32]  Adrian David Cheok,et al.  Designing a Mixed Reality Intergenerational Entertainment System , 2010, The Engineering of Mixed Reality Systems.

[33]  Amjad Rehman,et al.  Medical Image Segmentation Methods, Algorithms, and Applications , 2014 .

[34]  Hirokazu Kato,et al.  3-D live: real time interaction for mixed reality , 2002, CSCW '02.

[35]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Dzulkifli Mohamad,et al.  Discriminative Features Mining for Offline Handwritten Signature Verification , 2014 .

[37]  Dzulkifli Mohammad.  Digital watermarking for images security using discrete slantlet transform , 2014 .

[38]  Hideo Saito,et al.  Diminished reality using plane-sweep algorithm with weakly-calibrated cameras , 2010 .

[39]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[40]  Paul Harrison,et al.  A Non-Hierarchical Procedure for Re-Synthesis of Complex Textures , 2001, WSCG.

[41]  Ross T. Smith,et al.  Handbook of Augmented Reality , 2011 .

[42]  Naokazu Yokoya,et al.  Wearable augmented reality system using invisible visual markers and an IR camera , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[43]  Habibollah Haron,et al.  Parameterization Method on B-Spline Curve , 2012 .

[44]  Amjad Rehman,et al.  Features extraction for soccer video semantic analysis: current achievements and remaining issues , 2012, Artificial Intelligence Review.

[45]  Mohd Shahrizal Sunar,et al.  A quadratic spline approximation using detail multi-layer for soft shadow generation in augmented reality , 2013, Multimedia Tools and Applications.

[46]  Rehman,et al.  Video motion perception using optimized Gabor filter , 2011 .

[47]  Anil C. Kokaram.  Parametric texture synthesis for filling holes in pictures , 2002, Proceedings. International Conference on Image Processing.

[48]  Anupam,et al.  Fast and Enhanced Algorithm for Exemplar Based Image Inpainting , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[49]  RehmanAmjad,et al.  Neural networks for document image preprocessing , 2014 .

[50]  Guang-Zhong Yang,et al.  pq-space Based Non-Photorealistic Rendering for Augmented Reality , 2007, MICCAI.

[51]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Amjad Rehman,et al.  Evaluation of artificial intelligent techniques to secure information in enterprises , 2012, Artificial Intelligence Review.

[53]  Veronica Teichrieb,et al.  Photorealistic rendering for Augmented Reality: A global illumination and BRDF solution , 2010, 2010 IEEE Virtual Reality Conference (VR).