Efficient Verification of Holograms Using Mobile Augmented Reality

Paper documents such as passports, visas and banknotes are frequently checked by inspection of security elements. In particular, optically variable devices such as holograms are important, but difficult to inspect. Augmented Reality can provide all relevant information on standard mobile devices. However, hologram verification on mobiles still takes long and provides lower accuracy than inspection by human individuals using appropriate reference information. We aim to address these drawbacks by automatic matching combined with a special parametrization of an efficient goal-oriented user interface which supports constrained navigation. We first evaluate a series of similarity measures for matching hologram patches to provide a sound basis for automatic decisions. Then a re-parametrized user interface is proposed based on observations of typical user behavior during document capture. These measures help to reduce capture time to approximately 15 s with better decisions regarding the evaluated samples than what can be achieved by untrained users.

[1]  Steven K. Feiner,et al.  ParaFrustum: visualization techniques for guiding a user to a constrained set of viewing positions and orientations , 2014, UIST.

[2]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[3]  Tae-Hyoung Park,et al.  An automatic inspection system for hologram with multiple patterns , 2007, SICE Annual Conference 2007.

[4]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[5]  Tapio Seppänen,et al.  Watermark Recovery from a Dual Layer Hologram with a Digital Camera , 2011, SCIA.

[6]  Abhilash Pandya,et al.  Improved Telemanipulator Navigation During Display-Control Misalignments Using Augmented Reality Cues , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[8]  Dieter Schmalstieg,et al.  Mobile user interfaces for efficient verification of holograms , 2015, 2015 IEEE Virtual Reality (VR).

[9]  Jan Owsik,et al.  A Wiener filter based correlation method intended to evaluate effectiveness of holographic security devices , 2003 .

[10]  Heiko Hirschmüller,et al.  Evaluation of Stereo Matching Costs on Images with Radiometric Differences , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Frank Biocca,et al.  Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms , 2006, CHI.

[12]  Lai-Man Po,et al.  Edge-Based Structural Similarity for Image Quality Assessment , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[13]  Andrew J. Davison,et al.  Real-time surface light-field capture for augmentation of planar specular surfaces , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[14]  Baining Guo,et al.  Pocket reflectometry , 2011, SIGGRAPH 2011.

[15]  Cafer Ozkul,et al.  Application of wavelet transform to hologram analysis: three-dimensional location of particles , 2000 .

[16]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[17]  Jun Shingu,et al.  Camera pose navigation using Augmented Reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[18]  Gerhard Reitmayr,et al.  Rectangular target extraction for mobile augmented reality applications , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[19]  Matthew W. Gilbertson,et al.  Computer-guided ultrasound probe realignment by optical tracking , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[20]  Reinhold Huber-Mörk,et al.  Analysis of optically variable devices using a photometric light-field approach , 2015, Electronic Imaging.

[21]  Dieter Schmalstieg,et al.  Mobile interactive hologram verification , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[22]  Tae-Hyoung Park,et al.  Vision inspection system for holograms with mixed patterns , 2010, 2010 IEEE International Conference on Automation Science and Engineering.

[23]  Dieter Schmalstieg,et al.  Client-side mobile visual search , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[24]  Frédo Durand,et al.  Computational rephotography , 2010, TOGS.

[25]  Thomas J. Naughton,et al.  Stereo vision based approach for extracting features from digital holograms , 2009 .

[26]  F. Portheine,et al.  User-interactive registration of bone with A-mode ultrasound , 2005, IEEE Engineering in Medicine and Biology Magazine.

[27]  Dieter Schmalstieg,et al.  AR-Based Hologram Detection on Security Documents Using a Mobile Phone , 2014, ISVC.

[28]  C. J. Harwood,et al.  Optical Document Security , 1998 .

[29]  John M. Snyder,et al.  Manifold bootstrapping for SVBRDF capture , 2010, ACM Trans. Graph..