Virtual ads insertion in street building views for augmented reality

This paper is proposing a new framework of virtual ads insertion for Augmented Reality (AR) in a specific real scene, building facades of the street view videos. In this framework, specific region detection, camera orientation estimation, visual tracking, motion filtering and virtual-real blending are discussed. For the building façade, vanishing points are fully identified to detect a rectangular planar structure. Meanwhile, dynamic registration and color harmonization are designed to improve visual acuity of virtual ads insertion. Experimental results are given to show the good performance of the proposed framework.

[1]  Ja-Ling Wu,et al.  Virtual spotlighted advertising for tennis videos , 2010, J. Vis. Commun. Image Represent..

[2]  Xin Li,et al.  Video Processing Via Implicit and Mixture Motion Models , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Marcelo Gattass,et al.  Insertion of Three-Dimensional Objects in Architectural Photos , 2002, WSCG.

[4]  Alexandre R. J. François,et al.  Real-Time Billboard Substitution in a Video Stream , 1999 .

[5]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  Jana Kosecka,et al.  Extraction, matching and pose recovery based on dominant rectangular structures , 2003, HLK.

[8]  Changsheng Xu,et al.  Robust goal-mouth detection for virtual content insertion , 2003, MULTIMEDIA '03.

[9]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Changsheng Xu,et al.  A generic virtual content insertion system based on visual attention analysis , 2008, ACM Multimedia.

[11]  Jean-Philippe Tardif,et al.  Non-iterative approach for fast and accurate vanishing point detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[12]  Subhasis Chaudhuri,et al.  Automated Billboard Insertion in Video , 2007, ACCV.

[13]  Wei Zhang,et al.  Extraction, matching and pose recovery based on dominant rectangular structures , 1989, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..