AdOn: toward contextual overlay in-video advertising

This paper presents a contextual video advertising system, called AdOn, which supports intelligent overlay in-video advertising. Unlike most current ad-networks such as Youtube that overlay the ads at fixed locations in the videos (e.g., on the bottom fifth of videos 15 s in), AdOn is able to automatically detect a set of spatio-temporal non-intrusive locations and associate the contextually relevant ads with these locations. The overlay ad locations are obtained on the basis of video structuring, face and text detection, as well as visual saliency analysis, so that the intrusiveness to the users can be minimized. The ads are selected according to content-based multimodal relevance so that the relevance can be maximized. AdOn represents one of the first attempts towards contextual overlay video advertising by leveraging information retrieval and multimedia content analysis techniques. The experiments conducted on a video database with more than 100 video programs and 7,000 ad products indicated that AdOn is superior to existing advertising approaches in terms of ad relevance and user experience.

[1]  Ted J. Smith,et al.  State of the Industry , 2003 .

[2]  Tao Mei,et al.  VideoSense: towards effective online video advertising , 2007, ACM Multimedia.

[3]  Changsheng Xu,et al.  Real time advertisement insertion in baseball video based on advertisement effect , 2005, MULTIMEDIA '05.

[4]  Shiliang Zhang,et al.  Affective MTV analysis based on arousal and valence features , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[5]  HongJiang Zhang,et al.  Text Area Detection from Video Frames , 2001, IEEE Pacific Rim Conference on Multimedia.

[6]  Robin Cohen,et al.  An Approach for Delivering Personalized Advertisements in Interactive TV Customized to Both Users and Advertisers , 2007 .

[7]  Petros Maragos,et al.  Video event detection and summarization using audio, visual and text saliency , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Srinivasan H. Sengamedu,et al.  vADeo: video advertising system , 2007, ACM Multimedia.

[9]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[10]  Tao Mei,et al.  Online video recommendation based on multimodal fusion and relevance feedback , 2007, CIVR '07.

[11]  Keith S. Coulter.  The Effects of Affective Responses to Media Context on Advertising Evaluations , 1998 .

[12]  Tao Mei,et al.  AdOn: an intelligent overlay video advertising system , 2009, SIGIR.

[13]  Harry Shum,et al.  Statistical Learning of Multi-view Face Detection , 2002, ECCV.

[14]  Amit Thawani,et al.  Context Aware Personalized Ad Insertion in an Interactive TV Environment , 2004 .

[15]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[16]  Tao Mei,et al.  When multimedia advertising meets the new Internet era , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[17]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[18]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[19]  Tao Mei,et al.  Automatic Video Genre Categorization using Hierarchical SVM , 2006, 2006 International Conference on Image Processing.

[20]  Changsheng Xu,et al.  Robust goal-mouth detection for virtual content insertion , 2003, MULTIMEDIA '03.

[21]  Andrea Everard,et al.  The effects of online advertising , 2007, Commun. ACM.

[22]  Ja-Ling Wu,et al.  ViSA: virtual spotlighted advertising , 2008, ACM Multimedia.

[23]  Winston H. Hsu,et al.  AdImage: video advertising by image matching and ad scheduling optimization , 2008, SIGIR '08.

[24]  Tammi S. Feltham,et al.  Program involvement and ad/program consistency as moderators of program context effects , 1994 .

[25]  Tao Mei,et al.  Contextual in-image advertising , 2008, ACM Multimedia.

[26]  Changsheng Xu,et al.  A generic virtual content insertion system based on visual attention analysis , 2008, ACM Multimedia.

[27]  Lie Lu,et al.  A generic framework of user attention model and its application in video summarization , 2005, IEEE Trans. Multim..