When multimedia advertising meets the new Internet era

The advent of media-sharing sites, especially along with the so called Web 2.0 wave, has led to the unprecedented Internet delivery of community-contributed media contents such as images and videos, which have become the primary sources for online advertising. However, conventional ad-networks such as Google Adwords and AdSense treat image and video advertising as general text advertising by displaying the ads either relevant to the queries or the Web page content, without considering automatically monetizing the rich contents of individual images and videos. In this paper, we summarize the trends of online advertising and propose an innovative advertising model driven by the compelling contents of images and videos. We present recently developed ImageSense and VideoSense as two exemplary applications dedicated to images and videos, respectively, in which the most contextually relevant ads are embedded at the most appropriate positions within the images or videos. The ads are selected based on not only textual relevance but also visual similarity so that the ads yield contextual relevance to both the text in the Web page and the visual content. The ad insertion positions are detected based on visual saliency analysis to minimize the intrusiveness to the user. We also envision that the next trend of multimedia advertising would be game-alike advertising.

[1]  Md. Monirul Islam,et al.  Content based image retrieval using curvelet transform , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[2]  Huang Lee,et al.  Optimal camera selection in vision networks for shape approximation , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[3]  Yi Guo,et al.  Error resilient transcoding of Scalable Video bitstreams , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[4]  Kian Meng Yap,et al.  Quality of service issues for distributed virtual environments with haptic interfaces , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[5]  Joo-Hwee Lim,et al.  Rich representation and ranking for photographic image retrieval in ImageCLEF 2007 , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[6]  Mark R. Pickering,et al.  An automatic and robust approach for global motion estimation , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[7]  Dirk T. M. Slock,et al.  Singular block Toeplitz matrix approximation and application to multi-microphone speech dereverberation , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[8]  Andrea Everard,et al.  The effects of online advertising , 2007, Commun. ACM.

[9]  John S. D. Mason,et al.  Short utterance-based video aided speaker recognition , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[10]  Mark R. Pickering,et al.  Generalized framework for reduced precision global motion estimation between digital images , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[11]  Anamitra Makur,et al.  Distributed source coding based encryption and lossless compression of gray scale and color images , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[12]  Naoyuki Kanda,et al.  Open-vocabulary keyword detection from super-large scale speech database , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[13]  Ruiqin Xiong,et al.  Optimal LR-PET protection for scalable video streams over lossy channels with random delay , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[14]  Manoranjan Paul,et al.  A hybrid object detection technique from dynamic background using Gaussian mixture models , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[15]  Tao Mei,et al.  Online video recommendation based on multimodal fusion and relevance feedback , 2007, CIVR '07.

[16]  Aous Thabit Naman,et al.  Distortion estimation for optimized delivery of JPEG2000 compressed video with motion , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[17]  Yoshiaki Itoh,et al.  Highlight scene extraction of sports broadcasts using sports news programs , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[18]  Hermie Hermens,et al.  Biosignal and context monitoring: Distributed multimedia applications of Body Area Networks in healthcare , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[19]  Xinghuo Yu,et al.  Adaptive geometric features based filtering impulse noise in colour images , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[20]  Andrei Z. Broder,et al.  A semantic approach to contextual advertising , 2007, SIGIR.

[21]  Ilse Ravyse,et al.  Accurate visual speech synthesis based on diviseme unit selection and concatenation , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[22]  Xiongcai Cai,et al.  Robust object tracking using the particle filtering and level set methods: A comparative experiment , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[23]  Paolo Rocca,et al.  Content-based image retrieval by a semi-supervised Particle Swarm Optimization , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[24]  Christine Guillemot,et al.  Spatial prediction in distributed video coding using Wyner-Ziv DPCM , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[25]  Bin Li,et al.  CCL-SVC: Optimizing user experience of broadcasting video on computation capability limited handheld devices , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[26]  Christophe Tillier,et al.  Adaptive wavelet coding of the depth map for stereoscopic view synthesis , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[27]  Reji Mathew,et al.  Motion modeling with separate quad-tree structures for geometry and motion , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[28]  Peter Schelkens,et al.  Intra-frame video coding using an open-loop predictive coding approach , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[29]  Yang Wang,et al.  A practical approach to multiple super-resolution sprite generation , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[30]  Bernd Girod,et al.  Distortion-aware retransmission and concealment of video packets using a Wyner-Ziv-coded thumbnail , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[31]  Meng Wang,et al.  MSRA-USTC-SJTU at TRECVID 2007: High-Level Feature Extraction and Search , 2007, TRECVID.

[32]  Sridha Sridharan,et al.  Comparing object alignment algorithms with appearance variation: Forward-additive vs inverse-composition , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[33]  Thomas Sikora,et al.  Recent developments in panoramic image generation and sprite coding , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[34]  Lifeng Sun,et al.  Highlight detection in soccer video using web-casting text , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[35]  Tao Mei,et al.  VideoSense: towards effective online video advertising , 2007, ACM Multimedia.

[36]  Antonio Ortega,et al.  Coding structure optimization for interactive multiview streaming in virtual world observation , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[37]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[38]  Charalambos Strouthopoulos,et al.  Robust text extraction in mixed-type binary documents , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[39]  Mor Naaman,et al.  How flickr helps us make sense of the world: context and content in community-contributed media collections , 2007, ACM Multimedia.

[40]  Wei Zhang,et al.  Online photography assistance by exploring geo-referenced photos on MID / UMPC , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[41]  Berthier A. Ribeiro-Neto,et al.  Impedance coupling in content-targeted advertising , 2005, SIGIR '05.

[42]  Peter Lambert,et al.  Unsupervised texture segmentation and labeling using biologically inspired features , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[43]  Aranyak Mehta,et al.  AdWords and generalized on-line matching , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[44]  Dirk T. M. Slock,et al.  Periodic signal extraction with frequency-selective amplitude modulation and global time-warping for music signal decomposition , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[45]  Tao Mei,et al.  Contextual in-image advertising , 2008, ACM Multimedia.

[46]  Thomas Sikora,et al.  On the detection and localization of facial occlusions and its use within different scenarios , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.