Object-Level Video Advertising: An Optimization Framework

In this paper, we present new models and algorithms for object-level video advertising. A framework that aims to embed content-relevant ads within a video stream is investigated in this context. First, a comprehensive optimization model is designed to minimize intrusiveness to viewers when ads are inserted in a video. For human clothing advertising, we design a deep convolutional neural network using face features to recognize human genders in a video stream. Human parts alignment is then implemented to extract human part features that are used for clothing retrieval. Second, we develop a heuristic algorithm to solve the proposed optimization problem. For comparison, we also employ the genetic algorithm to find solutions approaching the global optimum. Our novel framework is examined in various types of videos. Experimental results demonstrate the effectiveness of the proposed method for object-level video advertising.

[1]  Ramesh K. Sitaraman,et al.  Understanding the effectiveness of video ads: a measurement study , 2013, Internet Measurement Conference.

[2]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Stjepan Oreski,et al.  Genetic algorithm-based heuristic for feature selection in credit risk assessment , 2014, Expert Syst. Appl..

[5]  Hyejin Bang,et al.  Tracking users' visual attention and responses to personalized advertising based on task cognitive demand , 2016, Comput. Hum. Behav..

[6]  Chyuan Perng,et al.  A strategic framework for website evaluation based on a review of the literature from 1995-2006 , 2010, Inf. Manag..

[7]  Caifeng Shan,et al.  Learning local binary patterns for gender classification on real-world face images , 2012, Pattern Recognit. Lett..

[8]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yong Feng,et al.  Multi-label learning with label relevance in advertising video , 2016, Neurocomputing.

[11]  Jun Hu,et al.  Advertising object in web videos , 2013, Neurocomputing.

[12]  Harish Katti,et al.  CAVVA: Computational Affective Video-in-Video Advertising , 2014, IEEE Transactions on Multimedia.

[13]  Kuo-Hsiang Chen,et al.  How different information types affect viewer's attention on internet advertising , 2011, Comput. Hum. Behav..

[14]  Tao Mei,et al.  AdOn: toward contextual overlay in-video advertising , 2010, Multimedia Systems.

[15]  Changsheng Xu,et al.  Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Ricardo B. C. Prudêncio,et al.  A literature review of recommender systems in the television domain , 2015, Expert Syst. Appl..

[17]  José Juan Pazos-Arias,et al.  Cloud-Based Personalization of New Advertising and e-Commerce Models for Video Consumption , 2013, Comput. J..

[18]  Q. M. Jonathan Wu,et al.  Gaussian Mixture Model With Advanced Distance Measure Based on Support Weights and Histogram of Gradients for Background Suppression , 2014, IEEE Transactions on Industrial Informatics.

[19]  Erik Learned-Miller,et al.  Labeled Faces in the Wild : Updates and New Reporting Procedures , 2014 .

[20]  Qi Tian,et al.  Interactive ads recommendation with contextual search on product topic space , 2011, Multimedia Tools and Applications.

[21]  Fei-Fei Li,et al.  Hierarchical semantic indexing for large scale image retrieval , 2011, CVPR 2011.

[22]  Honghai Liu,et al.  Intelligent Video Systems and Analytics: A Survey , 2013, IEEE Transactions on Industrial Informatics.

[23]  Tao Mei,et al.  VideoSense: a contextual video advertising system , 2007, ACM Multimedia.

[24]  Min Xu,et al.  ActiveAd: A novel framework of linking ad videos to online products , 2016, Neurocomputing.

[25]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[26]  Jorge García Duque,et al.  Bringing Content Awareness to Web-Based IDTV Advertising , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[27]  Yi Yang,et al.  Articulated Human Detection with Flexible Mixtures of Parts , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Sudipta Roy,et al.  Video shot boundary detection: A review , 2015, 2015 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT).

[29]  Hairong Li,et al.  Measuring the Intrusiveness of Advertisements: Scale Development and Validation , 2002 .

[30]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..