ADNet: A Deep Network for Detecting Adverts

Online video advertising gives content providers the ability to deliver compelling content, reach a growing audience, and generate additional revenue from online media. Recently, advertising strategies are designed to look for original advert(s) in a video frame, and replacing them with new adverts. These strategies, popularly known as product placement or embedded marketing, greatly help the marketing agencies to reach out to a wider audience. However, in the existing literature, such detection of candidate frames in a video sequence for the purpose of advert integration, is done manually. In this paper, we propose a deep-learning architecture called ADNet, that automatically detects the presence of advertisements in video frames. Our approach is the first of its kind that automatically detects the presence of adverts in a video frame, and achieves state-of-the-art results on a public dataset.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Peter Kontschieder,et al.  The Mapillary Vistas Dataset for Semantic Understanding of Street Scenes , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Marc'Aurelio Ranzato,et al.  Large Scale Distributed Deep Networks , 2012, NIPS.

[4]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[5]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Shamik Sural,et al.  Soccer video processing for the detection of advertisement billboards , 2008, Pattern Recognit. Lett..

[7]  Theo Gevers,et al.  Visual tracking and localization of billboards in streamed soccer matches , 2003, IS&T/SPIE Electronic Imaging.

[8]  Ekaterina V. Karniouchina,et al.  Do Marketing Media Have Life Cycles? The Case of Product Placement in Movies , 2011 .

[9]  Shumeet Baluja,et al.  Advertisement Detection and Replacement using Acoustic and Visual Repetition , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[10]  Zheyun Feng,et al.  Real Time Commercial Detection in Videos , 2013 .

[11]  Mingda Zhang,et al.  Automatic Understanding of Image and Video Advertisements , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Atul Nautiyal,et al.  An Advert Creation System for Next-Gen Publicity , 2018, ECML/PKDD.

[13]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[14]  Liming Chen,et al.  Billboard advertising detection in sport TV , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[15]  Hao Li,et al.  Do You Recognize Its Brand? The Effectiveness of Online In-Stream Video Advertisements , 2015 .

[16]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.