Video logo removal detection based on sparse representation

With the popularity of multimedia editing tools, more and more forged multimedia content appeared on the network. Thus, the legal authorities need novel techniques to distinguish copyright infringements from a large number of videos on the Internet. Since logo removal is a common editing operation during unauthorized reproduction, logo removal detection is often equivalent to copyright infringements detection to some extent. In this paper, we proposed a video forensics framework for logo removal detection. Our framework mainly contains two stages: the removal traces detection and the removal region location. In the first stage, we use sparse representation to show the difference between the tampered areas and the original areas in sparsity. In the second stage, spatial priors and temporal correlations are used to refine the location of the removal regions. Finally, a spatiotemporal suspected region can obviously show the edited regions. The proposed method is validated on our video logo removal dataset by extensive experiments, showing promising results.

[1]  Tat-Seng Chua,et al.  What Does Social Media Say about Your Stress? , 2016, IJCAI.

[2]  Yi Yang,et al.  Image Attribute Adaptation , 2014, IEEE Transactions on Multimedia.

[3]  Heung-Kyu Lee,et al.  Screenshot identification using combing artifact from interlaced video , 2010, MM&Sec '10.

[4]  Paolo Bestagini,et al.  Hash-based frame selection for video phylogeny , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[5]  Lei Zhu,et al.  Learning Compact Visual Representation with Canonical Views for Robust Mobile Landmark Search , 2016, IJCAI.

[6]  Yi-Liang Zhao,et al.  Volunteerism Tendency Prediction via Harvesting Multiple Social Networks , 2016, ACM Trans. Inf. Syst..

[7]  Tat-Seng Chua,et al.  From Tweets to Wellness: Wellness Event Detection from Twitter Streams , 2016, AAAI.

[8]  Jing Zhang,et al.  Detecting logo-removal forgery by inconsistencies of blur , 2009, 2009 International Conference on Industrial Mechatronics and Automation.

[9]  Changsheng Xu,et al.  Automatic TV Logo Detection, Tracking and Removal in Broadcast Video , 2007, MMM.

[10]  Shih-Fu Chang,et al.  Why We Watch the News: A Dataset for Exploring Sentiment in Broadcast Video News , 2014, ICMI.

[11]  Qi Tian,et al.  Object coding on the semantic graph for scene classification , 2013, MM '13.

[12]  Meng Wang,et al.  Learning User Attributes via Mobile Social Multimedia Analytics , 2017, ACM Trans. Intell. Syst. Technol..

[13]  Liqiang Nie,et al.  Predicting Image Memorability Through Adaptive Transfer Learning From External Sources , 2017, IEEE Transactions on Multimedia.

[14]  Weihong Wang,et al.  Exposing digital forgeries in video by detecting duplication , 2007, MM&Sec.

[15]  Pier Luigi Dragotti,et al.  Modelling radial distortion chains for video recapture detection , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[16]  Paolo Bestagini,et al.  Phylogeny reconstruction for misaligned and compressed video sequences , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[17]  Paolo Bestagini,et al.  Video recapture detection based on ghosting artifact analysis , 2013, 2013 IEEE International Conference on Image Processing.

[18]  Jyh-Jong Tsay,et al.  A passive approach for effective detection and localization of region-level video forgery with spatio-temporal coherence analysis , 2014, Digit. Investig..

[19]  Davide Cozzolino,et al.  Autoencoder with recurrent neural networks for video forgery detection , 2017, Media Watermarking, Security, and Forensics.

[20]  Takahiro Okabe,et al.  Detecting Forgery From Static-Scene Video Based on Inconsistency in Noise Level Functions , 2010, IEEE Transactions on Information Forensics and Security.

[21]  Huanbo Luan,et al.  Compact Indexing and Judicious Searching for Billion-Scale Microblog Retrieval , 2017, ACM Trans. Inf. Syst..

[22]  Anderson Rocha,et al.  Video Phylogeny: Recovering near-duplicate video relationships , 2011, 2011 IEEE International Workshop on Information Forensics and Security.

[23]  strong,et al.  Detection of double compression in MPEG-4 videos based on block artifact measurement , 2016 .

[24]  Bin Li,et al.  Automatic Detection of Object-Based Forgery in Advanced Video , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Weihong Wang,et al.  Exposing digital forgeries in video by detecting double MPEG compression , 2006, MM&Sec '06.

[26]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[27]  Mohan S. Kankanhalli,et al.  Automatic video logo detection and removal , 2005, Multimedia Systems.

[28]  Tat-Seng Chua,et al.  Computational Social Indicators: A Case Study of Chinese University Ranking , 2017, SIGIR.

[29]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[30]  Mauro Barni,et al.  A video forensic technique for detecting frame deletion and insertion , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Yi Yang,et al.  Augmenting Image Descriptions Using Structured Prediction Output , 2014, IEEE Transactions on Multimedia.

[32]  Shilin Wang,et al.  Double compression detection based on local motion vector field analysis in static-background videos , 2016, J. Vis. Commun. Image Represent..

[33]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[34]  Yuxing Wu,et al.  Exposing video inter-frame forgery based on velocity field consistency , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  Paolo Bestagini,et al.  Local tampering detection in video sequences , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[36]  Yueting Zhuang,et al.  Sparse Unsupervised Dimensionality Reduction for Multiple View Data , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Jiajun Wang,et al.  VCDB: A Large-Scale Database for Partial Copy Detection in Videos , 2014, ECCV.

[38]  Xinghao Jiang,et al.  Exposing video forgeries by detecting MPEG double compression , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  David Vazquez-Padin,et al.  Localization of forgeries in MPEG-2 video through GOP size and DQ analysis , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[40]  Xiangyu Wang,et al.  Semantic-Based Location Recommendation With Multimodal Venue Semantics , 2015, IEEE Transactions on Multimedia.

[41]  Nicu Sebe,et al.  Perceptual Attributes Optimization for Multivideo Summarization , 2016, IEEE Transactions on Cybernetics.

[42]  Weihong Wang,et al.  Exposing digital forgeries in video by detecting double quantization , 2009, MM&Sec '09.

[43]  Chia-Wen Lin,et al.  Video forgery detection using correlation of noise residue , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[44]  Zhengquan Xu,et al.  Automatic location of frame deletion point for digital video forensics , 2014, IH&MMSec '14.

[45]  Mauro Barni,et al.  Detection of malevolent changes in digital video for forensic applications , 2007, Electronic Imaging.

[46]  Yi Yang,et al.  Semisupervised Feature Selection via Spline Regression for Video Semantic Recognition , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Luming Zhang,et al.  Fortune Teller: Predicting Your Career Path , 2016, AAAI.