Temporal synchronization of watermarked video using image hashing

In this paper, we concentrate on video watermarking for forensics applications and consider the temporal synchronization problem, which has been overlooked in the literature so far. As a result, we propose a system that provides temporal synchronization in video watermarking by using side information at the receiver. Short perceptually-robust representations (also known as robust hash values) of randomly selected frames from the watermarked video regions is derived at the encoder and transmitted to the decoder. Synchronization is then achieved by computing perceptually-representative information of all frames of the received video at the receiver and finding the "best matching region" via solving a combinatorial optimization problem efficiently using dynamic programming techniques. A suitably-chosen "robust image hash" function is used to derive the necessary representative information of the video frames; the resulting hash values possess properties of being short in length, computable in real time, and similar (resp. different) for perceptually similar (resp. different) video frames with high probability. We experimentally illustrate the effectiveness of our method against several attacks, which include frame-wise geometric attacks, as well as temporal de-synchronization attacks, such as random temporal interpolation, scene editing, cutting and swapping.

[1]  Gabriela Csurka,et al.  Robust 3D DFT video watermarking , 1999, Electronic Imaging.

[2]  Ton Kalker,et al.  The VIVA project: digital watermarking for broadcast monitoring , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[3]  Ramarathnam Venkatesan,et al.  Robust image hashing , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[4]  Jiri Fridrich,et al.  Robust hash functions for digital watermarking , 2000, Proceedings International Conference on Information Technology: Coding and Computing (Cat. No.PR00540).

[5]  Yacov Yacobi,et al.  Improved Boneh-Shaw Content Fingerprinting , 2001, CT-RSA.

[6]  Ramarathnam Venkatesan,et al.  New Iterative Geometric Methods for Robust Perceptual Image Hashing , 2001, Digital Rights Management Workshop.

[7]  Dan.  Collusion-Secure Fingerprinting for Digital Data , 2002 .

[8]  Adnan M. Alattar,et al.  Digital watermarking of low bit-rate advanced simple profile MPEG-4 compressed video , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[10]  Ramarathnam Venkatesan,et al.  Robust perceptual image hashing via matrix invariants , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[11]  Vishal Monga,et al.  Robust perceptual image hashing using feature points , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  Ramarathnam Venkatesan,et al.  Robust video watermarking via optimization algorithm for quantization of pseudo-random semi-global statistics , 2005, IS&T/SPIE Electronic Imaging.