Robust Template-Based Watermarking for DIBR 3D Images

Several depth image-based rendering (DIBR) watermarking methods have been proposed, but they have various drawbacks, such as non-blindness, low imperceptibility and vulnerability to signal or geometric distortion. This paper proposes a template-based DIBR watermarking method that overcomes the drawbacks of previous methods. The proposed method exploits two properties to resist DIBR attacks: the pixel is only moved horizontally by DIBR, and the smaller block is not distorted by DIBR. The one-dimensional (1D) discrete cosine transform (DCT) and curvelet domains are adopted to utilize these two properties. A template is inserted in the curvelet domain to restore the synchronization error caused by geometric distortion. A watermark is inserted in the 1D DCT domain to insert and detect a message from the DIBR image. Experimental results of the proposed method show high imperceptibility and robustness to various attacks, such as signal and geometric distortions. The proposed method is also robust to DIBR distortion and DIBR configuration adjustment, such as depth image preprocessing and baseline distance adjustment.

[1]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[2]  Taali Martin,et al.  Smoothing depth maps for improved steroscopic image quality , 2004, SPIE Optics East.

[3]  Chen Cui,et al.  A novel watermarking for DIBR 3D images with geometric rectification based on feature points , 2015, Multimedia Tools and Applications.

[4]  Arijit Sur,et al.  Depth-Based View-Invariant Blind 3D Image Watermarking , 2016, TOMM.

[5]  Aljoscha Smolic,et al.  An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution , 2009, 2009 Picture Coding Symposium.

[6]  Md. Monirul Islam,et al.  Rotation invariant curvelet features for texture image retrieval , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[7]  Neil A. Dodgson,et al.  Three-Dimensional Displays: A Review and Applications Analysis , 2011, IEEE Transactions on Broadcasting.

[8]  Carlos Vázquez,et al.  3D-TV Content Creation: Automatic 2D-to-3D Video Conversion , 2011, IEEE Transactions on Broadcasting.

[9]  Ingemar J. Cox,et al.  Secure spread spectrum watermarking for multimedia , 1997, IEEE Trans. Image Process..

[10]  Thierry Pun,et al.  Robust template matching for affine resistant image watermarks , 2000, IEEE Trans. Image Process..

[11]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[12]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[13]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Heiko Hirschmüller,et al.  Evaluation of Cost Functions for Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Md. Monirul Islam,et al.  Content based image retrieval using curvelet transform , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[16]  Liang Zhang,et al.  3D-TV Content Generation: 2D-to-3D Conversion , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[17]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[18]  Michael G. Strintzis,et al.  Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Shen Wang,et al.  Watermarking for DIBR 3D images based on SIFT feature points , 2014 .

[20]  Mark R. Pickering,et al.  A blind watermarking scheme for depth-image-based rendered 3D video using the dual-tree complex wavelet transform , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[21]  Mauro Barni,et al.  A DCT-domain system for robust image watermarking , 1998, Signal Process..

[22]  Peter Lawrence,et al.  An Investigation of Methods for Determining Depth from Focus , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[24]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[25]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[26]  Heung-Kyu Lee,et al.  Robust DT-CWT Watermarking for DIBR 3D Images , 2012, IEEE Transactions on Broadcasting.

[27]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[28]  Ingemar J. Cox,et al.  Digital Watermarking and Steganography , 2014 .

[29]  Liang-Gee Chen,et al.  Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[30]  Demin Wang,et al.  Stereoscopic image generation based on depth images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[31]  Abdulmotaleb El-Saddik,et al.  A Survey of RST Invariant Image Watermarking Algorithms , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[32]  Xi Wang,et al.  High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth , 2014, GCPR.

[33]  Mark R. Pickering,et al.  Robust DT CWT-Based DIBR 3D Video Watermarking Using Chrominance Embedding , 2016, IEEE Transactions on Multimedia.

[34]  C. Lawrence Zitnick,et al.  High-quality video view interpolation , 2006, SIGGRAPH Courses.

[35]  Lu Yu,et al.  Temporal consistency enhancement on depth sequences , 2010, 28th Picture Coding Symposium.

[36]  Ja-Ling Wu,et al.  Image Descriptor Based Digital Semi-blind Watermarking for DIBR 3D Images , 2014, IWDW.

[37]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[38]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[39]  Hakan Urey,et al.  State of the Art in Stereoscopic and Autostereoscopic Displays , 2011, Proceedings of the IEEE.

[40]  Emmanuel J. Candès,et al.  New multiscale transforms, minimum total variation synthesis: applications to edge-preserving image reconstruction , 2002, Signal Process..

[41]  Pei-Jun Lee,et al.  Nongeometric Distortion Smoothing Approach for Depth Map Preprocessing , 2011, IEEE Transactions on Multimedia.

[42]  David J. Fleet,et al.  Embedding invisible information in color images , 1997, Proceedings of International Conference on Image Processing.

[43]  Mauro Barni,et al.  Effectiveness of exhaustive search and template matching against watermark desynchronization , 2005, IEEE Signal Processing Letters.

[44]  Ja-Ling Wu,et al.  A Digital Blind Watermarking for Depth-Image-Based Rendering 3D Images , 2011, IEEE Transactions on Broadcasting.

[45]  Yo-Sung Ho,et al.  Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video , 2009, 2009 Picture Coding Symposium.

[46]  Jinchang Ren,et al.  Object-based 2 Dto-3 D Video Conversion for Effective Stereoscopic Content Generation in 3 DTV Applications , 2011 .

[47]  Liang-Gee Chen,et al.  Hybrid motion/depth-oriented inpainting for virtual view synthesis in multiview applications , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[48]  Sebastiano Battiato,et al.  Depth map generation by image classification , 2004, IS&T/SPIE Electronic Imaging.

[49]  Reinhard Koch,et al.  Display-Independent 3D-TV Production and Delivery Using the Layered Depth Video Format , 2011, IEEE Transactions on Broadcasting.

[50]  Shang-Hong Lai,et al.  Spatio-Temporally Consistent Novel View Synthesis Algorithm From Video-Plus-Depth Sequences for Autostereoscopic Displays , 2011, IEEE Transactions on Broadcasting.

[51]  C. Fehn.  A 3 DTV Approach Using Depth-Image-Based Rendering ( DIBR ) , 2003 .