A Novel Two-stage Separable Deep Learning Framework for Practical Blind Watermarking

As a vital copyright protection technology, blind watermarking based on deep learning with an end-to-end encoder-decoder architecture has been recently proposed. Although the one-stage end-to-end training (OET) facilitates the joint learning of encoder and decoder, the noise attack must be simulated in a differentiable way, which is not always applicable in practice. In addition, OET often encounters the problems of converging slowly and tends to degrade the quality of watermarked images under noise attack. In order to address the above problems and improve the practicability and robustness of algorithms, this paper proposes a novel two-stage separable deep learning (TSDL) framework for practical blind watermarking. Precisely, the TSDL framework is composed of noise-free end-to-end adversary training (FEAT) and noise-aware decoder-only training (ADOT). A redundant multi-layer feature encoding network is developed in FEAT to obtain the encoder, while ADOT is used to get the decoder which is robust and practical enough to accept any type of noise. Extensive experiments demonstrate that the proposed framework not only exhibits better stability, greater performance and faster convergence speed compared with current state-of-the-art OET methods, but is also able to resist high-intensity noises that have not been tested in previous works.

[1]  Hocine Cherifi,et al.  Hybrid blind robust image watermarking technique based on DFT-DCT and Arnold transform , 2018, Multimedia Tools and Applications.

[2]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[3]  Jessica J. Fridrich,et al.  Detecting LSB Steganography in Color and Gray-Scale Images , 2001, IEEE Multim..

[4]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[5]  Heung-Kyu Lee,et al.  A Robust Blind Watermarking Using Convolutional Neural Network , 2017, ArXiv.

[6]  Clément Farabet,et al.  Torch7: A Matlab-like Environment for Machine Learning , 2011, NIPS 2011.

[7]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[8]  C. F. Osborne,et al.  A digital watermark , 1994, Proceedings of 1st International Conference on Image Processing.

[9]  Jessica J. Fridrich,et al.  Practical steganalysis of digital images: state of the art , 2002, IS&T/SPIE Electronic Imaging.

[10]  Nasir D. Memon,et al.  An SVD based audio watermarking technique , 2005, Proceedings of the IEEE 13th Signal Processing and Communications Applications Conference, 2005..

[11]  Ralf Steinmetz,et al.  Robust MPEG video watermarking technologies , 1998, MULTIMEDIA '98.

[12]  Gorthi R. K. Sai Subrahmanyam,et al.  Exploring the learning capabilities of convolutional neural networks for robust image watermarking , 2017, Comput. Secur..

[13]  Li Fei-Fei,et al.  HiDDeN: Hiding Data With Deep Networks , 2018, ECCV.

[14]  Mikhail J. Atallah,et al.  Words are not enough: sentence level natural language watermarking , 2006, MCPS '06.

[15]  Yuichi Yoshida,et al.  Spectral Normalization for Generative Adversarial Networks , 2018, ICLR.

[16]  Changsheng Xu,et al.  Digital audio watermarking based-on multiple-bit hopping and human auditory system , 2001, MULTIMEDIA '01.

[17]  Xiang Wei,et al.  Improving the Improved Training of Wasserstein GANs: A Consistency Term and Its Dual Effect , 2018, ICLR.

[18]  Irene G. Karybali,et al.  Efficient spatial image watermarking via new perceptual masking and blind detection schemes , 2006, IEEE Transactions on Information Forensics and Security.

[19]  Ying Weng,et al.  A New Robust Watermarking Scheme for Color Image in Spatial Domain , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[20]  Paul Bao,et al.  Image adaptive watermarking using wavelet domain singular value decomposition , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Sanja Fidler,et al.  Towards Diverse and Natural Image Descriptions via a Conditional GAN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Nicolas D. Georganas,et al.  Digital image watermarking for joint ownership , 2002, MULTIMEDIA '02.

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[25]  David Gross-Amblard,et al.  Query-preserving watermarking of relational databases and Xml documents , 2011, TODS.

[26]  Heung-Kyu Lee,et al.  Finding robust domain from attacks: A learning framework for blind watermarking , 2017, Neurocomputing.

[27]  Deepa Kundur,et al.  A robust digital image watermarking method using wavelet-based fusion , 1997, Proceedings of International Conference on Image Processing.

[28]  Bernt Schiele,et al.  Generative Adversarial Text to Image Synthesis , 2016, ICML.

[29]  Nasrin M. Makbol,et al.  Robust blind image watermarking scheme based on Redundant Discrete Wavelet Transform and Singular Value Decomposition , 2013 .

[30]  Ton Kalker,et al.  Audio watermarking for monitoring and copy protection , 2000, MULTIMEDIA '00.

[31]  Sorina Dumitrescu,et al.  Detection of LSB steganography via sample pair analysis , 2002, IEEE Trans. Signal Process..

[32]  Jiwu Huang,et al.  Robust Image Watermarking Based on Multiband Wavelets and Empirical Mode Decomposition , 2007, IEEE Transactions on Image Processing.

[33]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[34]  KandiHaribabu,et al.  Exploring the learning capabilities of convolutional neural networks for robust image watermarking , 2017 .

[35]  H J Wang,et al.  Wavelet-based digital image watermarking. , 1998, Optics express.

[36]  William T. Freeman,et al.  On the Effectiveness of Visible Watermarks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[38]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Nader Karimi,et al.  ReDMark: Framework for Residual Diffusion Watermarking on Deep Networks , 2018, ArXiv.

[40]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[41]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[42]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).