A survey of reversible data hiding in encrypted images - The first 12 years

Abstract In the last few years, with the increasing popularity of cloud computing and the availability of mobile smart devices as well as ubiquitous network connections, more and more users are uploading their personal data to remote servers. However, this can lead to significant security breaches, where confidentiality, integrity and authentication are constantly threatened. To overcome these multiple problems, multimedia data must be secured, for example by means of encryption before transmission and storage. In this survey, we look into the issues involved in handling encrypted multimedia data, and more specifically we focus on reversible data hiding in encrypted images (RDHEI). The aim of this survey is to present the birth and evolution of RDHEI methods over the last 12 years. We first highlight different classes and characteristics of RDHEI, then describe representative RDHEI methods. A comparison table is presented to summarize the key features and achievements of each representative RDHEI method considered in this survey. Finally, we share the future outlook of emerging applications and open research topics relevant to RDHEI for the next 12 years and beyond.

[1]  Xinpeng Zhang,et al.  Reversible Data Hiding in Encrypted Image , 2011, IEEE Signal Processing Letters.

[2]  Lucas Theis,et al.  Fast Face-Swap Using Convolutional Neural Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Fei Peng,et al.  Separable reversible data hiding and encryption for HEVC video , 2017, Journal of Real-Time Image Processing.

[4]  Weiming Zhang,et al.  Inter-frame distortion drift analysis for reversible data hiding in encrypted H.264/AVC video bitstreams , 2016, Signal Process..

[5]  Shijun Xiang,et al.  Reversible Data Hiding in Homomorphic Encrypted Domain by Mirroring Ciphertext Group , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Wenjun Zeng,et al.  Efficient Compression of Encrypted Grayscale Images , 2010, IEEE Transactions on Image Processing.

[7]  Pascal Paillier,et al.  Public-Key Cryptosystems Based on Composite Degree Residuosity Classes , 1999, EUROCRYPT.

[8]  Xinpeng Zhang,et al.  Separable Reversible Data Hiding in Encrypted Image , 2012, IEEE Transactions on Information Forensics and Security.

[9]  Yilin Pang,et al.  Encrypted images-based reversible data hiding in Paillier cryptosystem , 2019, Multimedia Tools and Applications.

[10]  Jiwu Huang,et al.  New Framework for Reversible Data Hiding in Encrypted Domain , 2016, IEEE Transactions on Information Forensics and Security.

[11]  KokSheik Wong,et al.  A Unified Data Embedding and Scrambling Method , 2014, IEEE Transactions on Image Processing.

[12]  Zhihua Xia,et al.  High-Capacity Reversible Data Hiding for Encrypted Multimedia Data With Somewhat Homomorphic Encryption , 2018, IEEE Access.

[13]  Tung-Shou Chen,et al.  An Improved Reversible Data Hiding in Encrypted Images Using Side Match , 2012, IEEE Signal Processing Letters.

[14]  KokSheik Wong,et al.  Progressive quality degradation in JPEG compressed image using DC block orientation with rewritable data embedding functionality , 2013, 2013 IEEE International Conference on Image Processing.

[16]  Gwoboa Horng,et al.  Encrypted signal-based reversible data hiding with public key cryptosystem , 2014, J. Vis. Commun. Image Represent..

[17]  Wesley De Neve,et al.  Privacy Protection in Video Surveillance Systems: Analysis of Subband-Adaptive Scrambling in JPEG XR , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Xinpeng Zhang,et al.  Reversible Data Hiding in Encrypted Images Based on Multi-MSB Prediction and Huffman Coding , 2018, IEEE Transactions on Multimedia.

[19]  William Puech,et al.  Visual saliency-based confidentiality metric for selective crypto-compressed JPEG images , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[20]  Deepa Kundur,et al.  Video fingerprinting and encryption principles for digital rights management , 2004, Proceedings of the IEEE.

[21]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[22]  Xiaoyuan Yang,et al.  A multilevel reversible data hiding scheme in encrypted domain based on LWE , 2018, J. Vis. Commun. Image Represent..

[23]  KokSheik Wong,et al.  Data embedding in random domain , 2015, Signal Process..

[24]  Kiyoshi Tanaka,et al.  A Novel Sketch Attack for H.264/AVC Format-Compliant Encrypted Video , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Wei Sun,et al.  High-capacity reversible data hiding in encrypted images by prediction error , 2014, Signal Process..

[26]  Zhenxing Qian,et al.  New Framework of Reversible Data Hiding in Encrypted JPEG Bitstreams , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Yu-Chi Chen,et al.  Encrypted image-based reversible data hiding with public key cryptography from difference expansion , 2015, Signal Process. Image Commun..

[28]  Rangding Wang,et al.  Separable and error-free reversible data hiding in encrypted images , 2016, Signal Process..

[29]  Yong Wang,et al.  Separable reversible data hiding in encrypted image based on pixel value ordering and additive homomorphism , 2017, J. Vis. Commun. Image Represent..

[30]  Bing Chen,et al.  Reversible data hiding in encrypted binary images by pixel prediction , 2019, Signal Process..

[31]  Claude E. Shannon,et al.  Communication theory of secrecy systems , 1949, Bell Syst. Tech. J..

[32]  Shuli Zheng,et al.  Lossless Data Hiding Based on Homomorphic Cryptosystem , 2019, IEEE Transactions on Dependable and Secure Computing.

[33]  S. Agaian,et al.  NPCR and UACI Randomness Tests for Image Encryption , 2011 .

[34]  Stephen M. Matyas,et al.  A proposed mode for triple-DES encryption , 1996, IBM J. Res. Dev..

[35]  Ioan-Catalin Dragoi,et al.  Improved reversible data hiding in encrypted images based on reserving room after encryption and pixel prediction , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[36]  Zhaoxia Yin,et al.  An Improved Reversible Data Hiding in Encrypted Images Using Parametric Binary Tree Labeling , 2019, IEEE Transactions on Multimedia.

[37]  Yang Li,et al.  Histogram shifting in encrypted images with public key cryptosystem for reversible data hiding , 2017, Signal Process..

[38]  Wei Lu,et al.  Reversible data hiding in encrypted images with additive and multiplicative public-key homomorphism , 2019, Signal Process..

[39]  Zhenxing Qian,et al.  Reversible Data Hiding in Encrypted Images with Two-MSB Prediction , 2018, 2018 IEEE International Workshop on Information Forensics and Security (WIFS).

[40]  Ioan-Catalin Dragoi,et al.  Reversible Data Hiding in Encrypted Images Based on Reserving Room After Encryption and Multiple Predictors , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  Adi Shamir,et al.  A method for obtaining digital signatures and public-key cryptosystems , 1978, CACM.

[42]  Xinpeng Zhang,et al.  Lossless and Reversible Data Hiding in Encrypted Images With Public-Key Cryptography , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Tal Hassner,et al.  On Face Segmentation, Face Swapping, and Face Perception , 2017, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[44]  Jia Liu,et al.  Separable Multiple Bits Reversible Data Hiding in Encrypted Domain , 2016, IWDW.

[45]  William Puech,et al.  EPE-based Huge-Capacity Reversible Data Hiding in Encrypted Images , 2018, 2018 IEEE International Workshop on Information Forensics and Security (WIFS).

[46]  Fei Peng,et al.  A separable reversible data hiding scheme for encrypted images based on Tromino scrambling and adaptive pixel value ordering , 2020, Signal Process..

[47]  Guanrong Chen,et al.  On the Dynamical Degradation of Digital Piecewise Linear Chaotic Maps , 2005, Int. J. Bifurc. Chaos.

[48]  King Ngi Ngan,et al.  Multi-layer authentication scheme for HEVC video based on embedded statistics , 2016, J. Vis. Commun. Image Represent..

[49]  Elaine B. Barker,et al.  A Statistical Test Suite for Random and Pseudorandom Number Generators for Cryptographic Applications , 2000 .

[50]  Weiming Zhang,et al.  Reversibility improved data hiding in encrypted images , 2014, Signal Process..

[51]  Hang Zhou,et al.  Separable Reversible Data Hiding in Encrypted JPEG Bitstreams , 2018, IEEE Transactions on Dependable and Secure Computing.

[52]  Hang Zhou,et al.  Reversible Data Hiding in Encrypted Three-Dimensional Mesh Models , 2018, IEEE Transactions on Multimedia.

[53]  King Ngi Ngan,et al.  Separable authentication in encrypted HEVC video , 2018, Multimedia Tools and Applications.

[54]  Geong Sen Poh,et al.  An Efficient Buyer-Seller Watermarking Protocol Based on Chameleon Encryption , 2009, IWDW.

[55]  Zhenxing Qian,et al.  Reversible Data Hiding in Encrypted Images With Distributed Source Encoding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[56]  Kiyoshi Tanaka,et al.  Scrambling-embedding for JPEG compressed image , 2015, Signal Process..

[57]  KokSheik Wong,et al.  An Overview of Information Hiding in H.264/AVC Compressed Video , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[58]  Xiaochun Cao,et al.  High Capacity Reversible Data Hiding in Encrypted Images by Patch-Level Sparse Representation , 2016, IEEE Transactions on Cybernetics.

[59]  Weiming Zhang,et al.  Homomorphic Encryption-Based Reversible Data Hiding for 3D Mesh Models , 2018, Arabian Journal for Science and Engineering.

[60]  Touradj Ebrahimi,et al.  JPEG XT: A New Family of JPEG Backward-Compatible Standards , 2016, IEEE MultiMedia.

[61]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[62]  Zhenxing Qian,et al.  A High Capacity Multi-Level Approach for Reversible Data Hiding in Encrypted Images , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[63]  Fei Peng,et al.  Separable Robust Reversible Watermarking in Encrypted 2D Vector Graphics , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[64]  Weiming Zhang,et al.  Reversible Data Hiding in Encrypted Images by Reserving Room Before Encryption , 2013, IEEE Transactions on Information Forensics and Security.

[65]  Jiwu Huang,et al.  A Novel High-Capacity Reversible Data Hiding Scheme for Encrypted JPEG Bitstreams , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[66]  Tao Xiang,et al.  PEID: A Perceptually Encrypted Image Database for Visual Security Evaluation , 2020, IEEE Transactions on Information Forensics and Security.

[67]  KokSheik Wong,et al.  Universal data embedding in encrypted domain , 2014, Signal Process..

[68]  Stefan Katzenbeisser,et al.  Depreciating Motivation and Empirical Security Analysis of Chaos-Based Image and Video Encryption , 2018, IEEE Transactions on Information Forensics and Security.

[69]  Hsin-Lung Wu,et al.  A separable reversible data hiding scheme for encrypted JPEG bitstreams , 2017, Signal Process..

[70]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[71]  Chin-Chen Chang,et al.  High-capacity reversible data hiding in encrypted images based on extended run-length coding and block-based MSB plane rearrangement , 2019, J. Vis. Commun. Image Represent..

[72]  Zhenxing Qian,et al.  Reversible Data Hiding in Encrypted JPEG Bitstream , 2014, IEEE Transactions on Multimedia.

[73]  William Puech,et al.  An Efficient MSB Prediction-Based Method for High-Capacity Reversible Data Hiding in Encrypted Images , 2018, IEEE Transactions on Information Forensics and Security.

[74]  Jiwu Huang,et al.  Reversible data hiding in Paillier cryptosystem , 2016, J. Vis. Commun. Image Represent..

[75]  Bin Li,et al.  High-fidelity reversible data hiding scheme based on pixel-value-ordering and prediction-error expansion , 2013, Signal Process..

[76]  Zhaoxia Yin,et al.  Reversible Data Hiding in Encrypted Images Based on Pixel Prediction and Bit-Plane Compression , 2019, IEEE Transactions on Dependable and Secure Computing.

[77]  Rangding Wang,et al.  Reversible Data Hiding in Encrypted H.264/AVC Video Streams , 2013, IWDW.

[78]  Kiyoshi Tanaka,et al.  A Scalable Reversible Data Embedding Method with progressive quality degradation functionality , 2014, Signal Process. Image Commun..

[79]  Kiyoshi Tanaka,et al.  Beyond format-compliant encryption for JPEG image , 2015, Signal Process. Image Commun..

[80]  Yicong Zhou,et al.  Separable and Reversible Data Hiding in Encrypted Images Using Parametric Binary Tree Labeling , 2019, IEEE Transactions on Multimedia.

[81]  Marc Chaumont,et al.  A reversible data hiding method for encrypted images , 2008, Electronic Imaging.