A robust error concealment technique using data hiding for image and video transmission over lossy channels

A robust error concealment scheme using data hiding which aims at achieving high perceptual quality of images and video at the end-user despite channel losses is proposed. The scheme involves embedding a low-resolution version of each image or video frame into itself using spread-spectrum watermarking, extracting the embedded watermark from the received video frame, and using it as a reference for reconstruction of the parent image or frame, thus detecting and concealing the transmission errors. Dithering techniques have been used to obtain a binary watermark from the low-resolution version of the image/video frame. Multiple copies of the dithered watermark are embedded in frequencies in a specific range to make it more robust to channel errors. It is shown experimentally that, based on the frequency selection and scaling factor variation, a high-quality watermark can be extracted from a low-quality lossy received image/video frame. Furthermore, the proposed technique is compared to its two-part variant where the low-resolution version is encoded and transmitted as side information instead of embedding it. Simulation results show that the proposed concealment technique using data hiding outperforms existing approaches in improving the perceptual quality, especially in the case of higher loss probabilities.

[1]  John W. Buchanan,et al.  Threshold-diffuse hybrid half-toning methods , 1997 .

[2]  Sanjit K. Mitra,et al.  A hybrid constrained unequal error protection and data hiding scheme for packet video transmission , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[3]  Michael T. Orchard,et al.  Inverse halftoning using wavelets , 1999, IEEE Trans. Image Process..

[4]  Jaejin Lee,et al.  A watermarking sequence using parities of error control coding for image authentication and correction , 2000, IEEE Trans. Consumer Electron..

[5]  Jue Wang,et al.  A region and data hiding based error concealment scheme for images , 2001, IEEE Trans. Consumer Electron..

[6]  Ingemar J. Cox,et al.  Secure spread spectrum watermarking for multimedia , 1997, IEEE Trans. Image Process..

[7]  Sang Uk Lee,et al.  Recovery of corrupted image data based on the NURBS interpolation , 1999, IEEE Trans. Circuits Syst. Video Technol..

[8]  Hong Heather Yu,et al.  Error concealment using data hiding , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[9]  Henry R. Kang Color Technology for Electronic Imaging Devices , 1997 .

[10]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[11]  Min Wu,et al.  Multimedia Data Hiding , 2003, Springer New York.

[12]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[13]  C.-C. Jay Kuo,et al.  A Robust Nonlinear Filtering Approach to Inverse Halftoning , 2001, J. Vis. Commun. Image Represent..

[14]  S. Wicker Error Control Systems for Digital Communication and Storage , 1994 .

[15]  P. P. Vaidyanathan,et al.  Look up table (LUT) inverse halftoning , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[16]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[17]  Ness B. Shroff,et al.  Error concealment techniques for encoded video streams , 1995, Proceedings., International Conference on Image Processing.

[18]  Ali N. Akansu,et al.  Low-level motion activity features for semantic characterization of video , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[19]  Hitoshi Kiya,et al.  Error Concealment Using a Digital Watermarking Technique for Interframe Video Coding , 2002 .

[20]  Chun-Shien Lu Wireless multimedia error resilience via a data hiding technique , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[21]  P. P. Vaidyanathan,et al.  Look-up table (LUT) method for inverse halftoning , 2001, IEEE Trans. Image Process..

[22]  Yao Wang,et al.  Error control and concealment for video communications , 1999 .

[23]  John J. Lemmon Wireless Link Statistical Bit Error Model , 2002 .

[24]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[25]  Yanda Li,et al.  Error Concealment for Digital Images Using Data Hiding , 2000 .

[26]  A. Aydin Alatan,et al.  Error concealment of video sequences by data hiding , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[27]  Ton Kalker,et al.  Considerations on watermarking security , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[28]  Mauro Barni,et al.  A data hiding approach for correcting errors in H.263 video transmitted over a noisy channel , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[29]  Frederic Dufaux,et al.  Motion estimation techniques for digital TV: a review and a new contribution , 1995, Proc. IEEE.

[30]  Shao Ya-fei,et al.  Reconstruction of missing blocks in image transmission by using self-embedding , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[31]  Yao Wang,et al.  Signal loss recovery in DCT-based image and video codecs , 1991, Other Conferences.

[32]  Ahmed H. Tewfik,et al.  Multimedia data-embedding and watermarking technologies , 1998, Proc. IEEE.