A survey of hybrid MC/DPCM/DCT video coding distortions

Abstract The motion-compensated hybrid DCT/DPCM algorithm has been successfully adopted in various video coding standards, such as H.261, H.263, MPEG-1 and MPEG-2. However, its robustness is challenged in the face of an inadequate bit allocation, either globally for the whole video sequence, or locally as a result of an inappropriate distribution of the available bits. In either of these situations, the trade-off between quality and the availability of bits results in a deterioration in the quality of the decoded video sequence, both in terms of the loss of information and the introduction of coding artifacts. These distortions are an important factor in the fields of filtering, codec design, and the search for objective psychovisual-based quality metrics; therefore, this paper presents a comprehensive analysis and classification of the numerous coding artifacts which are introduced into the reconstructed video sequence through the use of the hybrid MC/DPCM/DCT video coding algorithm. Artifacts which have already been briefly described in the literature, such as the blocking effect, ringing, the mosquito effect, MC mismatch, blurring, and color bleeding, will be comprehensively analyzed. Additionally, we will present artifacts with unique properties which have not been previously identified in the literature.

[1]  Eric Dubois,et al.  Noise Reduction in Image Sequences Using Motion-Compensated Temporal Filtering , 1984, IEEE Trans. Commun..

[2]  C. Lambrecht.  Perceptual models and architectures for video coding applications , 1996 .

[3]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[4]  Masahide Kaneko,et al.  Improvements of Transform Coding Algorithm for Motion-Compensated Interframe Prediction Errors-DCT/SQ Coding , 1987, IEEE J. Sel. Areas Commun..

[5]  R.H.J.M. Plompen,et al.  Motion video coding for visual telephony , 1990 .

[6]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[7]  Keith Jack,et al.  Video Demystified: A Handbook for the Digital Engineer , 1993 .

[8]  Jerry D. Gibson,et al.  Digital coding of waveforms: Principles and applications to speech and video , 1985, Proceedings of the IEEE.

[9]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block-transform compressed images , 1995, IEEE Trans. Image Process..

[10]  Nikil Jayant,et al.  Signal Compression: Technology Targets and Research Directions , 1992, IEEE J. Sel. Areas Commun..

[11]  T. J. Dennis.  Nonlinear temporal filter for television picture noise reduction , 1980 .

[12]  Andrew B. Watson,et al.  Discrete cosine transform (DCT) basis function visibility: effects of viewing distance and contrast masking , 1994, Electronic Imaging.

[13]  Albert J. Ahumada,et al.  Improved detection model for DCT coefficient quantization , 1993, Electronic Imaging.

[14]  Information technology — Generic coding of moving pictures and associated audio information — Part 2 : Video Technologies , 2022 .

[15]  Bernd Girod,et al.  The Information Theoretical Significance of Spatial and Temporal Masking in Video Signals , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[16]  Bhaskar Ramamurthi,et al.  Nonlinear space-variant postprocessing of block coded images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[17]  Zigmantas L. Budrikis,et al.  Detail perception after scene changes in television image presentations , 1965, IEEE Trans. Inf. Theory.

[18]  Frederic Dufaux,et al.  Motion estimation techniques for digital TV: a review and a new contribution , 1995, Proc. IEEE.

[19]  Roger J. Clarke,et al.  Digital compression of still images and video , 1995 .

[20]  Jae S. Lim,et al.  Reduction of blocking effect in image coding , 1983, ICASSP.

[21]  Arun N. Netravali,et al.  Digital Pictures: Representation and Compression , 1988 .

[22]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block transform compressed images , 1994, Other Conferences.

[23]  Chia Lung Yeh,et al.  Reduction of blocking artifacts using motion-compensated spatial-temporal filtering , 1991, Electronic Imaging.

[24]  Albert J. Ahumada,et al.  Deblocking DCT compressed images , 1994, Electronic Imaging.

[25]  Heidi A. Peterson,et al.  Luminance-model-based DCT quantization for color image compression , 1992, Electronic Imaging.

[26]  K. R. Rao,et al.  Performance evaluation of projection onto convex sets (POCS) loop filtering in generic MC/DPCM/DCT video coding , 1995, Other Conferences.

[27]  D. Amnon Silverstein,et al.  Relevance of human vision to JPEG-DCT compression , 1992, Electronic Imaging.

[28]  Kou-Hu Tzou.  Post-Filtering Of Transforms-Coded Images , 1988, Optics & Photonics.

[29]  P. Yip,et al.  Discrete Cosine Transform: Algorithms, Advantages, Applications , 1990 .

[30]  Atul Puri,et al.  Motion-compensated video coding with adaptive perceptual quantization , 1991, IEEE Trans. Circuits Syst. Video Technol..

[31]  Itu-T.  Video coding for low bitrate communication , 1996 .

[32]  Jae Lim,et al.  Reduction Of Blocking Effects In Image Coding , 1984 .