Temporal Resolution Enhancement in Compressed Video Sequences

Compressed video may possess a number of artifacts, both spatial and temporal. Spatial compression artifacts arise as a result of quantization of the transform-domain coefficients, and are often manifested as blocking and ringing artifacts. Temporal limitations in compressed video occur when the encoder, in an effort to reduce bandwidth, drops frames. Omitting frames decreases the reconstructed frame rate, which can cause motion to appear jerky and uneven. This paper discusses a method to increase the frame rate of video compressed with the DCT by inserting images between received frames of the sequence. The Bayesian formulation of the restoration prevents spatial compression artifacts in the received frames from propagating to the reconstructed frames.

[1]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block transform compressed images , 1994, Other Conferences.

[2]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[3]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[4]  Nikolas P. Galatsanos,et al.  Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images , 1993, IEEE Trans. Circuits Syst. Video Technol..

[5]  G. McCormick,et al.  Iterative Methods for Nonlinear Optimization , 1973 .

[6]  Robert THOMA,et al.  Motion compensating interpolation considering covered and uncovered background , 1989, Signal Process. Image Commun..

[7]  Itu-T.  Video coding for low bitrate communication , 1996 .

[8]  Aggelos K. Katsaggelos,et al.  Reduction of blocking artifacts in block transformed compressed color images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[9]  K. Rijkse,et al.  H.263: video coding for low-bit-rate communication , 1996, IEEE Commun. Mag..

[10]  Stefano Tubaro,et al.  Motion compensated image interpolation , 1990, IEEE Trans. Commun..

[11]  Robert L. Stevenson,et al.  Improved image decompression for reduced transform coding artifacts , 1994, Electronic Imaging.

[12]  Chi-Kong Wong,et al.  Fast motion compensated temporal interpolation for video , 1995, Other Conferences.

[13]  King Ngi Ngan,et al.  Reduction of blocking artifacts in image and video coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[14]  Stefano Tubaro,et al.  Motion Field Estimators and their Application to Image Interpolation , 1993 .

[15]  Roberto Castagno,et al.  A method for motion adaptive frame rate up-conversion , 1996, IEEE Trans. Circuits Syst. Video Technol..

[16]  Janusz S. Kowalik,et al.  Iterative methods for nonlinear optimization problems , 1972 .

[17]  Ness B. Shroff,et al.  A Bayesian approach to error concealment in encoded video streams , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.