Spatially adaptive high-resolution image reconstruction of DCT-based compressed images

The problem of recovering a high-resolution image from a sequence of low-resolution DCT-based compressed observations is considered in this paper. The introduction of compression complicates the recovery problem. We analyze the DCT quantization noise and propose to model it in the spatial domain as a colored Gaussian process. This allows us to estimate the quantization noise at low bit-rates without explicit knowledge of the original image frame, and we propose a method that simultaneously estimates the quantization noise along with the high-resolution data. We also incorporate a nonstationary image prior model to address blocking and ringing artifacts while still preserving edges. To facilitate the simultaneous estimate, we employ a regularization functional to determine the regularization parameter without any prior knowledge of the reconstruction procedure. The smoothing functional to be minimized is then formulated to have a global minimizer in spite of its nonlinearity by enforcing convergence and convexity requirements. Experiments illustrate the benefit of the proposed method when compared to traditional high-resolution image reconstruction methods. Quantitative and qualitative comparisons are provided.

[1]  Aggelos K. Katsaggelos,et al.  Signal Recovery Techniques for Image and Video Compression and Transmission , 1998, Springer US.

[2]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[3]  Aggelos K. Katsaggelos,et al.  Spatially adaptive iterative algorithm for the restoration of astronomical images , 1995, Int. J. Imaging Syst. Technol..

[4]  Robert L. Stevenson,et al.  DCT quantization noise in compressed images , 2001, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block-transform compressed images , 1995, IEEE Trans. Image Process..

[6]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[7]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[8]  Aggelos K. Katsaggelos,et al.  General choice of the regularization functional in regularized image restoration , 1995, IEEE Trans. Image Process..

[9]  Anil K. Jain,et al.  A Sinusoidal Family of Unitary Transforms , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Robert L. Stevenson,et al.  Improved image decompression for reduced transform coding artifacts , 1994, Electronic Imaging.

[11]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[12]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[13]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[14]  Aggelos K. Katsaggelos,et al.  Super-Resolution from Compressed Video , 2002 .

[15]  Daniel Gross,et al.  Improved resolution from subpixel shifted pictures , 1992, CVGIP Graph. Model. Image Process..

[16]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.

[17]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[18]  Aggelos K. Katsaggelos,et al.  Bayesian high-resolution reconstruction of low-resolution compressed video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[19]  Jiebo Luo,et al.  Artifact reduction in low bit rate DCT-based image compression , 1996, IEEE Trans. Image Process..

[20]  P. Yip,et al.  Discrete Cosine Transform: Algorithms, Advantages, Applications , 1990 .

[21]  Jerry D. Gibson,et al.  Distributions of the Two-Dimensional DCT Coefficients for Images , 1983, IEEE Trans. Commun..

[22]  Moon Gi Kang,et al.  Noise-adaptive edge-preserving image restoration algorithm , 2000 .

[23]  B. Widrow,et al.  Statistical theory of quantization , 1996 .

[24]  Richard R. Schultz,et al.  Extraction of high-resolution video stills from MPEG image sequences , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[25]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[26]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[27]  Aggelos K. Katsaggelos,et al.  Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images , 1995, Proceedings., International Conference on Image Processing.

[28]  Nikolas P. Galatsanos,et al.  Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images , 1993, IEEE Trans. Circuits Syst. Video Technol..

[29]  King Ngi Ngan,et al.  Reduction of blocking artifacts in image and video coding , 1999, IEEE Trans. Circuits Syst. Video Technol..