Image-fusion-based adaptive regularization for image expansion

This paper presents a regularized image sequence interpolation algorithm, which can restore high frequency details by fusing low-resolution frames. Image fusion algorithm gives the feasibility of using different data sets, which correspond to the same scene to get a better resolution and information of the scene than the one obtained using only one data set. Based on the mathematical model of image degradation, we can have an interpolated image which minimizes both residual between the high resolution and the interpolated images with a prior constraint. In addition, by using spatially adaptive regularization parameters, directional high frequency components are preserved with efficiently suppressed noise. The proposed algorithm provides a better-interpolated image by fusing low-resolution frames. We provide experimental results which are classified into non-fusion and fusion algorithms. Based on the experimental results, the proposed algorithm provides a better interpolated image than the conventional interpolation algorithms in the sense of both subjective and objective criteria. More specifically, the proposed algorithm has the advantage of preserving high frequency components and suppressing undesirable artifacts such as noise.

[1]  Jae S. Lim,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[2]  H. Trussell,et al.  The feasible solution in signal restoration , 1984 .

[3]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[4]  Aggelos K. Katsaggelos,et al.  Iterative Image Restoration Algorithms , 1989 .

[5]  Kiyoharu Aizawa,et al.  A scheme for acquiring very high resolution images using multiple cameras , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Chung J. Kuo,et al.  Adaptive interpolation technique for scanning rate conversion , 1996, IEEE Trans. Circuits Syst. Video Technol..

[7]  Michael Unser,et al.  Fast B-spline Transforms for Continuous Image Representation and Interpolation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Joonki Paik,et al.  Fast superresolution for image sequences using motion adaptive relaxation parameters , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[9]  Aggelos K. Katsaggelos,et al.  Iterative algorithm for improving the resolution of video sequences , 1996, Other Conferences.

[10]  Andrew J. Patti,et al.  High resolution standards conversion of low resolution video , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[11]  J. A. Parker,et al.  Comparison of Interpolating Methods for Image Resampling , 1983, IEEE Transactions on Medical Imaging.

[12]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[13]  Arun N. Netravali,et al.  Image Restoration Based on a Subjective Criterion , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  Aggelos K. Katsaggelos,et al.  A regularized iterative image restoration algorithm , 1991, IEEE Trans. Signal Process..

[15]  Jorge Herbert de Lira,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[16]  김효주,et al.  디지털 캠코더용 고화질 영상 확대 알고리즘 개발 ( An Edge-Preserving Image Interpolation System For a Digital Camcorder ) , 1996 .

[17]  D. Youla,et al.  Image Restoration by the Method of Convex Projections: Part 1ߞTheory , 1982, IEEE Transactions on Medical Imaging.

[18]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[19]  Min-Cheol Hong,et al.  An iterative weighted regularized algorithm for improving the resolution of video sequences , 1997, Proceedings of International Conference on Image Processing.

[20]  A. Murat Tekalp,et al.  High-resolution image reconstruction from a low-resolution image sequence in the presence of time-varying motion blur , 1992, Proceedings of 1st International Conference on Image Processing.

[21]  J. Paik,et al.  Regularized Interative Image Interpolation and its application to Spatially Scalable Coding , 1998, International 1998 Conference on Consumer Electronics.

[22]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[23]  R.W. Schafer,et al.  Constrained iterative restoration algorithms , 1981, Proceedings of the IEEE.