A Neural Network Method for Image Resolution Enhancement from a Multiple of Image Frames

This paper presents a neural network based method to estimate a high resolution image from a sequence of low resolution image frames. In this method, a multiple of layered feed-forward neural networks is specially designed to learn an optimal mapping from a multiple of low resolution image frames to a high resolution image through training. Simulation results demonstrate that the proposed neural networks can successfully learn the mapping in the presented examples and show a good potential in solving image resolution enhancement problem, as it can adapt itself to the various changeable conditions. Furthermore, due to the inherent parallel computing structure of neural network, this method can be applied for real-time application, alleviating the computational bottlenecks associated with other methods and providing a more powerful tool for image resolution enhancement.

[1]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[2]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[3]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[4]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[5]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[6]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[7]  Russell C. Hardie,et al.  High-resolution image reconstruction from digital video by exploitation of nonglobal motion , 1999 .

[8]  T. S. Huang,et al.  Advances in computer vision & image processing , 1988 .

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[11]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[12]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[13]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .