Direct super-resolution and registration using raw CFA images

Super-resolution has been applied mainly to grayscale images, but producing a high-resolution color image using a single CCD sensor has not been investigated in detail until recently. This work aims at producing a high-resolution color image directly from raw "color mosaic" images obtained by a single CCD equipped with a color filter array. This method is based on a generalized formulation of super-resolution that simultaneously performs both resolution enhancement and demosaicing. The other key factor of our topic is a precise sub-pixel registration of multiple raw images. We examined direct registration of raw images based on an imaging model, which shows precise estimation of motion among severely aliased raw images. The proposed method is verified through experiments using synthetic and real images.

[1]  M. Shimizu,et al.  Precise sub-pixel estimation on area-based matching , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Joonki Paik,et al.  Adaptive regularized image interpolation using data fusion and steerable constraints , 2000, IS&T/SPIE Electronic Imaging.

[3]  Masatoshi Okutomi,et al.  Color Super-Resolution from a Single CCD , 2003 .

[4]  Michael Elad,et al.  Multiframe demosaicing and super-resolution from undersampled color images , 2004, IS&T/SPIE Electronic Imaging.

[5]  Shmuel Peleg,et al.  Multi-sensor super-resolution , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[6]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[7]  A. Murat Tekalp,et al.  High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Robert L. Stevenson,et al.  Improved definition video frame enhancement , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[9]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..