Regularization function for video super-resolution using auxiliary high resolution still images

In this paper video super-resolution using sequences generated by dual-mode cameras is studied. Dual-mode cameras are capable to shoot high-resolution still images at a low rate while taking low-resolution video from the scene. An algorithm for video super-resolution is proposed which uses high-resolution still images generated by the dual-mode cameras for super-resolution process. We use high-resolution still images to form a regularization function and use it for the de-blurring stage of the super-resolution process. The simulation results show that performance of the proposed algorithm is superior in terms of recovering high-frequency details of the original video and edge reconstruction.

[1]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[2]  Kai-Kuang Ma,et al.  Correction to "a new diamond search algorithm for fast block-matching motion estimation" , 2000, IEEE Trans. Image Process..

[3]  Cosmin Ancuti,et al.  Video super-resolution using high quality photographs , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Byung Cheol Song,et al.  Video Super-Resolution Algorithm Using Bi-Directional Overlapped Block Motion Compensation and On-the-Fly Dictionary Training , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Debargha Mukherjee,et al.  Super-resolution of video using key frames and motion estimation , 2008, 2008 15th IEEE International Conference on Image Processing.

[7]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[8]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[9]  Krystian Mikolajczyk,et al.  Combining High-Resolution Images With Low-Quality Videos , 2008, BMVC.