Blurred/Non-Blurred Image Alignment using Sparseness Prior

Aligning a pair of blurred and non-blurred images is a prerequisite for many image and video restoration and graphics applications. The traditional alignment methods such as direct and feature-based approaches cannot be used due to the presence of motion blur in one image of the pair. In this paper, we present an effective and accurate alignment approach for a blurred/non-blurred image pair. We exploit a statistical characteristic of the real blur kernel - the marginal distribution of kernel value is sparse. Using this sparseness prior, we can search the best alignment which produces the sparsest blur kernel. The search is carried out in scale space with a coarse-to-fine strategy for efficiency. Finally, we demonstrate the effectiveness of our algorithm for image deblurring, video restoration, and image matting.

[1]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  Qi Tian,et al.  Algorithms for subpixel registration , 1986 .

[4]  Andrew Blake,et al.  Motion Deblurring and Super-resolution from an Image Sequence , 1996, ECCV.

[5]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[6]  Jan Flusser,et al.  Degraded Image Analysis: An Invariant Approach , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Shmuel Peleg,et al.  Restoration of multiple images with motion blur in different directions , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[8]  Jan Flusser,et al.  Moment Forms Invariant to Rotation and Blur in Arbitrary Number of Dimensions , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Assaf Zomet,et al.  Learning how to inpaint from global image statistics , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Bryan C. Russell,et al.  Exploiting the sparse derivative prior for super-resolution , 2003 .

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  Harry Shum,et al.  Bayesian Correction of Image Intensity with Spatial Consideration , 2004, ECCV.

[13]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Shmuel Peleg,et al.  Two motion-blurred images are better than one , 2005, Pattern Recognit. Lett..

[15]  Amit K. Agrawal,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, ACM Trans. Graph..

[16]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.

[17]  Anat Levin,et al.  User Assisted Separation of Reflections from a Single Image Using a Sparsity Prior , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .