Fast motion deblurring using gyroscopes and strong edge prediction

This paper presents a fast deblurring algorithm to remove camera motion blur from a single photograph using built-in gyroscopes and strong edge prediction. An inaccurate blur kernel or point spread function (PSF) usually leads to an unsatisfying restored result. Hence, we propose a robust three-phase method for accurate PSF estimation. In the first stage, we utilize the embedded gyroscopes to compute a coarse version of the PSF from the camera's angular velocity during an exposure. In order to reduce the execution time of the later PSF modification, we introduce a patch selection procedure in the second stage to choose a suitable region from the blurry image based on the size of the coarse PSF estimated in stage one. The third phase aims to modify the coarse PSF to obtain an accurate one by predicting strong edges from an estimated latent image. In our experiments, we compare the restoration performance of several state-of-the-art approaches including ours and find that the proposed method outperforms others qualitatively as well as quantitatively. In addition, our method is also compared with the multi-scale approach without gyroscope data and shows shorter processing time and comparable deblurring quality. To the best of our knowledge, this is the first work that combines the sensor-aided method with the image-based approach to estimate the blur kernel.

[1]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[3]  Robert L. Stevenson,et al.  Multi-image motion deblurring aided by inertial sensors , 2016, J. Electronic Imaging.

[4]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Rob Fergus,et al.  Blind deconvolution using a normalized sparsity measure , 2011, CVPR 2011.

[6]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[7]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[8]  Adam Finkelstein,et al.  A no-reference metric for evaluating the quality of motion deblurring , 2013, ACM Trans. Graph..

[9]  Seungyong Lee,et al.  Fast motion deblurring , 2009, ACM Trans. Graph..

[10]  Filip Sroubek,et al.  Image deblurring in smartphone devices using built-in inertial measurement sensors , 2013, J. Electronic Imaging.

[11]  Shang-Hong Lai,et al.  Blind Image Deblurring with Modified Richardson-Lucy Deconvolution for Ringing Artifact Suppression , 2011, PSIVT.

[12]  Eunsung Lee,et al.  Fast Motion Deblurring Using Sensor-Aided Motion Trajectory Estimation , 2014, TheScientificWorldJournal.

[13]  S. B. Kang,et al.  Image deblurring using inertial measurement sensors , 2010, ACM Trans. Graph..

[14]  Wen Gao,et al.  Image deblurring using robust sparsity priors , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  Marc Levoy,et al.  Gyro-Based Multi-image Deconvolution for Removing Handshake Blur , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .