Scene and Motion Reconstruction from Defocused and Motion-Blurred Images via Anisotropic Diffusion

We propose a solution to the problem of inferring the depth map, radiance and motion of a scene from a collection of motion-blurred and defocused images. We model motion-blur and defocus as an anisotropic diffusion process, whose initial conditions depend on the radiance and whose diffusion tensor encodes the shape of the scene, the motion field and the optics parameters. We show that this model is well-posed and propose an efficient algorithm to infer the unknowns of the model. Inference is performed by minimizing the discrepancy between the measured blurred images and the ones synthesized via forward diffusion. Since the problem is ill-posed, we also introduce additional Tikhonov regularization terms. The resulting method is fast and robust to noise as shown by experiments with both synthetic and real data.

[1]  Mostafa Kaveh,et al.  Blind image restoration by anisotropic regularization , 1999, IEEE Trans. Image Process..

[2]  Bruce Fischl,et al.  Learning an Integral Equation Approximation to Nonlinear Anisotropic Diffusion in Image Processing , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  N S Kopeika,et al.  Comparison of direct blind deconvolution methods for motion-blurred images. , 1999, Applied optics.

[4]  J HeegerDavid,et al.  Subspace methods for recovering rigid motion I , 1992 .

[5]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Steven A. Shafer,et al.  Depth from focusing and defocusing , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Roberto Cipolla,et al.  Computer Vision — ECCV '96 , 1996, Lecture Notes in Computer Science.

[8]  Andrew Blake,et al.  Motion Deblurring and Super-resolution from an Image Sequence , 1996, ECCV.

[9]  Rachid Deriche,et al.  Vector-valued image regularization with PDE's: a common framework for different applications , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Subhasis Chaudhuri,et al.  Depth From Defocus: A Real Aperture Imaging Approach , 1999, Springer New York.

[11]  Shmuel Peleg,et al.  Restoration of multiple images with motion blur in different directions , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[12]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[13]  Rachid Deriche,et al.  Vector-valued image regularization with PDEs: a common framework for different applications , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Shree K. Nayar,et al.  Motion deblurring using hybrid imaging , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[16]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[17]  Shree K. Nayar,et al.  Rational Filters for Passive Depth from Defocus , 1998, International Journal of Computer Vision.

[18]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[20]  Allan D. Jepson,et al.  Subspace methods for recovering rigid motion I: Algorithm and implementation , 2004, International Journal of Computer Vision.

[21]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[22]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[23]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[24]  Stefano Soatto,et al.  3D shape from anisotropic diffusion , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[25]  Gjlles Aubert,et al.  Mathematical problems in image processing , 2001 .

[26]  Peter Lawrence,et al.  An Investigation of Methods for Determining Depth from Focus , 1993, IEEE Trans. Pattern Anal. Mach. Intell..