Image destabilization: Programmable defocus using lens and sensor motion

We propose a novel camera setup in which both the lens and the sensor are perturbed during the exposure. We analyze the defocus effects produced by such a setup, and use it to demonstrate new methods for simulating a lens with a larger effective aperture size (i.e., shallower depth of field) and methods for achieving approximately depth-independent defocus blur size. We achieve exaggerated, programmable, and pleasing bokeh with relatively small aperture sizes such as those found on cell phone cameras. Destabilizing the standard alignment of the sensor and lens allows us to introduce programmable defocus effects and achieve greater flexibility in the image capture process.

[1]  Narendra Ahuja,et al.  Range estimation from focus using a non-frontal imaging camera , 1993, International Journal of Computer Vision.

[2]  Shree K. Nayar,et al.  Lensless Imaging with a Controllable Aperture , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Frédo Durand,et al.  Defocus Magnification , 2007, Comput. Graph. Forum.

[4]  G. Häusler,et al.  A method to increase the depth of focus by two step image processing , 1972 .

[5]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[6]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH '06.

[7]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, ACM Trans. Graph..

[8]  Edward R. Dowski,et al.  A New Paradigm for Imaging Systems , 2002, PICS.

[9]  Gerald C. Holst,et al.  CCD arrays, cameras, and displays , 1996 .

[10]  Shree K. Nayar,et al.  Transactions on Pattern Analysis and Machine Intelligence Flexible Depth of Field Photography 1 Depth of Field , 2022 .

[11]  Kiriakos N. Kutulakos,et al.  A Layer-Based Restoration Framework for Variable-Aperture Photography , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Frédo Durand,et al.  Motion-invariant photography , 2008, ACM Trans. Graph..

[13]  Y. Schechner,et al.  Propagation-invariant wave fields with finite energy. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.