Depth-based computational photography

A depth-based computational photography model is proposed for all-in-focus image capture. A decomposition function, a defocus matrix, and a depth matrix are introduced to construct the photography model. The original image acquired from a camera can be decomposed into several sub-images on the basis of depth information. The defocus matrix can be deduced from the depth matrix according to the sensor defocus geometry for a thin lens model. And the depth matrix is reconstructed using the axial binocular stereo vision algorithm. This photography model adopts an energy functional minimization method to acquire the sharpest image pieces separately. The implementation of the photography method is described in detail. Experimental results for an actual scene demonstrate that our model is effective.

[1]  Bahram Javidi,et al.  Generalization of three-dimensional N-ocular imaging systems under fixed resource constraints. , 2012, Optics letters.

[2]  Tatsuo Arai,et al.  Automated micromanipulation for a microhand with All-In-Focus imaging system , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Tingfa Xu,et al.  Defocus from depth for defocus measurement , 2013 .

[4]  Ramesh Raskar,et al.  Computational photography , 2005, Eurographics.

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  A. Orth,et al.  Light field moment imaging. , 2013, Optics letters.

[7]  Gabriel Thomas,et al.  All-in-Focus Imaging Using a Series of Images on Different Focal Planes , 2005, ICIAR.

[8]  Kazuya Kodama,et al.  Efficient Reconstruction of All-in-Focus Images Through Shifted Pinholes From Multi-Focus Images for Dense Light Field Synthesis and Rendering , 2013, IEEE Transactions on Image Processing.

[9]  Nathan Ickes,et al.  Reconfigurable Processor for Energy-Efficient Computational Photography , 2013, IEEE Journal of Solid-State Circuits.

[10]  Kazuya Kodama,et al.  Simple and Fast All-in-Focus Image Reconstruction Based on Three-Dimensional/Two-Dimensional Transform and Filtering , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[11]  Shigeru Yamada,et al.  Microscopic vision system with all-in-focus and depth images , 2003, Machine Vision and Applications.

[12]  Bahram Javidi,et al.  Three-dimensional imaging and visualization of partially occluded objects using axially distributed stereo image sensing. , 2012, Optics letters.

[13]  Edmund Y Lam,et al.  High-resolution lightfield photography using two masks. , 2012, Optics express.

[14]  Marc Levoy,et al.  CMOS Image Sensors With Multi-Bucket Pixels for Computational Photography , 2012, IEEE Journal of Solid-State Circuits.

[15]  Jun Tanida,et al.  Computational superposition compound eye imaging for extended depth-of-field and field-of-view. , 2012, Optics express.

[16]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Kazuya Kodama,et al.  All-in-Focus Image Generation by Merging Multiple Differently Focused Images in Three-Dimensional Frequency Domain , 2005, PCM.

[18]  Andrea Fusiello,et al.  Generation of All-in-Focus Images by Noise-Robust Selective Fusion of Limited Depth-of-Field Images , 2013, IEEE Transactions on Image Processing.