Enhanced reconstruction of three-dimensional shape and texture from integral photography images.

A method for the reconstruction of 3D shape and texture from integral photography (IP) images is presented. Sharing the same principles with stereoscopic-based object reconstruction, it offers increased robustness to noise and occlusions due to the unique characteristics of IP images. A coarse-to-fine approach is used, employing what we believe to be a novel grid refinement step in order to increase the quality of the reconstructed objects. The proposed method's properties include configurable depth accuracy and direct and seamless triangulation. We evaluate our method using synthetic data from a computer-simulated IP setup as well as real data from a simple yet effective digital IP setup. Experiments show reconstructed objects of high-quality indicating that IP can be a competitive modality for 3D object reconstruction.

[1]  Byoungho Lee,et al.  Depth extraction by use of a rectangular lens array and one-dimensional elemental image modification. , 2004, Applied optics.

[2]  Bahram Javidi,et al.  Formation of orthoscopic three-dimensional real images in direct pickup one-step integral imaging , 2003 .

[3]  Byoungho Lee,et al.  Computational Reconstruction of Three-Dimensional Objects in Integral Imaging using Lenslet Array , 2005 .

[4]  Bahram Javidi,et al.  Improved resolution 3D object sensing and recognition using time multiplexed computational integral imaging. , 2003, Optics express.

[5]  Dimitrios E. Maroulis,et al.  Photorealistic integral photography using a ray-traced model of capturing optics , 2006, J. Electronic Imaging.

[6]  Bahram Javidi,et al.  Formation of real, orthoscopic integral images by smart pixel mapping. , 2005, Optics express.

[7]  Nicholas P Sgouros,et al.  Accurate lattice extraction in integral images. , 2006, Optics express.

[8]  S Nakajima,et al.  Three-dimensional medical imaging display with computer-generated integral photography. , 2001, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[9]  Bahram Javidi,et al.  Digital three-dimensional image correlation by use of computer-reconstructed integral imaging. , 2002, Applied optics.

[10]  Joohwan Kim,et al.  Three-dimensional display scheme based on integral imaging with three-dimensional information processing. , 2004, Optics express.

[11]  Bahram Javidi,et al.  Two-step integral imaging for orthoscopic three-dimensional imaging with improved viewing resolution , 2002 .

[12]  Jung-Young Son,et al.  Depth resolution and displayable depth of a scene in three-dimensional images. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.