Free segmentation in rendered 3D images through synthetic impulse response in integral imaging

Integral Imaging is a technique that has the capability of providing not only the spatial, but also the angular information of three-dimensional (3D) scenes. Some important applications are the 3D display and digital post-processing as for example, depth-reconstruction from integral images. In this contribution we propose a new reconstruction method that takes into account the integral image and a simplified version of the impulse response function (IRF) of the integral imaging (InI) system to perform a two-dimensional (2D) deconvolution. The IRF of an InI system has a periodic structure that depends directly on the axial position of the object. Considering different periods of the IRFs we recover by deconvolution the depth information of the 3D scene. An advantage of our method is that it is possible to obtain nonconventional reconstructions by considering alternative synthetic impulse responses. Our experiments show the feasibility of the proposed method.

[1]  Jae-Young Jang,et al.  Depth extraction by using the correlation of the periodic function with an elemental image in integral imaging. , 2012, Applied optics.

[2]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[3]  Bahram Javidi,et al.  Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics. , 2002, Optics letters.

[4]  Bahram Javidi,et al.  Improved resolution 3D object reconstruction using computational integral imaging with time multiplexing. , 2004, Optics express.

[5]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[6]  Byoungho Lee,et al.  Viewing-angle-enhanced integral three-dimensional imaging along all directions without mechanical movement. , 2003, Optics express.

[7]  F. Okano,et al.  Gradient-index lens-array method based on real-time integral photography for three-dimensional images. , 1998, Applied optics.

[8]  T. Okoshi,et al.  Three-dimensional displays , 1980, Proceedings of the IEEE.

[9]  B. Javidi,et al.  Three-dimensional synthetic aperture integral imaging. , 2002, Optics letters.

[10]  Bahram Javidi,et al.  Perceivable Light Fields: Matching the Requirements Between the Human Visual System and Autostereoscopic 3-D Displays , 2014, Proceedings of the IEEE.

[11]  Dong-Hak Shin,et al.  Computational integral imaging reconstruction method of 3D images using pixel-to-pixel mapping and image interpolation , 2009 .

[12]  C. Helstrom.  Image Restoration by the Method of Least Squares , 1967 .

[13]  Bahram Javidi,et al.  Three-dimensional volumetric object reconstruction using computational integral imaging. , 2004, Optics express.

[14]  Filiberto Pla,et al.  Multispectral integral imaging acquisition and processing using a monochrome camera and a liquid crystal tunable filter. , 2012, Optics express.

[15]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[16]  C. Burckhardt.  Optimum Parameters and Resolution Limitation of Integral Photography , 1968 .

[17]  B. Javidi,et al.  Integral three-dimensional imaging with digital reconstruction. , 2001, Optics letters.

[18]  Bahram Javidi,et al.  Polarimetric 3D integral imaging in photon-starved conditions. , 2015, Optics express.

[19]  B. Javidi,et al.  Non-Homogeneity of Lateral Resolution in Integral Imaging , 2013, Journal of Display Technology.

[20]  Herbert E. Ives,et al.  Optical Properties of a Lippmann Lenticulated Sheet , 1931 .

[21]  Eun-Soo Kim,et al.  3D Image Correlator using Computational Integral Imaging Reconstruction Based on Modified Convolution Property of Periodic Functions , 2014 .

[22]  Eun-Soo Kim,et al.  Optical three-dimensional refocusing from elemental images based on a sifting property of the periodic δ-function array in integral-imaging. , 2014, Optics express.

[23]  B Javidi,et al.  Free-depths reconstruction with synthetic impulse response in integral imaging. , 2015, Optics express.

[24]  B. Javidi,et al.  Computational Reconstruction of Three-Dimensional Integral Imaging by Rearrangement of Elemental Image Pixels , 2009, Journal of Display Technology.