Elemental Image Generation Algorithm Using Reverse Iteration Along Optical Path

We propose a fast elemental image generation algorithm for integral imaging display based on depth information and a two-dimensional scene image. Existing elemental image generation algorithms establish many-to-one mappings from the scene to the elemental image, thereby including redundant calculations. The improved algorithm entails establishing a single mapping from elemental image to the scene. Each pixel in the elemental image matches a unique scene pixel by inverse iteration along the optical path. This establishes a high precision matching and eliminates hole caused by depth discontinuities. In this paper, we obtain a unique mapping solution by inverse iteration along the optical path using a one-pixel step. The time complexity of this algorithm is mainly driven by the pixel sum of the elemental image array. We generate the elemental image seven times faster than the original algorithm. The larger total quantity of the scene pixels further demonstrates the advantages of our algorithm. The experiments show that the update rate can reach more than 30 fps according to the VCD standard (352×240 resolution) using four parallel calculation threads with a four-core Intel® Core(TM) i7-7500U 2.70 GHz CPU despite various delay factors. The results verify the correctness of the theoretical analysis.

[1]  Bahram Javidi,et al.  Augmented Reality 3D Displays With Micro Integral Imaging , 2015, Journal of Display Technology.

[2]  Bahram Javidi,et al.  Large depth of focus dynamic micro integral imaging for optical see-through augmented reality display using a focus-tunable lens. , 2018, Applied optics.

[3]  Byoungho Lee,et al.  Real-time capturing and 3D visualization method based on integral imaging. , 2013, Optics express.

[4]  Genaro Saavedra,et al.  Full parallax three-dimensional display from Kinect v1 and v2 , 2016 .

[5]  王琼华 Wang Qionghua,et al.  Real-time integral imaging pickup system based on binocular stereo camera , 2017 .

[6]  Xiaocong Yuan,et al.  Dual-camera enabled real-time three-dimensional integral imaging pick-up and display. , 2012, Optics express.

[7]  Kwan-Hee Yoo,et al.  Simplified Integral Imaging Pickup Method for Real Objects Using a Depth Camera , 2012 .

[8]  Jeong-A Lee,et al.  Fast 3D Computational Integral Imaging Using Graphics Processing Unit , 2012, Journal of Display Technology.

[9]  Makoto Okui,et al.  Integral three-dimensional television using a 2000-scanning-line video system. , 2006, Applied optics.

[10]  Takeshi Naemura,et al.  TransCAIP: A Live 3D TV System Using a Camera Array and an Integral Photography Display with Interactive Control of Viewing Parameters , 2009, IEEE Transactions on Visualization and Computer Graphics.

[11]  Filiberto Pla,et al.  Depth and All-in-Focus Image Estimation in Synthetic Aperture Integral Imaging Under Partial Occlusions , 2019, IEEE Access.

[12]  Xingpeng Yan,et al.  Nonlinear mapping method for the generation of an elemental image array in a photorealistic pseudoscopic free 3D display. , 2018, Applied optics.

[13]  Yiqun Liu,et al.  Integral imaging display for natural scene based on KinectFusion , 2016 .

[14]  Byoungho Lee,et al.  Real-time depth controllable integral imaging pickup and reconstruction method with a light field camera. , 2015, Applied optics.

[15]  Ruigang Yang,et al.  Toward the Light Field Display: Autostereoscopic Rendering via a Cluster of Projectors , 2008, IEEE Transactions on Visualization and Computer Graphics.

[16]  Anting Wang,et al.  High Optical Efficiency Lensless 2D–3D Convertible Integral Imaging Display Using an Edge-Lit Light Guide Plate , 2016, Journal of Display Technology.

[17]  朴燕 Piao Yan,et al.  Computational Reconstruction for Integral Imaging with Sampled Elemental Images , 2014 .

[18]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[19]  Xiaochun Cao,et al.  Geometric Occlusion Analysis in Depth Estimation Using Integral Guided Filter for Light-Field Image , 2017, IEEE Transactions on Image Processing.

[20]  M. Martinez-Corral,et al.  Fuzzy Integral Imaging Camera Calibration for Real Scale 3D Reconstructions , 2014, Journal of Display Technology.