Viewing Angle-Improved 3D Integral Imaging Display with Eye Tracking Sensor

In this paper, in order to solve the problems of a narrow viewing angle and the flip effect in a three-dimensional (3D) integral imaging display, we propose an improved system by using an eye tracking method based on the Kinect sensor. In the proposed method, we introduce two types of calibration processes. First process is to perform the calibration between two cameras within Kinect sensor to collect specific 3D information. Second process is to use a space calibration for the coordinate conversion between the Kinect sensor and the coordinate system of the display panel. Our calibration processes can provide the improved performance of estimation for 3D position of the observer’s eyes and generate elemental images in real-time speed based on the estimated position. To show the usefulness of the proposed method, we implement an integral imaging display system using the eye tracking process based on our calibration processes and carry out the preliminary experiments by measuring the viewing angle and flipping effect for the reconstructed 3D images. The experimental results reveal that the proposed method extended the viewing angles and removed the flipping images compared with the conventional system.

[1]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[2]  Zhengyou Zhang.  Estimating Projective Transformation Matrix (Collineation, Homography) , 2010 .

[3]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[4]  B. Javidi,et al.  Integral imaging with improved depth of field by use of amplitude-modulated microlens arrays. , 2004, Applied optics.

[5]  Seung-Hyun Lee,et al.  Optical display of true 3D objects in depth-priority integral imaging using an active sensor , 2007 .

[6]  Sung-Wook Min,et al.  Multi-viewer tracking integral imaging system and its viewing zone analysis. , 2009, Optics express.

[7]  Byung-Gook Lee,et al.  Resolution-enhanced integral imaging in focal mode with a time-multiplexed electrical mask array. , 2014, Optics express.

[8]  Byoungho Lee,et al.  Recent researches based on integral imaging display method , 2010 .

[9]  Hwajeong Seo,et al.  Low-Power Encryption Algorithm Block Cipher in JavaScript , 2014, J. Inform. and Commun. Convergence Engineering.

[10]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[11]  Chan-Yong Jin,et al.  A Meta-analysis of the Relationship between Mediator Factors and Purchasing Intention in E-commerce Studies , 2014, J. Inform. and Commun. Convergence Engineering.

[12]  Eun-Soo Kim,et al.  Multi-projection integral imaging by use of a convex mirror array. , 2014, Optics letters.

[13]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[14]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Bahram Javidi,et al.  Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics. , 2002, Optics letters.

[16]  Bahram Javidi,et al.  Three-Dimensional Image Sensing, Visualization, and Processing Using Integral Imaging , 2006, Proceedings of the IEEE.

[17]  Joohwan Kim,et al.  Resolution-enhanced three-dimension / two-dimension convertible display based on integral imaging. , 2005, Optics express.

[18]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.