Full parallax three-dimensional display from Kinect v1 and v2

Abstract. We exploit the two different versions of Kinect, v1 and v2, for the calculation of microimages projected onto integral-imaging displays. Our approach is based on composing a three-dimensional (3-D) point cloud from a captured depth map and RGB information. These fused 3-D maps permit to generate an integral image after projecting the information through a virtual pinhole array. In our analysis, we take into account that each of the Kinect devices has its own inherent capacities and individualities. We illustrate our analysis with some imaging experiments, provide the distinctive differences between the two Kinect devices, and finally conclude that Kinect v2 allows the display of 3-D images with very good resolution and with full parallax.

[1]  Manuel Martinez-Corral,et al.  Computation and Display of 3D Movie From a Single Integral Photography , 2016, Journal of Display Technology.

[2]  Bahram Javidi,et al.  Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics. , 2002, Optics letters.

[3]  Seokmin Hong,et al.  Viewing Angle-Improved 3D Integral Imaging Display with Eye Tracking Sensor , 2014, J. Inform. and Commun. Convergence Engineering.

[4]  Myungjin Cho,et al.  Three-Dimensional Optical Sensing and Visualization Using Integral Imaging , 2011, Proceedings of the IEEE.

[5]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Bahram Javidi,et al.  Three-Dimensional Image Sensing, Visualization, and Processing Using Integral Imaging , 2006, Proceedings of the IEEE.

[7]  Bahram Javidi,et al.  Mid-Wave Infrared 3D Integral Imaging at Long Range , 2013, Journal of Display Technology.

[8]  Kwanghoon Sohn,et al.  Hybrid Stereoscopic Camera System , 2011 .

[9]  Yiqun Liu,et al.  Integral imaging display for natural scene based on KinectFusion , 2016 .

[10]  Byoungho Lee,et al.  Recent researches based on integral imaging display method , 2010 .

[11]  Livio Pinto,et al.  Calibration of Kinect for Xbox One and Comparison between the Two Generations of Microsoft Sensors , 2015, Sensors.

[12]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[13]  Sung-Wook Min,et al.  Multi-viewer tracking integral imaging system and its viewing zone analysis. , 2009, Optics express.

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Byung-Gook Lee,et al.  Towards 3D Television Through Fusion of Kinect and Integral-Imaging Concepts , 2015, Journal of Display Technology.