Towards 3D Television Through Fusion of Kinect and Integral-Imaging Concepts

We report a new procedure for the capture and processing of light proceeding from 3D scenes of some cubic meters in size. Specifically we demonstrate that with the information provided by a kinect device it is possible to generate an array of microimages ready for their projection onto an integral-imaging monitor. We illustrate our proposal with some imaging experiment in which the final result are 3D images displayed with full parallax.

[1]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[2]  J. Geng.  Three-dimensional display technologies. , 2013, Advances in optics and photonics.

[3]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[4]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[6]  Ichiro Sakuma,et al.  Augmented Reality Navigation With Automatic Marker-Free Image Registration Using 3-D Image Overlay for Dental Surgery , 2014, IEEE Transactions on Biomedical Engineering.

[7]  B. Javidi,et al.  Integral three-dimensional imaging with digital reconstruction. , 2001, Optics letters.

[8]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[9]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, ACM Trans. Graph..

[10]  Makoto Okui,et al.  Integral imaging system with enlarged horizontal viewing angle , 2012, Defense, Security, and Sensing.

[11]  Tabassum Nasrin,et al.  Partially occluded object reconstruction using multiple Kinect sensors , 2014, Sensing Technologies + Applications.

[12]  Sharon F. Freedman,et al.  Anterior segment photography in pediatric eyes using the Lytro light field handheld noncontact camera. , 2013, Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus.

[13]  J. Huisken,et al.  Light Sheet Microscopy , 2018 .

[14]  Bahram Javidi,et al.  Three-dimensional display by smart pseudoscopic-to-orthoscopic conversion with tunable focus. , 2014, Applied optics.

[15]  Shree K. Nayar,et al.  PiCam , 2013, ACM Trans. Graph..

[16]  G. Saavedra,et al.  Chapter 1 The Resolution Challenge in 3D Optical Microscopy , 2009 .

[17]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[18]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[19]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[20]  B Javidi,et al.  Method to Remedy Image Degradations Due to Facet Braiding in 3D Integral-Imaging Monitors , 2010, Journal of Display Technology.

[21]  G. Maret,et al.  Coherent backscattering and Anderson localization of light , 2009 .

[22]  Marc Levoy,et al.  Light field microscopy , 2006, ACM Trans. Graph..

[23]  Bahram Javidi,et al.  Formation of real, orthoscopic integral images by smart pixel mapping. , 2005, Optics express.

[24]  Jason Geng,et al.  Review of 3-D Endoscopic Surface Imaging Techniques , 2014, IEEE Sensors Journal.

[25]  Sung-Wook Min,et al.  Three-dimensional display technologies of recent interest: principles, status, and issues [Invited]. , 2011, Applied optics.

[26]  Masayuki Tanimoto,et al.  Multiview Imaging and 3DTV , 2007, IEEE Signal Processing Magazine.