Real-time capture and reconstruction system with multiple GPUs for a 3D live scene by a generation from 4K IP images to 8K holograms.

We developed a real-time capture and reconstruction system for three-dimensional (3D) live scenes. In previous research, we used integral photography (IP) to capture 3D images and then generated holograms from the IP images to implement a real-time reconstruction system. In this paper, we use a 4K (3,840 × 2,160) camera to capture IP images and 8K (7,680 × 4,320) liquid crystal display (LCD) panels for the reconstruction of holograms. We investigate two methods for enlarging the 4K images that were captured by integral photography to 8K images. One of the methods increases the number of pixels of each elemental image. The other increases the number of elemental images. In addition, we developed a personal computer (PC) cluster system with graphics processing units (GPUs) for the enlargement of IP images and the generation of holograms from the IP images using fast Fourier transform (FFT). We used the Compute Unified Device Architecture (CUDA) as the development environment for the GPUs. The Fast Fourier transform is performed using the CUFFT (CUDA FFT) library. As a result, we developed an integrated system for performing all processing from the capture to the reconstruction of 3D images by using these components and successfully used this system to reconstruct a 3D live scene at 12 frames per second.

[1]  Mark Lucente.  Computational Holographic Bandwith Compression , 1996, IBM Syst. J..

[2]  K. Yamamoto,et al.  Viewing-Zone-Angle-Expanded Color Electronic Holography System Using Ultra-High-Definition Liquid Crystal Displays With Undesirable Light Elimination , 2011, Journal of Display Technology.

[3]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[4]  R. V. Pole,et al.  3‐D IMAGERY AND HOLOGRAMS OF OBJECTS ILLUMINATED IN WHITE LIGHT , 1967 .

[5]  Nobuyuki Hashimoto,et al.  Real-time holography using the high-resolution LCTV-SLM , 1991, Electronic Imaging.

[6]  Yasuyuki Ichihashi,et al.  One-unit system to reconstruct a 3-D movie at a video-rate via electroholography. , 2009, Optics express.

[7]  H Harashima,et al.  3-D computer graphics based on integral photography. , 2001, Optics express.

[8]  F. Okano,et al.  Time-alternating method based on single-sideband holography with half-zone-plate processing for the enlargement of viewing zones. , 1999, Applied optics.

[9]  F. Okano,et al.  Analysis of resolution limitation of integral photography , 1998 .

[10]  Toshio Honda,et al.  Fast computation of holograms for the interactive holographic 3D display system , 1995, Other Conferences.

[11]  Sundeep Jolly,et al.  Diffraction specific coherent panoramagrams of real scenes , 2011, OPTO.

[12]  Mark E. Lucente,et al.  Electronic display system for computational holography , 1990, Photonics West - Lasers and Applications in Science and Engineering.

[13]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[14]  Mark Lucente,et al.  Rendering interactive holographic images , 1995, SIGGRAPH.

[15]  F. Okano,et al.  Gradient-index lens-array method based on real-time integral photography for three-dimensional images. , 1998, Applied optics.

[16]  Koki Sato,et al.  Holographic television by liquid-crystal device , 1992, Electronic Imaging.

[17]  Yasuhiro Takaki,et al.  Development of a Holographic Display Module Using a 4k2k-SLM Based on the Resolution Redistribution Technique , 2012 .

[18]  Olof Bryngdahl,et al.  Single-Sideband Holography* , 1968 .

[19]  G Tricoles,et al.  Computer generated holograms: an historical review. , 1987, Applied optics.

[20]  Takanori Senoh,et al.  Real-time color holography system for live scene using 4K2K video system , 2010, OPTO.

[21]  Sundeep Jolly,et al.  Depth perception and user interface in digital holographic television , 2012, OPTO.

[22]  Mark E. Lucente.  Holographic bandwidth compression using spatial subsampling , 1996 .

[23]  Yasuyuki Ichihashi,et al.  Simplified electroholographic color reconstruction system using graphics processing unit and liquid crystal display projector. , 2009, Optics express.