Real-time light-field 3D telepresence

Light-field technology is often looked at as the final frontier of glasses-free 3D visualization, as no additional viewing gear is required to experience its capabilities to their full extent. Among the numerous industrial and commercial use cases, light-field telepresence stands out, as such natural visualization may significantly boost the sense of presence. In this paper, we present a fully-implemented real-time light-field 3D telepresence system. We provide a comprehensive analysis of the implementation of the one-way system, highlighting how the achieved capabilities satisfy the reasonable requirements towards such system. The paper also discusses future enhancements to the 3D telepresence system, since its true potential is yet to be fulfilled.

[1]  Du-Sik Park,et al.  Optimal projector configuration design for 300-Mpixel multi-projection 3D display. , 2013, Optics express.

[2]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[3]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[4]  Dong Tian,et al.  View synthesis techniques for 3D video , 2009, Optical Engineering + Applications.

[5]  Tibor Balogh,et al.  The HoloVizio system , 2006, Electronic Imaging.

[6]  Wenhua Dou,et al.  Demonstration of a large-size real-time full-color three-dimensional display. , 2009, Optics letters.

[7]  Robert Bregovic,et al.  Architectures and Codecs for Real-Time Light Field Streaming , 2017 .

[8]  Leonard McMillan,et al.  A Real-Time Distributed Light Field Camera , 2002, Rendering Techniques.

[9]  Maria G. Martini,et al.  Evaluation of the Concept of Dynamic Adaptive Streaming of Light Field Video , 2018, IEEE Transactions on Broadcasting.

[10]  T. Balogh,et al.  HoloVizio: The Next Generation of 3D Oil & Gas Visualization , 2008 .

[11]  Douglas Lanman,et al.  Near-eye light field displays , 2013, SIGGRAPH Emerging Technologies.

[12]  Péter Tamás Kovács,et al.  Real-time 3D light field transmission , 2010, Photonics Europe.

[13]  Maria G. Martini,et al.  Cinema as large as life: Large-scale light field cinema system , 2017, 2017 International Conference on 3D Immersion (IC3D).

[14]  Qionghai Dai,et al.  A Real Time Interactive Dynamic Light Field Transmission System , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[15]  Markus H. Gross,et al.  Gaze Correction for Home Video Conferencing , 2012 .

[16]  Reinhard Koch,et al.  Efficient Rendering of Light Field Images , 2010, Video Processing and Computational Video.

[17]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[18]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .