Progressive hologram transmission using a view-dependent scalable compression scheme

Over the last few years, holography has been emerging as an alternative to stereoscopic imaging since it provides users with the most realistic and comfortable three-dimensional (3D) experience. However, high-quality holograms enabling a free-viewpoint visualization contain tremendous amount of data. Therefore, a user willing to access to a remote hologram repository would face high downloading time, even with high speed networks. To reduce transmission time, a joint viewpoint-quality scalable compression scheme is proposed. At the encoder side, the hologram is first decomposed into a sparse set of diffracted light rays using Matching Pursuit over a Gabor atoms dictionary. Then, the atoms corresponding to a given user’s viewpoint are selected to form a sub-hologram. Finally, the pruned atoms are sorted and encoded according to their importance for the reconstructed view. The proposed approach allows a progressive decoding of the sub-hologram from the first received atom. Streaming simulations for a moving user reveal that our approach outperforms conventional scalable codecs such as scalable H.265 and enables a practical streaming with a better quality of experience.

[1]  Patrick Gioia,et al.  View-dependent compression of digital hologram based on matching pursuit , 2018, Photonics Europe.

[2]  Myung K. Kim Principles and techniques of digital holographic microscopy , 2010 .

[3]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Jingang Zhong,et al.  Reconstruction of Digital Hologram by use of the Wavelet Transform , 2009 .

[5]  Michel Barlaud,et al.  JPEG2000-Compatible Scalable Scheme for Wavelet-Based Video Coding , 2007, EURASIP J. Image Video Process..

[6]  Takeshi Yamaguchi,et al.  Computer-generated holograms for 3D display , 2009 .

[7]  Béatrice Pesquet-Popescu,et al.  Color digital hologram compression based on matching pursuit. , 2018, Applied optics.

[8]  Thierry Blu,et al.  Fresnelets: new multiresolution wavelet bases for digital holography , 2003, IEEE Trans. Image Process..

[9]  Jens-Rainer Ohm,et al.  Advances in Scalable Video Coding , 2005, Proceedings of the IEEE.

[10]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[11]  P. Hariharan,et al.  Optical Holography: Principles, Techniques and Applications , 1987 .

[12]  Christian Timmerer,et al.  Dynamic adaptive streaming over HTTP dataset , 2012, MMSys '12.

[13]  Luce Morin,et al.  Computer generated hologram from Multiview-plus-Depth data considering specular reflections , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[14]  John J. Soraghan,et al.  Use of Fresnelets for Phase-Shifting Digital Hologram Compression , 2006, IEEE Transactions on Image Processing.

[15]  E. Leith,et al.  Reconstructed Wavefronts and Communication Theory , 1962 .

[16]  Ichirou Yamaguchi,et al.  Phase-shifting digital holography , 1997 .

[17]  R. Häussler,et al.  Large holographic displays for real-time applications , 2008, SPIE OPTO.

[18]  Jae-Hyeung Park,et al.  Compression of digital hologram for three-dimensional object using Wavelet-Bandelets transform. , 2011, Optics express.

[19]  Mounir Kaaniche,et al.  Vector lifting scheme for phase-shifting holographic data compression , 2014 .

[20]  David Blinder,et al.  JPEG 2000-based compression of fringe patterns for digital holographic microscopy , 2014 .

[21]  Jianle Chen,et al.  Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding Standard , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Sergei S. Orlov,et al.  Holographic data storage systems , 1993, Proceedings of the IEEE.

[23]  Chris Slinger,et al.  Computer-generated holography as a generic display technology , 2005, Computer.

[24]  David Blinder,et al.  Computer-generated holograms by multiple wavefront recording plane method with occlusion culling. , 2015, Optics express.

[25]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[26]  Bahram Javidi,et al.  Compression of digital holograms of three-dimensional objects using wavelets. , 2006, Optics express.

[27]  Ji-Sang Yoo,et al.  Scalable hologram video coding for adaptive transmitting service. , 2013, Applied optics.

[28]  Colas Schretter,et al.  Unitary Transforms Using Time-Frequency Warping for Digital Holograms of Deep Scenes , 2018, IEEE Transactions on Computational Imaging.

[29]  Vijay Garg,et al.  Wireless Communications & Networking , 2007 .

[30]  Catarina Brites,et al.  Holographic Data Coding: Benchmarking and Extending HEVC With Adapted Transforms , 2018, IEEE Transactions on Multimedia.

[31]  B Javidi,et al.  Securing information by use of digital holography. , 2000, Optics letters.

[32]  Touradj Ebrahimi,et al.  JPEG Pleno: Providing representation interoperability for holographic applications and devices , 2019 .

[33]  L. Onural,et al.  State of the Art in Holographic Displays: A Survey , 2010, Journal of Display Technology.

[34]  J. Goodman Introduction to Fourier optics , 1969 .

[35]  Shigeru Murata,et al.  Potential of digital holography in particle measurement , 2000 .

[36]  L. Morin,et al.  Hybrid approach for fast occlusion processing in computer-generated hologram calculation. , 2016, Applied optics.

[37]  Sang Uk Lee,et al.  Viewing angle dependent coding of digital holograms , 2011, 2011 19th European Signal Processing Conference.

[38]  Martin Vetterli,et al.  Receiver-driven layered multicast , 1996, SIGCOMM 1996.

[39]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[40]  Colas Schretter,et al.  Signal processing challenges for digital holographic video display systems , 2019, Signal Process. Image Commun..

[41]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[42]  Mounir Kaaniche,et al.  Adaptive nonseparable vector lifting scheme for digital holographic data compression. , 2015, Applied optics.

[43]  R. W. Lawrence,et al.  Digital Image Formation From Electronically Detected Holograms , 1967 .

[44]  Luce Morin,et al.  Wavelet compression of digital holograms: Towards a view-dependent framework , 2013, Optics & Photonics - Optical Engineering + Applications.

[45]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Ching-Jen Chen,et al.  Numerical simulation of flow in a screw-type blood pump , 2005, J. Vis..

[47]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[48]  Béatrice Pesquet-Popescu,et al.  Compression of computer generated phase-shifting hologram sequence using AVC and HEVC , 2013, Optics & Photonics - Optical Engineering + Applications.