ReMA: Real-time 3D video streaming system for mobile devices

User's multimedia interaction is facing a paradigm shift from 2D to 3D videos. Nonetheless, it is still difficult to watch 3D videos with a mobile device. With current technological barrier in wireless networking, it is hardly imagined that the timely transmission for a 3D video streaming could be feasible with the mobile device. In this paper, we propose ReMA, a novel 3D video distribution system based on a lightweight compression, a linkadaptive transmission scheme, and a network-side assistance for processing capability. ReMA consists of a 3D data transmitter, a receiver, and an infrastructure for generating and distributing 3D videos. We implemented the proposed system in a real testbed and conducted a thorough empirical evaluation study. Based on the empirical results, the proposed system presents a great promise in streaming 3D video in real-time to the mobile device.

[1]  Marco Fiorentino,et al.  A multi-directional backlight for a wide-angle, glasses-free three-dimensional display , 2013, Nature.

[2]  Chong Luo,et al.  Multimedia Cloud Computing , 2011, IEEE Signal Processing Magazine.

[3]  Thomas Wiegand,et al.  3D Video and Free Viewpoint Video - Technologies, Applications and MPEG Standards , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[4]  Aljoscha Smolic,et al.  Reliability-based generation and view synthesis in layered depth video , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[5]  Ahmet M. Kondoz,et al.  Joint source and channel coding for 3D video with depth image - based rendering , 2008, IEEE Transactions on Consumer Electronics.

[6]  Yo-Sung Ho,et al.  Overview of Multi-view Video Coding , 2007, 2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services.

[7]  Neil A. Dodgson,et al.  Autostereoscopic 3D displays , 2005, Computer.

[8]  Jeffrey S. McVeigh,et al.  Intermediate view synthesis considering occluded and ambiguously referenced image regions , 1996, Signal Process. Image Commun..

[9]  Srecko Kunic,et al.  3D television , 2011, Proceedings ELMAR-2011.

[10]  Chuohao Yeo,et al.  View Synthesis for Robust Distributed Video Compression in Wireless Camera Networks , 2007, 2007 IEEE International Conference on Image Processing.

[11]  周峰,et al.  Stereoscopic display system , 2015 .

[12]  M. Halle.  Autostereoscopic displays and computer graphics , 1997, COMG.

[13]  Younghui Kim,et al.  Video Panorama for 2D to 3D Conversion , 2012, Comput. Graph. Forum.

[14]  Aljoscha Smolic,et al.  Coding and intermediate view synthesis of multiview video plus depth , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[15]  Marcus A. Magnor,et al.  Multi-view coding for image-based rendering using 3-D scene geometry , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[17]  Aljoscha Smolic,et al.  Toward a 3D video format for auto-stereoscopic displays , 2008, Optical Engineering + Applications.

[18]  Graham John Woodgate,et al.  A prototype 3D mobile phone equipped with a next-generation autostereoscopic display , 2007, Electronic Imaging.

[19]  Graham John Woodgate,et al.  Autostereoscopic display technology for mobile 3DTV applications , 2007, Electronic Imaging.