3DQoE-Oriented and Energy-Efficient 2D plus Depth Based 3D Video Streaming Over Centrally Controlled Networks

IP networks have become the dominant platform for video delivery. However, bandwidth-hungry video is pushing networks to their limits: costs are rising for the operators and the viewing experience is not always satisfactory for the users. When considering 3D video delivery, the previous problems are exacerbated because of the higher volume of data that must be communicated, and the difficulty in characterizing the viewing experience of the end user. Consequently, network operators may be reluctant to deliver 3D video due to costs and unclear quality improvements to their users. In this setting, the true immersive experience of 3D video remains elusive. In this paper, we focus on the efficient delivery of 3D video in terms of quality and energy cost over centrally controlled networks. As a representative example of a centrally controlled network, a software-defined network (SDN) is assumed. Our approach is based on a comprehensive network-dependent 3D quality of experience (3DQoE) model and an energy cost model for 3D video streaming. By using the developed models, we formulate the problem of energy-efficient and 3DQoE-optimized 3D video flow path routing. The particular characteristic of video/depth rate allocation presented in 3D video is embedded seamlessly into the selection of the optimal routing paths for multiple 3D video streams. The formulated problem is NP-hard and is solved with a heuristic algorithm based on the branch-and-bound method after significant reduction of the solution search space. Extensive 3D video streaming experiments are conducted over an OpenFlow-based SDN with subjective and objective evaluations and they highlight the significant benefits of the proposed approach.

[1]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[2]  G. Klir,et al.  Fuzzy Measure Theory , 1993 .

[3]  Zhibo Chen,et al.  Guest Editorial QoE-Aware Wireless Multimedia Systems , 2012, IEEE J. Sel. Areas Commun..

[4]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.

[5]  Patrick Le Callet,et al.  Quality of experience model for 3DTV , 2012, Electronic Imaging.

[6]  Lu Yu,et al.  A perceptual metric for evaluating quality of synthesized sequences in 3DV system , 2010, Visual Communications and Image Processing.

[7]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[8]  Takeshi Ikenaga,et al.  Flow-based Routing Schemes for Minimizing Network Energy Consumption using OpenFlow , 2014 .

[9]  Tasos Dagiuklas,et al.  A model of network related QoE for 3D video , 2012, 2012 IEEE Globecom Workshops.

[10]  Chaminda T. E. R. Hewage,et al.  Reduced-reference quality assessment for 3D video compression and transmission , 2011, IEEE Transactions on Consumer Electronics.

[11]  Dejan Kostic,et al.  Energy-aware traffic engineering , 2010, e-Energy.

[12]  Klara Nahrstedt,et al.  OpenSession: SDN-based cross-layer multi-stream management protocol for 3D teleimmersion , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[13]  Bo Fu,et al.  QoE-aware priority marking and traffic management for H.264/SVC-based mobile video delivery , 2013, PM2HW2N '13.

[14]  Song Ci,et al.  QoE-oriented 3D video transcoding for mobile streaming , 2012, TOMCCAP.

[15]  Bernd Girod,et al.  Congestion-distortion optimized video transmission over ad hoc networks , 2005, Signal Process. Image Commun..

[16]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[17]  Zdravko Bozakov,et al.  Measurement-based flow characterization in centrally controlled networks , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[18]  Song Ci,et al.  Joint video/depth/FEC rate allocation with considering 3D visual saliency for scalable 3D video streaming , 2013, 2013 Visual Communications and Image Processing (VCIP).

[19]  Murali S. Kodialam,et al.  Traffic engineering in software defined networks , 2013, 2013 Proceedings IEEE INFOCOM.

[20]  Chaminda T. E. R. Hewage,et al.  Edge-Based Reduced-Reference Quality Metric for 3-D Video Compression and Transmission , 2012, IEEE Journal of Selected Topics in Signal Processing.

[21]  Edoardo Amaldi,et al.  Energy-aware IP traffic engineering with shortest path routing , 2013, Comput. Networks.

[22]  Filippo Speranza,et al.  Stereoscopic 3D-TV: Visual Comfort , 2011, IEEE Transactions on Broadcasting.

[23]  Mihaela van der Schaar,et al.  MOS-Based Congestion Control for Conversational Services in Wireless Environments , 2012, IEEE Journal on Selected Areas in Communications.

[24]  John G. Apostolopoulos,et al.  On multiple description streaming with content delivery networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[25]  Marcus Barkowsky,et al.  How visual fatigue and discomfort impact 3D-TV quality of experience: a comprehensive review of technological, psychophysical, and psychological factors , 2013, annals of telecommunications - annales des télécommunications.

[26]  Ahmet M. Kondoz,et al.  Automatic QOE Prediction in Stereoscopic Videos , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[27]  A. Murat Tekalp,et al.  Distributed QoS Architectures for Multimedia Streaming Over Software Defined Networks , 2014, IEEE Transactions on Multimedia.

[28]  Lingfen Sun,et al.  QoE Prediction Model and its Application in Video Quality Adaptation Over UMTS Networks , 2012, IEEE Transactions on Multimedia.

[29]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[30]  Mårten Sjöström,et al.  Layer Assignment Based on Depth Data Distribution for Multiview-Plus-Depth Scalable Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Marcus Barkowsky,et al.  Video quality assessment: From 2D to 3D — Challenges and future trends , 2010, 2010 IEEE International Conference on Image Processing.

[32]  Alexander Raake,et al.  Evaluating Depth Perception of 3D Stereoscopic Videos , 2012, IEEE Journal of Selected Topics in Signal Processing.

[33]  Jennifer Rexford,et al.  Live migration of an entire network (and its hosts) , 2012, HotNets-XI.

[34]  Qingming Huang,et al.  Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model , 2009, Signal Process. Image Commun..

[35]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[36]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[37]  Tao Chen,et al.  3D-TV Content Storage and Transmission , 2011, IEEE Transactions on Broadcasting.

[38]  Mihaela van der Schaar,et al.  Cross-Layer Optimized Video Streaming Over Wireless Multihop Mesh Networks , 2006, IEEE Journal on Selected Areas in Communications.

[39]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[40]  Daniel C. Kilper,et al.  Toward energy-efficient content dissemination , 2011, IEEE Network.

[41]  View Synthesis Reference Software (VSRS) 4.2 with improved inpainting and hole filing , 2017 .

[42]  Moshe Zukerman,et al.  Internet traffic modeling and future technology implications , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[43]  Daoyun Hu,et al.  Demonstration of OpenFlow-Controlled Network Orchestration for Adaptive SVC Video Manycast , 2015, IEEE Transactions on Multimedia.

[44]  Kwong-Sak Leung,et al.  Applying fuzzy measures and nonlinear integrals in data mining , 2005, Fuzzy Sets Syst..

[45]  Bernd Girod,et al.  Depth augmented stereo panorama for cinematic virtual reality with head-motion parallax , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[46]  A. Murat Tekalp,et al.  An Optimization Framework for QoS-Enabled Adaptive Video Streaming Over OpenFlow Networks , 2013, IEEE Transactions on Multimedia.

[47]  Fabrizio Granelli,et al.  Measurement-based modelling of power consumption at wireless access network gateways , 2012, Comput. Networks.

[48]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[49]  Aggelos Lazaris,et al.  Video Activity-Based Traffic Policing: A New Paradigm , 2014, IEEE Transactions on Multimedia.

[50]  Subjective methods for the assessment of stereoscopic 3DTV systems , 2015 .

[51]  Alan C. Bovik,et al.  Multimodal Interactive Continuous Scoring of Subjective 3D Video Quality of Experience , 2014, IEEE Transactions on Multimedia.

[52]  Chaminda T. E. R. Hewage,et al.  Quality of experience for 3D video streaming , 2013, IEEE Communications Magazine.

[53]  Marcus Barkowsky,et al.  Perceived 3D TV Transmission Quality Assessment: Multi-Laboratory Results Using Absolute Category Rating on Quality of Experience Scale , 2012, IEEE Transactions on Broadcasting.

[54]  Song Ci,et al.  Choquet integral based QoS-to-QoE mapping for mobile VoD applications , 2016, 2016 IEEE/ACM 24th International Symposium on Quality of Service (IWQoS).

[55]  Stephen J. Wright,et al.  Power Awareness in Network Design and Routing , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.