Semantic-aware adaptation scheme for soccer video over MPEG-DASH

In recent years, quality of experience (QoE) has been investigated and proved to have both influential factors on user's visual quality and perceptual quality, while the perceptual quality means user's requirement on personalized content should be acquired in optimized quality. That's to say, those segments holding user interested content such as highlights need to be allocated more network resource in a resource-limited streaming scenario. However, all the existing HTTP-based adaptive methods only focus the content-agnostic bitrate adaptation according to limited network resources or energy resource, since they ignored user perceived semantics on some important segments, which suffered less quality on the important segments than on those ordinary ones, so as to hurt the overall QoE. In this paper, we have proposed a new semantic-aware adaptation scheme for MPEG-DASH services, which decides how to preserve bandwidth and buffering time depending on content descriptors for the perceived important content to users. Further, a semantic-aware probe and adaptation (SMA-PANDA) algorithm has been implemented in a DASH client to compare with conventional bitrate adaptions. Preliminary results show that SMA-PANDA achieves better QoE and flexibility on streaming user's interested content on MPEG-DASH platform, and it also aggressively helps user interested content compete more resource to deliver high quality presentation.

[1]  Lingfen Sun,et al.  QoE Prediction Model and its Application in Video Quality Adaptation Over UMTS Networks , 2012, IEEE Transactions on Multimedia.

[2]  Ali C. Begen,et al.  Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale , 2013, IEEE Journal on Selected Areas in Communications.

[3]  Adam Wolisz,et al.  EvalVid - A Framework for Video Transmission and Quality Evaluation , 2003, Computer Performance Evaluation / TOOLS.

[4]  Christian Timmerer,et al.  HTTP Streaming of MPEG Media , 2010 .

[5]  Vyas Sekar,et al.  Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE , 2012, CoNEXT '12.

[6]  Shih-Fu Chang,et al.  Video Adaptation: Concepts, Technologies, and Open Issues , 2005, Proceedings of the IEEE.

[7]  Narciso García,et al.  Perceptual Quality of HTTP Adaptive Streaming Strategies: Cross-Experimental Analysis of Multi-Laboratory and Crowdsourced Subjective Studies , 2016, IEEE Journal on Selected Areas in Communications.

[8]  Jun Xin,et al.  Video Adaptation : Concepts , Technologies , and Open Issues , .

[9]  Chao Gui,et al.  Content-aware adaptation scheme for QoE optimized dash applications , 2014, 2014 IEEE Global Communications Conference.

[10]  Andrzej Chydzinski,et al.  Adaptive Video Streaming: Rate and Buffer on the Track of Minimum Rebuffering , 2016, IEEE Journal on Selected Areas in Communications.

[11]  Zekeriya Uykan,et al.  Transmission-Order Optimization for Bidirectional Device-to-Device (D2D) Communications Underlaying Cellular TDD Networks—A Graph Theoretic Approach , 2016, IEEE Journal on Selected Areas in Communications.

[12]  George Ghinea,et al.  Quality of perception: user quality of service in multimedia presentations , 2005, IEEE Transactions on Multimedia.

[13]  Junqing Yu,et al.  Affection arousal based highlight extraction for soccer video , 2013, Multimedia Tools and Applications.

[14]  Alan Hanjalic,et al.  Adaptive extraction of highlights from a sport video based on excitement modeling , 2005, IEEE Transactions on Multimedia.

[15]  Qing Zhang,et al.  Cloud Detection of RGB Color Aerial Photographs by Progressive Refinement Scheme , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Moncef Gabbouj,et al.  Rate adaptation for adaptive HTTP streaming , 2011, MMSys.

[17]  Yongwei Nie,et al.  Compact Video Synopsis via Global Spatiotemporal Optimization , 2013, IEEE Transactions on Visualization and Computer Graphics.