Multimedia Human-Centric Networking: Concepts, Technologies and Trends

The transmission of multimedia content will represent up to 90% of all Internet traffic in a few years, where it will be mainly accessed over wireless networks. However, this new wireless multimedia era requires instantaneous adaptation of multimedia content and the network resources according to user’s preferences, experiences, or interests. In this context, human-centric multimedia networking (HCMN) appears as a promising model for next generation of wireless multimedia networks. In such scenarios, users will produce, share, and consume video flows ubiquitously, ranging from entertaining to real-time video flows about natural disasters or surveillance. Although, optimizations in HCMN scenarios must consider issues related to the network, the video characteristics, and, especially, human’s preferences or the human’s visual system. In this way, HCMN systems place the human’s experience in the centre of mobile video services, protocols, and applications, where the video transmission process must be done and optimized in real-time according to the human’s perceptions, content’s characteristics, and also context-awareness. In this work, we introduce the basic concepts for the video transmission in HCMN systems. We also detail main existing mechanisms, which aim to improve the performance of HCMN system in sharing video content, including Quality of Experience (QoE)-based solutions for handover, routing, error correction, decisionmaking, and controlling the dissemination of video flows in wireless multimedia-aware

[1]  A. Mellouk,et al.  User QoE-based adaptive routing system for future Internet CDN , 2012, 2012 Computing, Communications and Applications Conference.

[2]  César Viho,et al.  Hybrid QoE Assessment Is Well-Suited for Multiple Description Coding Video Streaming in Overlay Networks , 2010, 2010 8th Annual Communication Networks and Services Research Conference.

[3]  M. Motani,et al.  Cross-layer design: a survey and the road ahead , 2005, IEEE Communications Magazine.

[4]  Tao Gu,et al.  A service-oriented middleware for building context-aware services , 2005, J. Netw. Comput. Appl..

[5]  Nik Bessis,et al.  Federated broker system for pervasive context provisioning , 2013, J. Syst. Softw..

[6]  Didier J. Le Gall,et al.  The MPEG video compression algorithm , 1992, Signal Process. Image Commun..

[7]  Xiaofei Wang,et al.  Cloud-assisted adaptive video streaming and social-aware video prefetching for mobile users , 2013, IEEE Wireless Communications.

[8]  Bo Fu,et al.  QoE-based resource reservation for unperceivable video quality fluctuation during Handover in LTE , 2013, 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC).

[9]  Ricardo Matos,et al.  Quality of experience-based routing in multi-service wireless mesh networks , 2012, 2012 IEEE International Conference on Communications (ICC).

[10]  Tarik Taleb,et al.  QoS/QoE predictions-based admission control for femto communications , 2012, 2012 IEEE International Conference on Communications (ICC).

[11]  Rita Cucchiara,et al.  Video Streaming for Mobile Video Surveillance , 2008, IEEE Transactions on Multimedia.

[12]  Hoh Peter In,et al.  An Adaptive FEC Mechanism Using Cross-layer Approach to Enhance Quality of Video Transmission over 802.11 WLANs , 2010, KSII Trans. Internet Inf. Syst..

[13]  Yonggang Wen,et al.  QoE-Driven Cache Management for HTTP Adaptive Bit Rate Streaming Over Wireless Networks , 2012, IEEE Transactions on Multimedia.

[14]  Martín Varela,et al.  QOE-driven mobility management — Integrating the users' quality perception into network — Level decision making , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Alan C. Bovik,et al.  Wireless Video Quality Assessment: A Study of Subjective Scores and Objective Algorithms , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Marília Curado,et al.  An Overview of Quality of Experience Measurement Challenges for Video Applications in IP Networks , 2010, WWIC.

[18]  Mihaela van der Schaar,et al.  Adaptive cross-layer protection strategies for robust scalable video transmission over 802.11 WLANs , 2003, IEEE J. Sel. Areas Commun..

[19]  Ilker Bekmezci,et al.  Flying Ad-Hoc Networks (FANETs): A survey , 2013, Ad Hoc Networks.

[20]  Mei-Ling Shyu,et al.  Quality of service provision in mobile multimedia - a survey , 2011, Human-centric Computing and Information Sciences.

[21]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[22]  Eylem Ekici,et al.  A survey of cross-layer design for VANETs , 2011, Ad Hoc Networks.

[23]  Eduardo Cerqueira,et al.  Video quality estimator for wireless mesh networks , 2012, 2012 IEEE 20th International Workshop on Quality of Service.

[24]  Mario Gerla,et al.  Recent advances and challenges in human-centric multimedia mobile cloud computing , 2014, 2014 International Conference on Computing, Networking and Communications (ICNC).

[25]  Thomas Plagemann,et al.  Challenges and techniques for video streaming over mobile ad hoc networks , 2010, Multimedia Systems.

[26]  Marília Curado,et al.  Adaptive video-aware FEC-based mechanism with unequal error protection scheme , 2013, SAC '13.

[27]  H. Zimmermann,et al.  OSI Reference Model - The ISO Model of Architecture for Open Systems Interconnection , 1980, IEEE Transactions on Communications.

[28]  Fotis Foukalas,et al.  Cross-layer design proposals for wireless mobile networks: a survey and taxonomy , 2008, IEEE Communications Surveys & Tutorials.

[29]  César Viho,et al.  A QoE-based approach for multiple description coding (MDC) streaming over video distribution network (VDN) , 2011, Int. J. Multim. Intell. Secur..

[30]  Fernando Boavida,et al.  Quality of Experience management framework for real-time multimedia applications , 2009, Int. J. Internet Protoc. Technol..

[31]  Nicu Sebe,et al.  Personalization in multimedia retrieval: A survey , 2010, Multimedia Tools and Applications.

[32]  Andrea J. Goldsmith,et al.  Cross-layer design of ad hoc networks for real-time video streaming , 2005, IEEE Wireless Communications.

[33]  Maxim P. Sharabayko,et al.  Intra compression efficiency in VP9 and HEVC , 2013 .

[34]  Ce-Kuen Shieh,et al.  An unequal error protection mechanism for video streaming over IEEE 802.11e WLANs , 2012, Comput. Networks.

[35]  Chih-Heng Ke,et al.  Adaptive hybrid error correction model for video streaming over wireless networks , 2010, Multimedia Systems.

[36]  Martín Varela,et al.  QoE-driven network management for real-time over-the-top multimedia services , 2013, 2013 IEEE Wireless Communications and Networking Conference (WCNC).

[37]  Salima Benbernou,et al.  A survey on service quality description , 2013, CSUR.

[38]  Panagiotis Georgopoulos,et al.  Towards network-wide QoE fairness using openflow-assisted adaptive video streaming , 2013, FhMN@SIGCOMM.

[39]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[40]  Bo Wang,et al.  Exploiting content relevance and social relevance for personalized ad recommendation on internet TV , 2013, TOMCCAP.

[41]  Sherali Zeadally,et al.  A dynamic QoE routing system for user‐centric applications , 2013, Trans. Emerg. Telecommun. Technol..

[42]  Ali C. Begen,et al.  Not All Packets Are Equal, Part I: Streaming Video Coding and SLA Requirements , 2009, IEEE Internet Computing.

[43]  Thomas Staub,et al.  UAVNet: A mobile wireless mesh network using Unmanned Aerial Vehicles , 2012, 2012 IEEE Globecom Workshops.

[44]  Jose Oscar Fajardo,et al.  QoE-driven and network-aware adaptation capabilities in mobile multimedia applications , 2011, Multimedia Tools and Applications.

[45]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[46]  Urtzi Ayesta,et al.  QoE-aware optimization of multimedia flow scheduling , 2013, Comput. Commun..

[47]  Paresh Saxena,et al.  QoE driven adaptive video with Overlapping Network Coding for Best Effort Erasure Satellite Links , 2013 .

[48]  Hui Tian,et al.  Estimation of in-service quality of experience for peer-to-peer live video streaming systems using a user-centric and context-aware approach based on Bayesian networks , 2013, Trans. Emerg. Telecommun. Technol..

[49]  Abdulmotaleb El-Saddik,et al.  A context-aware multimedia framework toward personal social network services , 2012, Multimedia Tools and Applications.

[50]  Michael Seufert,et al.  Crowdsourcing 2.0: Enhancing execution speed and reliability of web-based QoE testing , 2014, 2014 IEEE International Conference on Communications (ICC).

[51]  Chunming Wu,et al.  Multicast virtual network mapping for supporting multiple description coding-based video applications , 2013, Comput. Networks.

[52]  Lixia Zhang,et al.  Video Streaming over Named Data Networking , 2013 .

[53]  Der-Jiunn Deng,et al.  Forward-Looking Forward Error Correction Mechanism for Video Streaming Over Wireless Networks , 2011, IEEE Systems Journal.

[54]  Antonio Iera,et al.  LTE for vehicular networking: a survey , 2013, IEEE Communications Magazine.

[55]  Brice Augustin,et al.  Global state-dependent QoE based routing , 2012, 2012 IEEE International Conference on Communications (ICC).

[56]  Ali C. Begen,et al.  Not All Packets Are Equal, Part 2: The Impact of Network Packet Loss on Video Quality , 2009, IEEE Internet Computing.

[57]  V. Vaidehi,et al.  QoS guaranteed integration methodology for a WLAN-WiMAX heterogeneous network , 2011, Comput. Electr. Eng..

[58]  D. G. Costa,et al.  Redundancy-Based Semi-Reliable Packet Transmission in Wireless Visual Sensor Networks Exploiting the Sensing Relevancies of Source Nodes , 2013 .

[59]  Mihaela van der Schaar,et al.  Cross-Layer Optimized Video Streaming Over Wireless Multihop Mesh Networks , 2006, IEEE Journal on Selected Areas in Communications.

[60]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[61]  Radim Bartos,et al.  A survey of schemes for Internet-based video delivery , 2011, J. Netw. Comput. Appl..

[62]  Marília Curado,et al.  QoE-aware FEC mechanism for intrusion detection in multi-tier Wireless Multimedia Sensor Networks , 2012, 2012 IEEE 8th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[63]  Naser Movahhedinia,et al.  A personalized QoE-aware handover decision based on distributed reinforcement learning , 2013, Wirel. Networks.

[64]  Sherali Zeadally,et al.  A real-time video quality estimator for emerging wireless multimedia systems , 2014, Wireless Networks.

[65]  Tasos Dagiuklas,et al.  H.264/SVC vs. H.264/AVC video quality comparison under QoE-driven seamless handoff , 2012, Signal Process. Image Commun..

[66]  Zan Li,et al.  Assessment of a robust opportunistic routing for video transmission in dynamic topologies , 2013, 2013 IFIP Wireless Days (WD).

[67]  R. M. Noor,et al.  A mobility framework to enhance quality of experience through quality of service , 2012, 2012 International Conference on Innovation Management and Technology Research.

[68]  Lingfen Sun,et al.  Content Clustering Based Video Quality Prediction Model for MPEG4 Video Streaming over Wireless Networks , 2009, 2009 IEEE International Conference on Communications.

[69]  Marília Curado,et al.  A QoE handover architecture for converged heterogeneous wireless networks , 2013, Wirel. Networks.

[70]  Miguel Garcia,et al.  Architecture and Protocol of a Semantic System Designed for Video Tagging with Sensor Data in Mobile Devices , 2012, Sensors.

[71]  Hamid R. Rabiee,et al.  Error control for multimedia communications in wireless sensor networks: A comparative performance analysis , 2012, Ad Hoc Networks.

[72]  G. V. Kumar,et al.  Current Research Work on Routing Protocols for MANET: A Literature Survey , 2010 .

[73]  Abdelhakim Hafid,et al.  Wireless Mesh Networks Design — A Survey , 2012, IEEE Communications Surveys & Tutorials.

[74]  Jordi Mongay Batalla,et al.  Context-aware multimedia services provisioning in future Internet using ontology and rules , 2014, 2014 International Conference and Workshop on the Network of the Future (NOF).

[75]  Eduardo Cerqueira,et al.  Framework for the integrated video quality assessment , 2012, Multimedia Tools and Applications.

[76]  Xuemin Chen,et al.  Video coding using the H.264/MPEG-4 AVC compression standard , 2004, Signal Process. Image Commun..

[77]  Christos V. Verikoukis,et al.  Spatial opportunistic transmission for Quality of Experience satisfaction , 2014, J. Vis. Commun. Image Represent..

[78]  Lingfen Sun,et al.  Quality of experience-driven adaptation scheme for video applications over wireless networks , 2010, IET Commun..

[79]  Soo Dong Kim,et al.  A Conceptual Framework for Provisioning Context-aware Mobile Cloud Services , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[80]  Aggeliki Sgora,et al.  An autonomous QoE-driven network management framework , 2014, J. Vis. Commun. Image Represent..

[81]  Andreas Mitschele-Thiel,et al.  Hierarchical routing management for improving multimedia transmissions and QoE , 2012, 2012 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[82]  Bo Fu,et al.  QoE-aware traffic management for mobile video delivery , 2013, 2013 IEEE International Conference on Communications Workshops (ICC).

[83]  Borko Furht,et al.  A survey of multimedia content adaptation for mobile devices , 2010, Multimedia Tools and Applications.

[84]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[85]  Honggang Wang,et al.  A Network and Device Aware QoS Approach for Cloud-Based Mobile Streaming , 2013, IEEE Transactions on Multimedia.

[86]  Lajos Hanzo,et al.  Voice Compression and Communications , 2001 .