A testbed for QoE-based multimedia streaming optimization in heterogeneous wireless networks

Over the top services such as video telephony or IPTV are nowadays offered in mobile networks. The mobile users, however, expect not only service connectivity, but also demand on service quality. To meet user expectations and optimize the multimedia streaming, operators have to make a trade-off between service quality and the resources allocated for the service offering. However, due to the subjective nature of quality perception, multimedia streaming strategies must be evaluated in laboratory environments before offering them to the users. The contribution of this paper is an experimental testbed that enables to merge user experience with cross-layer parameters of multimedia streaming in wireless networks. The testbed consist of an audiovisual client, a network infrastructure, a control module, and a demonstrator. Thus, experiments can be performed to evaluate streaming quality aspects that are related to 1) uncompressed video processing (e.g. rescaling), 2) audio and video coding, 3) packetization, 4) buffering, 5) transmission link, and 6) quality adaptation during active sessions. The test conditions can be flexibly defined through an event-based test definition concept. The tests can be automatically processed and data can be collected. Selected results of tests conducted in the testbed are presented in the paper. The demonstrator that is deployed on top of the testbed enables visualisation of the streaming quality for various configurations in real-time. This way, the testbed is a relevant contribution to the design of Quality of Experience (QoE) aware applications in future wireless networks.

[1]  Sebastian Möller,et al.  Mobisense testbed: merging user perception and network performance , 2008, TRIDENTCOM.

[2]  Mark Handley,et al.  SIP: Session Initiation Protocol , 1999, RFC.

[3]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Arash Behboodi,et al.  Jitter-Buffer Management for VoIP over Wireless LAN in a Limited Resource Device , 2008, Fourth International Conference on Networking and Services (icns 2008).

[5]  Sebastian Möller,et al.  On the way to high-quality video calls in future mobile networks , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[6]  Adam Wolisz,et al.  EvalVid - A Framework for Video Transmission and Quality Evaluation , 2003, Computer Performance Evaluation / TOOLS.

[7]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[8]  R. Ward,et al.  A Framework for Evaluating Video Transmission over Wireless Ad Hoc Networks , 2007, 2007 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[9]  Vincent Barriac,et al.  Standardization activities in the ITU for a QoE assessment of IPTV , 2008, IEEE Communications Magazine.

[10]  Blazej Lewcio,et al.  Video quality in next generation mobile networks — Perception of time-varying transmission , 2011, 2011 IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR).

[11]  Sebastian Möller,et al.  A method for seamless codec changeover during active video calls , 2011, 2011 IEEE 16th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD).

[12]  Methods for objective and subjective assessment of quality Perceptual evaluation of speech quality ( PESQ ) : An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs , 2002 .

[13]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[14]  Sebastian Möller,et al.  Speech Quality While Roaming in Next Generation Networks , 2009, 2009 IEEE International Conference on Communications.

[15]  Wolfgang Kellerer,et al.  A real-time Internet streaming media testbed , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[16]  Anja Feldmann,et al.  The Routerlab - Emulating Internet Characteristics in a Room , 2010 .

[17]  Jin-Woo Jung,et al.  Performance evaluation of two layered mobility management using mobile IP and session initiation protocol , 2003, GLOBECOM '03. IEEE Global Telecommunications Conference (IEEE Cat. No.03CH37489).

[18]  Feng Li,et al.  Application, Network and Link Layer Measurements of Streaming Video over a Wireless Campus Network , 2005, PAM.

[19]  Sebastian Möller,et al.  A Technique for Seamless VoIP-Codec Switching in Next Generation Networks , 2008, 2008 IEEE International Conference on Communications.