QoE-aware congestion control algorithm for conversational services

Nowadays, multimedia applications and specifically streaming systems over wireless networks use the TCP transport protocol. Indeed, TCP can deal with practical issues such as firewalls and also deploys built-in retransmissions and congestion control mechanisms. We propose in this paper a Quality-centric Mean Opinion Score (MOS) based congestion control that determines an optimal congestion window updating policy for multimedia transmission. Unlike the standard congestion control algorithms, our approach defines a new Additive Increase Multiplicative Decrease (AIMD) algorithm given the multimedia application and the transmission characteristics. In order to get the optimal congestion policy in practice, the sender requires complete statistical knowledge of both multimedia traffic and the network environment, which may not be available in wireless systems. Hence, we propose in this paper, a Partially Observable Markov Decision Process (POMDP) framework in order to determine an optimal congestion control policy which maximizes the long term expected Quality of Experience (QoE) of the receiver. Moreover, the computation of an optimal policy is usually time/process consuming and as wireless devices are capacity-limited, we consider optimal solutions based on temporal difference (TD-λ) online learning algorithms. Finally, we do some practical experiments of our algorithms on a Microsoft Lync testbed. We observe that our algorithm improve significantly the QoE compared to standard AIMD congestion control mechanism.

[1]  Wolfgang Kellerer,et al.  QoE-Based Cross-Layer Optimization of Wireless Video with Unperceivable Temporal Video Quality Fluctuation , 2011, 2011 IEEE International Conference on Communications (ICC).

[2]  Yutaka Ishibashi,et al.  Mutually compensatory property of multimedia QoS , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[3]  Eva Ibarrola,et al.  Web QoE Evaluation in Multi-agent Networks: Validation of ITU-T G.1030 , 2009, 2009 Fifth International Conference on Autonomic and Autonomous Systems.

[4]  Wolfgang Kellerer,et al.  MOS-Based Multiuser Multiapplication Cross-Layer Optimization for Mobile Multimedia Communication , 2007, Adv. Multim..

[5]  Jean-Marie Bonnin,et al.  QoE-Aware Admission Control for Multimedia Applications in IEEE 802.11 Wireless Networks , 2008, 2008 IEEE 68th Vehicular Technology Conference.

[6]  Deepak Bansal,et al.  Binomial congestion control algorithms , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[7]  Jim Kurose,et al.  Multimedia streaming via TCP: an analytic performance study , 2004, SIGMETRICS 2004.

[8]  Mario Gerla,et al.  Adaptive video streaming: pre-encoded MPEG-4 with bandwidth scaling , 2004, Comput. Networks.

[9]  Richard S. Sutton,et al.  Generalization in ReinforcementLearning : Successful Examples UsingSparse Coarse , 1996 .

[10]  Donald F. Towsley,et al.  Modeling TCP Reno performance: a simple model and its empirical validation , 2000, TNET.