Modeling the QoE of rate changes in Skype/SILK VoIP calls

The effective end-to-end transport of delay-sensitive voice data has long been a problem in multimedia networking. One of the major issues is determining the sending rate of real-time VoIP streams such that the user experience is maximized per unit network resource consumed. A particularly interesting complication that remains to be addressed is that the available bandwidth is often dynamic. Thus, it is unclear whether a marginal increase warrants better user experience. If a user naively tunes the sending rate to the optimum at any given opportunity, the user experience could fluctuate. To investigate the effects of magnitude and frequency of rate changes on user experience, we recruited 127 human participants to systematically score emulated Skype calls with different combinations of rate changes, including varying magnitude and frequency of rate changes. Results show that: 1) the rate change frequency affects the user experience on a logarithmic scale, echoing Weber-Fechner's Law; 2) the effect of rate change magnitude depends on how users perceive the quality difference; and 3) this study derives a closed-form model of user perception for rate changes for Skype calls.

[1]  R. Fisher Statistical methods for research workers , 1927, Protoplasma.

[2]  Ravi Jain,et al.  A source and channel rate adaptation algorithm for AMR in VoIP using the Emodel , 2003, NOSSDAV '03.

[3]  Peter Reichl,et al.  The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment , 2010, 2010 IEEE International Conference on Communications.

[4]  Lingfen Sun,et al.  Modelling Speech Quality for NB and WB SILK Codec for VoIP Applications , 2011, 2011 Fifth International Conference on Next Generation Mobile Applications, Services and Technologies.

[5]  Lingfen Sun,et al.  A new method for VoIP quality of service control use combined adaptive sender rate and priority marking , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[6]  Kuan-Ta Chen,et al.  Could Skype be more satisfying? a QoE-centric study of the FEC mechanism in an internet-scale VoIP system , 2010, IEEE Network.

[7]  Eric D. Scheirer,et al.  Tempo and beat analysis of acoustic musical signals. , 1998, The Journal of the Acoustical Society of America.

[8]  M. Angela Sasse,et al.  Measuring perceived quality of speech and video in multimedia conferencing applications , 1998, MULTIMEDIA '98.

[9]  Jianhong Shen,et al.  On the foundations of vision modeling: I. Weber’s law and Weberized TV restoration , 2003 .

[10]  Wei Song,et al.  Saving bitrate vs. pleasing users: where is the break-even point in mobile video quality? , 2011, MM '11.

[11]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[12]  Cha Zhang,et al.  CROWDMOS: An approach for crowdsourcing mean opinion score studies , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Ruzena Bajcsy,et al.  Color-plus-depth level-of-detail in 3D tele-immersive video: a psychophysical approach , 2011, MM '11.

[14]  A Bouch,et al.  A 3-dimensional approach to assessing end-user quality of service , 2001 .

[15]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[16]  Bogdan M. Wilamowski,et al.  The Transmission Control Protocol , 2005, The Industrial Information Technology Handbook.

[17]  Shuji Tasaka,et al.  The effectiveness of a QoE-based video output scheme for audio-video ip transmission , 2008, ACM Multimedia.

[18]  Peter Reichl,et al.  Economics of logarithmic Quality-of-Experience in communication networks , 2010, 2010 9th Conference of Telecommunication, Media and Internet.

[19]  Stella F. Lourenco,et al.  Spatial attention and the mental number line: Evidence for characteristic biases and compression , 2007, Neuropsychologia.

[20]  Bob Briscoe,et al.  Market Managed Multi-service Internet (M3I): Economics driving Network Design , 2002 .

[21]  ROBERT S. MOYER,et al.  Time required for Judgements of Numerical Inequality , 1967, Nature.

[22]  Yoshihiro Ito,et al.  Real-Time Estimation of User-Level QoS of Audio-Video Transmission over IP Networks , 2006, 2006 IEEE International Conference on Communications.

[23]  Guy Pujolle,et al.  Quality of Experience of VoIP Service: A Survey of Assessment Approaches and Open Issues , 2012, IEEE Communications Surveys & Tutorials.

[24]  Jon Postel,et al.  User Datagram Protocol , 1980, RFC.

[25]  Sebastian Möller,et al.  Speech Quality Estimation: Models and Trends , 2011, IEEE Signal Processing Magazine.

[26]  Claudio Casetti,et al.  A simulation study of adaptive voice communications on IP networks , 2001, Comput. Commun..

[27]  Tobias Hoßfeld,et al.  SOS: The MOS is not enough! , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[28]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[29]  Chun-Ying Huang,et al.  Quantifying Skype user satisfaction , 2006, SIGCOMM 2006.

[30]  Thierry Turletti,et al.  A rate control mechanism for packet video in the Internet , 1994, Proceedings of INFOCOM '94 Conference on Computer Communications.