User-level performance evaluation of VoIP using ns-2

Voice over IP (VoIP) is gaining an ever increasing popularity. As such, it nowadays represents one of the most studied test applications in the performance evaluation of wireline and wireless networks. However, a sound performance analysis of VoIP communications should be carried out at the user level, by computing perceptive metrics like the Mean Opinion Score (MOS) or the E-Model. In this paper, we present enhancements to the popular Network Simulator 2 (ns-2) that allow a reliable VoIP user-level performance analysis to be carried out through simulation. We show that computing performance measures at the IP level, which is usually done in ns-2, often leads to inaccurate results. Our code is publicly available at http://info.iet.unipi.it/~cng/ns2voip/.

[1]  Donald F. Towsley,et al.  Packet audio playout delay adjustment: performance bounds and algorithms , 1998, Multimedia Systems.

[2]  Henning Schulzrinne,et al.  Adaptive playout mechanisms for packetized audio applications in wide-area networks , 1994, Proceedings of INFOCOM '94 Conference on Computer Communications.

[3]  Athina Markopoulou,et al.  Assessment of VoIP quality over Internet backbones , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[4]  Leandros Tassiulas,et al.  Dynamic Cross-Layer Association in 802.11-Based Mesh Networks , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[5]  Suhas N. Diggavi,et al.  Optimal Rate-Reliability-Delay Tradeoff in Networks with Composite Links , 2007, IEEE Transactions on Communications.

[6]  Lingfen Sun,et al.  A new method for VoIP quality of service control use combined adaptive sender rate and priority marking , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[7]  Saverio Niccolini,et al.  An Experimental Evaluation of Voice Quality Over the Datagram Congestion Control Protocol , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[8]  Henning Schulzrinne,et al.  Experimental Measurement of the Capacity for VoIP Traffic in IEEE 802.11 WLANs , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[9]  Dario Rossi,et al.  Understanding VoIP from Backbone Measurements , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[10]  Claudio Cicconetti,et al.  Simulation Model for End-to-end QoS across Heterogeneous Networks , 2005 .

[11]  Luigi Atzori,et al.  Playout buffering in ip telephony: a survey discussing problems and approaches , 2006, IEEE Communications Surveys & Tutorials.

[12]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[13]  Haitao Wu,et al.  Proactive Scan: Fast Handoff with Smart Triggers for 802.11 Wireless LAN , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[14]  Kathryn Momtahan,et al.  Linear prediction based packet loss concealment algorithm for PCM coded speech , 2001, IEEE Trans. Speech Audio Process..

[15]  Robert G. Cole,et al.  Voice over IP performance monitoring , 2001, CCRV.

[16]  Chun-Ying Huang,et al.  Quantifying Skype user satisfaction , 2006, SIGCOMM.

[17]  Alexander Raake,et al.  The well-tempered conversation: interactivity, delay and perceptual VoIP quality , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[18]  Andries P. Hekstra,et al.  Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[19]  Randy H. Katz,et al.  Characterizing packet audio streams from Internet multimedia applications , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[20]  Suman Banerjee,et al.  VoIP on Wireless Meshes: Models, Algorithms and Evaluation , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[21]  Tracy Camp,et al.  MANET simulation studies: the incredibles , 2005, MOCO.

[22]  Claudio Cicconetti,et al.  An integrated framework for enabling effective data collection and statistical analysis with ns-2 , 2006 .