Empirical Evaluation of SDN Controllers Using Mininet/Wireshark and Comparison with Cbench

Software-defined networking (SDN) is one of the most promising topics of research today. In this paper, we study the performance of three SDN controllers - ONOS, OpenMUL, and POX, that are implemented in three different programming languages, i.e., Java, C, and Python, respectively, using Mininet and Wireshark packet analysis. We compare the performance of the controllers analyzed using Mininet-Wireshark packet analysis with that of the benchmarking tool Cbench (that uses fake control packets generated from switch instances) in terms of latency and throughput and show that the latter significantly under-estimates the performance evaluation. Additionally, we also study a new performance metric, topology discovery time, that none of the current benchmarking tools capture.

[1]  Abdul Bais,et al.  Comparative analysis of software defined networking (SDN) controllers — In terms of traffic handling capabilities , 2016, 2016 19th International Multi-Topic Conference (INMIC).

[2]  Vishwas Manral,et al.  Benchmarking Methodology for SDN Controller Performance , 2015 .

[3]  John Keeney,et al.  Qualitative comparison of open-source SDN controllers , 2016, NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium.

[4]  Rui L. Aguiar,et al.  A qualitative and quantitative assessment of SDN controllers , 2017, 2017 International Young Engineers Forum (YEF-­ECE).

[5]  Shingo Ata,et al.  Abstract model of SDN architectures enabling comprehensive performance comparisons , 2015, 2015 11th International Conference on Network and Service Management (CNSM).

[6]  Vincent Gramoli,et al.  Are Today's SDN Controllers Ready for Primetime? , 2016, 2016 IEEE 41st Conference on Local Computer Networks (LCN).

[7]  Fouad Benamrane,et al.  Short: A Case Study of the Performance of an OpenFlow Controller , 2014, NETYS.