A Survey on Large-Scale Software Defined Networking (SDN) Testbeds: Approaches and Challenges

Recently, several large-scale software defined networking (SDN) testbeds have been designed and developed. These SDN testbeds have spurred numerous network researchers to run their prototypes and experiments, as well as to set up novel architectures for the future Internet. Based on these efforts, SDN testbeds are actively contributing to future network research, bringing forth the attention of both academia and industry. In addition, researchers envisage these large-scale SDN testbeds to be the future Internet. In this paper, we present a comprehensive survey and research challenges for large-scale SDN testbeds. We first introduce the related work and background knowledge. Then, an overview of SDN testbeds is presented. In addition, five typical implementations of large-scale SDN testbeds around the world are described in detail, including design objectives, key technologies, deployment, and experiments. Moreover, an in-depth comparison of SDN testbeds is given. Finally, challenges and future works of SDN testbeds are discussed.

[1]  T. Schwartz,et al.  Clearinghouse , 1971 .

[2]  C. W. Haas,et al.  Stored Program Controlled Network: 800 Service using SPC network capability , 1982, The Bell System Technical Journal.

[3]  G.J. Minden,et al.  A survey of active network research , 1997, IEEE Communications Magazine.

[4]  Ian F. Akyildiz,et al.  Mobility Management in Next Generation Wireless Systems , 1999, ICCCN.

[5]  Dino Farinacci,et al.  Generic Routing Encapsulation (GRE) , 2000, RFC.

[6]  Yakov Rekhter,et al.  Mpls: Technology and Applications , 2000 .

[7]  Christian F. Tschudin,et al.  A large-scale testbed for reproducible ad hoc protocol evaluations , 2002, 2002 IEEE Wireless Communications and Networking Conference Record. WCNC 2002 (Cat. No.02TH8609).

[8]  Victor C. M. Leung,et al.  Mobility-based predictive call admission control and bandwidth reservation in wireless cellular networks , 2002, Comput. Networks.

[9]  Ieee P . ad.  Virtual Bridged Local Area Networks-Amendment 4 : Provider Bridges , 2003 .

[10]  Kevin Skadron,et al.  Power-aware QoS management in Web servers , 2003, RTSS 2003. 24th IEEE Real-Time Systems Symposium, 2003.

[11]  David E. Culler,et al.  PlanetLab: an overlay testbed for broad-coverage services , 2003, CCRV.

[12]  David A. Maltz,et al.  Network-Wide Decision Making: Toward A Wafer-Thin Control Plane , 2004 .

[13]  Chase Qishi Wu,et al.  Ultrascience net: network testbed for large-scale science applications , 2005, IEEE Communications Magazine.

[14]  Scott Shenker,et al.  Overcoming the Internet impasse through virtualization , 2005, Computer.

[15]  Nick Feamster,et al.  Design and implementation of a routing control platform , 2005, NSDI.

[16]  Matt Welsh,et al.  MoteLab: a wireless sensor network testbed , 2005, IPSN '05.

[17]  Jonathan S. Turner,et al.  Diversifying the Internet , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[18]  Hong Yan,et al.  A clean slate 4D approach to network control and management , 2005, CCRV.

[19]  Yoichi Shinoda,et al.  StarBED and SpringOS: large-scale general purpose network testbed and supporting software , 2006, valuetools '06.

[20]  Eric C. Rosen,et al.  Encapsulation Methods for Transport of Ethernet over MPLS Networks , 2006, RFC.

[21]  F. Richard Yu,et al.  Optimal Joint Session Admission Control in Integrated WLAN and CDMA Cellular Networks with Vertical Handoff , 2007, IEEE Transactions on Mobile Computing.

[22]  Martín Casado,et al.  Ethane: taking control of the enterprise , 2007, SIGCOMM '07.

[23]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[24]  Martín Casado,et al.  NOX: towards an operating system for networks , 2008, CCRV.

[25]  Minlan Yu,et al.  Rethinking virtual network embedding: substrate support for path splitting and migration , 2008, CCRV.

[26]  Raouf Boutaba,et al.  Virtual Network Embedding with Coordinated Node and Link Mapping , 2009, IEEE INFOCOM 2009.

[27]  Rob Sherwood,et al.  FlowVisor: A Network Virtualization Layer , 2009 .

[28]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[29]  Jean-Louis Le Roux,et al.  Path Computation Element (PCE) Communication Protocol (PCEP) , 2009, RFC.

[30]  Martín Casado,et al.  Onix: A Distributed Control Platform for Large-scale Production Networks , 2010, OSDI.

[31]  Rob Sherwood,et al.  Can the Production Network Be the Testbed? , 2010, OSDI.

[32]  Zhiqiang Li,et al.  A Distributed Consensus-Based Cooperative Spectrum-Sensing Scheme in Cognitive Radios , 2010, IEEE Transactions on Vehicular Technology.

[33]  F. Richard Yu,et al.  Distributed Optimal Relay Selection in Wireless Cooperative Networks With Finite-State Markov Channels , 2010, IEEE Transactions on Vehicular Technology.

[34]  Eiji Kawai,et al.  Toward large-scale programmable networks: Lessons learned through the operation and management of a wide-area OpenFlow-based network , 2010, 2010 International Conference on Network and Service Management.

[35]  Jamal Hadi Salim,et al.  Forwarding and Control Element Separation (ForCES) Protocol Specification , 2010, RFC.

[36]  Xiang Cheng,et al.  Virtual network embedding through topology-aware node ranking , 2011, CCRV.

[37]  William E. Johnston,et al.  Hybrid networks: lessons learned and future challenges based on ESnet4 experience , 2011, IEEE Communications Magazine.

[38]  Reza Nejabati,et al.  Integrated OpenFlow — GMPLS control plane: An overlay model for software defined packet over optical networks , 2011, 2011 37th European Conference and Exhibition on Optical Communication.

[39]  Ankit Singla,et al.  Information-centric networking: seeing the forest for the trees , 2011, HotNets-X.

[40]  Dawei Li,et al.  Evaluation of Security Vulnerabilities by Using ProtoGENI as a Launchpad , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[41]  JongWon Kim,et al.  Interconnecting International Network Substrates for Networking Experiments , 2011, TRIDENTCOM.

[42]  Nicola Blefari-Melazzi,et al.  CONET: a content centric inter-networking architecture , 2011, ICN '11.

[43]  Luca Veltri,et al.  Supporting information-centric functionality in software defined networks , 2012, 2012 IEEE International Conference on Communications (ICC).

[44]  R. Nejabati,et al.  Optical FlowVisor: An OpenFlow-based optical network virtualization approach , 2012, OFC/NFOEC.

[45]  Hiroaki Harai,et al.  Optical Packet & Circuit Integrated Network for Future Networks , 2012, IEICE Trans. Commun..

[46]  Hiroaki Harai,et al.  A multi-ring optical packet and circuit integrated network with optical buffering , 2012, 2012 38th European Conference and Exhibition on Optical Communications.

[47]  Elio Salvadori,et al.  VeRTIGO: Network Virtualization and Beyond , 2012, 2012 European Workshop on Software Defined Networking.

[48]  F. Richard Yu,et al.  Energy-Efficient Resource Allocation for Heterogeneous Cognitive Radio Networks with Femtocells , 2012, IEEE Transactions on Wireless Communications.

[49]  Peter Xiaoping Liu,et al.  When the Smart Grid Meets Energy-Efficient Communications: Green Wireless Cellular Networks Powered by the Smart Grid , 2012, IEEE Transactions on Wireless Communications.

[50]  H. Furukawa,et al.  Development of an Autonomous Distributed Control System for Optical Packet and Circuit Integrated Networks , 2012, IEEE/OSA Journal of Optical Communications and Networking.

[51]  Shinji Shimojo,et al.  Extending the RISE controller for the interconnection of RISE and OS3E/NDDI , 2012, 2012 18th IEEE International Conference on Networks (ICON).

[52]  Bruce S. Davie,et al.  The Open vSwitch Database Management Protocol , 2013, RFC.

[53]  E. Salvadori,et al.  Demonstrating inter-testbed network virtualization in OFELIA SDN experimental facility , 2013, 2013 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[54]  Shinji Shimojo,et al.  A study on designing OpenFlow controller RISE 3.0 , 2013, 2013 19th IEEE International Conference on Networks (ICON).

[55]  Nick Feamster,et al.  The Road to SDN , 2013 .

[56]  Shinji Shimojo,et al.  RISE: A Wide-Area Hybrid OpenFlow Network Testbed , 2013, IEICE Trans. Commun..

[57]  Lisandro Zambenedetti Granville,et al.  Data Center Network Virtualization: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[58]  Chin Guok,et al.  Open transport switch: a software defined networking architecture for transport networks , 2013, HotSDN '13.

[59]  Hiroaki Harai,et al.  Experimental demonstrations of interworking between an optical packet and circuit integrated network and OpenFlow-based networks , 2013, 2013 IEEE Globecom Workshops (GC Wkshps).

[60]  Thierry Parmentelat,et al.  Control plane extension - Status of the SFA deployment , 2013 .

[61]  Piotr Rygielski,et al.  Network Virtualization for QoS-Aware Resource Management in Cloud Data Centers: A Survey , 2013, Prax. Inf.verarb. Kommun..

[62]  Hiroaki Harai,et al.  Development of a common path control-plane for interoperating hybrid optical packet- and circuit-switched ring networks and WSONs , 2013, 2013 18th OptoElectronics and Communications Conference held jointly with 2013 International Conference on Photonics in Switching (OECC/PS).

[63]  Elio Salvadori,et al.  Progressive virtual topology embedding in OpenFlow networks , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[64]  ByungRae Cha,et al.  OF@TEIN: An OpenFlow-enabled SDN Testbed over International SmartX Rack Sites , 2013 .

[65]  Akihiro Nakao,et al.  GENI: A federated testbed for innovative network experiments , 2014, Comput. Networks.

[66]  Byrav Ramamurthy,et al.  The GpENI testbed: Network infrastructure, implementation experience, and experimentation , 2014, Comput. Networks.

[67]  JongWon Kim,et al.  Inter-connection automation for OF@TEIN multi-point international OpenFlow islands , 2014, CFI '14.

[68]  Guru M. Parulkar,et al.  OpenVirteX: make your virtual SDNs programmable , 2014, HotSDN.

[69]  Russell J. Clark,et al.  SDX , 2014 .

[70]  Fernando M. V. Ramos,et al.  Software-Defined Networking: A Comprehensive Survey , 2014, Proceedings of the IEEE.

[71]  Lawrence Kreeger,et al.  Virtual eXtensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks , 2014, RFC.

[72]  Qi Hao,et al.  A Survey on Software-Defined Network and OpenFlow: From Concept to Implementation , 2014, IEEE Communications Surveys & Tutorials.

[73]  Pavlin Radoslavov,et al.  ONOS: towards an open, distributed SDN OS , 2014, HotSDN.

[74]  Didier Colle,et al.  Design and implementation of the OFELIA FP7 facility: The European OpenFlow testbed , 2014, Comput. Networks.

[75]  Kuang-Ching Wang,et al.  An OpenFlow Testbed for the Evaluation of Vertical Handover Decision Algorithms in Heterogeneous Wireless Networks , 2014, TRIDENTCOM.

[76]  Biswanath Mukherjee,et al.  Software-defined optical networks (SDONs): a survey , 2014, Photonic Network Communications.

[77]  Yonggang Wen,et al.  “ A Survey of Software Defined Networking , 2020 .

[78]  Wolfgang Kellerer,et al.  HyperFlex: An SDN virtualization architecture with flexible hypervisor function allocation , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[79]  Athanasios V. Vasilakos,et al.  Software-Defined and Virtualized Future Mobile and Wireless Networks: A Survey , 2014, Mobile Networks and Applications.

[80]  F. Richard Yu,et al.  A Survey of Green Information-Centric Networking: Research Issues and Challenges , 2015, IEEE Communications Surveys & Tutorials.

[81]  F. Richard Yu,et al.  Distributed denial of service attacks in software-defined networking with cloud computing , 2015, IEEE Communications Magazine.

[82]  Pin Lv,et al.  Control plane of software defined networks: A survey , 2015, Comput. Commun..

[83]  F. Richard Yu,et al.  Wireless Network Virtualization: A Survey, Some Research Issues and Challenges , 2015, IEEE Communications Surveys & Tutorials.

[84]  Pankaj Garg,et al.  NVGRE: Network Virtualization Using Generic Routing Encapsulation , 2015, RFC.

[85]  F. Richard Yu,et al.  Wireless virtualization for next generation mobile cellular networks , 2015, IEEE Wireless Communications.

[86]  Xi Zhang,et al.  Information-centric network function virtualization over 5g mobile wireless networks , 2015, IEEE Network.

[87]  F. Richard Yu,et al.  Virtual Resource Allocation in Software-Defined Information-Centric Cellular Networks With Device-to-Device Communications and Imperfect CSI , 2016, IEEE Transactions on Vehicular Technology.

[88]  F. Richard Yu,et al.  Software-Defined Networking (SDN) and Distributed Denial of Service (DDoS) Attacks in Cloud Computing Environments: A Survey, Some Research Issues, and Challenges , 2016, IEEE Communications Surveys & Tutorials.

[89]  Wolfgang Kellerer,et al.  Survey on Network Virtualization Hypervisors for Software Defined Networking , 2015, IEEE Communications Surveys & Tutorials.

[90]  Victor C. M. Leung,et al.  Software Defined Networking, Caching, and Computing for Green Wireless Networks , 2016, IEEE Communications Magazine.

[91]  HyungWon Kim,et al.  Low Power Routing and Channel Allocation of Wireless Video Sensor Networks Using Wireless Link Utilization , 2016, Ad Hoc Sens. Wirel. Networks.

[92]  Peng Liu,et al.  Application Driven Network: providing On-Demand Services for Applications , 2016, SIGCOMM.

[93]  Yu Zhang,et al.  Time-Window and Voronoi-Partition Based Aggregation Scheduling in Multi-Sink Wireless Sensor Networks , 2016, Ad Hoc Sens. Wirel. Networks.

[94]  Laizhong Cui,et al.  When big data meets software-defined networking: SDN for big data and big data for SDN , 2016, IEEE Network.

[95]  F. Richard Yu,et al.  Software-Defined Device-to-Device (D2D) Communications in Virtual Wireless Networks With Imperfect Network State Information (NSI) , 2016, IEEE Transactions on Vehicular Technology.

[96]  F. Richard Yu,et al.  An Integrated Framework for Software Defined Networking, Caching, and Computing , 2017, IEEE Network.

[97]  Yuan Fei.  A NEW METHOD TO SUPPORT UMTS / WLAN VERTICAL HANDOVER USING SCTP , 2022 .