Novel network services for supporting big data science research

To interconnect research facilities across wide geographic areas, network operators deploy science networks, also referred to as Research and Education (R&E) networks. These networks allow experimenters to establish dedicated network connections between research facilities for transferring large amounts of data. Recently, R&E networks have started using Software-Defined Networking (SDN) and Software-Defined Exchanges (SDX) for deploying these connections. AtlanticWave/SDX is a response to the growing demand to support end-to-end network services spanning multiple SDN domains. However, requesting these services is a challenging task for domain-expert scientists, because the interfaces of the R&E networks have been developed by network operators for network operators. In this paper, we propose interfaces that allow domain-expert scientists to reserve resources of the scientific network using abstractions that focus on their data transfer needs for scientific workflow management. Recent trends in the networking field pursue better interfaces for requesting network services (e.g., intent-based networking). Although intents are sufficient for the needs of network operations, they are not abstract enough in most cases to be used by domain-expert scientists. This is an issue we are addressing in the AtlanticWave/SDX design: network operators and domain-expert scientists will have their own interfaces focusing on their specific needs.

[1]  Chin Guok,et al.  Enabling intent to configure scientific networks for high performance demands , 2018, Future Gener. Comput. Syst..

[2]  Russell J. Clark,et al.  MetroSDX: A resilient edge network for the smart community , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[3]  Andrew Adams,et al.  Developing Applications with Networking Capabilities via End-to-End SDN (DANCES) , 2016, XSEDE.

[4]  R. Hofmeister,et al.  Vendor-neutral network representations for transport SDN , 2016, 2016 Optical Fiber Communications Conference and Exhibition (OFC).

[5]  Russell Clark,et al.  SDX architectures: A qualitative analysis , 2016, SoutheastCon 2016.

[6]  Malathi Veeraraghavan,et al.  A multi-domain SDN for dynamic layer-2 path service , 2015, NDM '15.

[7]  Donald A. Cox,et al.  Benefits brought by the use of OpenFlow/SDN on the AmLight intercontinental research and education network , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[8]  Martín Casado,et al.  The Design and Implementation of Open vSwitch , 2015, NSDI.

[9]  Zhe Zhang,et al.  Lark: Bringing Network Awareness to High Throughput Computing , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[10]  Henry Owen,et al.  AtlanticWave-SDX : An International SDX to Support Science Data Applications , 2015 .

[11]  Russell J. Clark,et al.  SDX , 2014, SIGCOMM.

[12]  Joe Mambretti,et al.  Software-Defined Network Exchanges (SDXs): Architecture, services, capabilities, and foundation technologies , 2014, 2014 26th International Teletraffic Congress (ITC).

[13]  M. Hazlinsky,et al.  SDNI: The GEANT testbeds service - virtual network environments for advanced network and applications research , 2014, 2014 First International Science and Technology Conference (Modern Networking Technologies) (MoNeTeC).

[14]  Fernando M. V. Ramos,et al.  Software-Defined Networking: A Comprehensive Survey , 2014, Proceedings of the IEEE.

[15]  George Varghese,et al.  P4: programming protocol-independent packet processors , 2013, CCRV.

[16]  Eli Dart,et al.  The Science DMZ: A network design pattern for data-intensive science , 2013, 2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[17]  Jürgen Schönwälder,et al.  Network Configuration Protocol (NETCONF) , 2011, RFC.

[18]  Neal Charbonneau,et al.  Advance reservation frameworks in hybrid IP-WDM networks , 2011, IEEE Communications Magazine.

[19]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[20]  Steven Tuecke,et al.  GridFTP: Protocol Extensions to FTP for the Grid , 2001 .