An Artifact Evaluation of NDP

Artifact badging aims to rank the quality of submitted research artifacts and promote reproducibility. However, artifact badging may not indicate inherent design and evaluation limitations. This work explores current limits in artifact badging using a performance-based evaluation of the NDP artifact. We evaluate the NDP artifact beyond the Reusable badge's level, investigating the effect of aspects such as packet size and random-number seed on throughput and flow completion time. Our evaluation demonstrates that while the NDP artifact is reusable, it is not robust, and we identify architectural, implementation and evaluation limitations.

[1]  Philippe Owezarski,et al.  OSNT: open source network tester , 2014, IEEE Network.

[2]  Javid Taheri,et al.  MDTCP: Towards a Practical Multipath Transport Protocol for Telco Cloud Datacenters , 2018, 2018 9th International Conference on the Network of the Future (NOF).

[3]  Noa Zilberman.  An Evaluation of NDP performance , 2019 .

[4]  PadhyeJitendra,et al.  Data center TCP (DCTCP) , 2010 .

[5]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..

[6]  Polina Bayvel,et al.  Sub-Nanosecond Clock and Data Recovery in an Optically-Switched Data Centre Network , 2018, 2018 European Conference on Optical Communication (ECOC).

[7]  C SnoerenAlex,et al.  Inside the Social Network's (Datacenter) Network , 2015 .

[8]  Kushagra Vaid,et al.  Azure Accelerated Networking: SmartNICs in the Public Cloud , 2018, NSDI.

[9]  ZilbermanNoa.  An Artifact Evaluation of NDP , 2020 .

[10]  Andrew W. Moore,et al.  Thoughts about Artifact Badging , 2020, Comput. Commun. Rev..

[11]  Ming Zhang,et al.  Congestion Control for Large-Scale RDMA Deployments , 2015, Comput. Commun. Rev..

[12]  Albert G. Greenberg,et al.  Data center TCP (DCTCP) , 2010, SIGCOMM '10.

[13]  Andrew W. Moore,et al.  NetFPGA SUME: Toward 100 Gbps as Research Commodity , 2014, IEEE Micro.

[14]  Mark Handley,et al.  Re-architecting datacenter networks and stacks for low latency and high performance , 2017, SIGCOMM.

[15]  ZhuYibo,et al.  Congestion Control for Large-Scale RDMA Deployments , 2015 .

[16]  John K. Ousterhout,et al.  Homa: a receiver-driven low-latency transport protocol using network priorities , 2018, SIGCOMM.

[17]  Noa Zilberman,et al.  Stardust: Divide and Conquer in the Data Center Network , 2019, NSDI.

[18]  Luigi Iannone,et al.  Evaluating the artifacts of SIGCOMM papers , 2019, CCRV.

[19]  Hakim Weatherspoon,et al.  Shoal: A Network Architecture for Disaggregated Racks , 2019, NSDI.

[20]  Mark Handley,et al.  Improving datacenter performance and robustness with multipath TCP , 2011, SIGCOMM.