START:Sensible traffic scheduling in dynamic data center networks

In data center networks (DCNs), the flow size is a crucial factor to schedule the traffic, as small flows are usually latency-sensitive (e.g., web search from users) while large flows are not (e.g., backup between two sites). Some existing flow scheduling schemes try to schedule flows based on the prior knowledge of flows, such as flow size and deadline. However, it may be unpractical to obtain the prior information in some scenarios. In this paper, we propose START to minimize the flow completion time (FCT) and guarantee the priority of small flows in DCNs. We control the priorities of packets by leveraging the multiple priority queues based on the amount of data a flow has sent. Switches schedule flows according to their priorities. In addition, to schedule the flows more intelligently, we adjust the threshold of each priority dynamically according to the network loads. A prototype of START has been implemented with ns2 simulations. START is compatible with legacy TCP/IP stacks and deployable with existing commodity switches. The results show that START significantly outperforms existing flow scheduling schemes DCTCP and L2DCT up to 40% and 45% for small flows in changing network status. In some scenarios, START can even achieve better performance than pFabric.

[1]  Junda Liu,et al.  Multi-enterprise networking , 2000 .

[2]  Haitao Wu,et al.  Per-packet load-balanced, low-latency routing for clos-based data center networks , 2013, CoNEXT.

[3]  Ali Munir,et al.  Minimizing flow completion times in data centers , 2013, 2013 Proceedings IEEE INFOCOM.

[4]  T. N. Vijaykumar,et al.  Deadline-aware datacenter tcp (D2TCP) , 2012, CCRV.

[5]  Devavrat Shah,et al.  Fastpass: a centralized "zero-queue" datacenter network , 2015, SIGCOMM 2015.

[6]  Amin Vahdat,et al.  Less Is More: Trading a Little Bandwidth for Ultra-Low Latency in the Data Center , 2012, NSDI.

[7]  Howard B. Demuth,et al.  Neutral network toolbox for use with Matlab , 1995 .

[8]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[9]  Sally Floyd,et al.  TCP and explicit congestion notification , 1994, CCRV.

[10]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[11]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[12]  Wei Bai,et al.  Information-Agnostic Flow Scheduling for Commodity Data Centers , 2015, NSDI.

[13]  George Varghese,et al.  CONGA: distributed congestion-aware load balancing for datacenters , 2015, SIGCOMM.

[14]  Christo Wilson,et al.  Better never than late , 2011, SIGCOMM 2011.

[15]  Alex X. Liu,et al.  Friends, not foes: synthesizing existing transport strategies for data center networks , 2015, SIGCOMM 2015.

[16]  Brighten Godfrey,et al.  Finishing flows quickly with preemptive scheduling , 2012, CCRV.

[17]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[18]  Keqiang He,et al.  Presto: Edge-based Load Balancing for Fast Datacenter Networks , 2015, Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication.

[19]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.

[20]  David A. Maltz,et al.  Data center TCP (DCTCP) , 2010, SIGCOMM 2010.

[21]  Nick McKeown,et al.  pFabric: minimal near-optimal datacenter transport , 2013, SIGCOMM.