A Novel Cache-based Framework for Accelerating Real-time Flow Transmission

Real-time flow transmission is widely used in various online applications, such as video transmission, social networks, etc. Most of these tasks which require strict deadlines need to be handled by distributed systems, so the deadline guarantee of the whole system can be divided into each node. However, due to insufficient computing power or software errors, some nodes are prone to delay data processing, leading to the loss of computing deadline, resulting in the loss of the cutoff event of the whole system, and causing the data processing delay of the next link. In view of the performance loss caused by this situation, this paper proposes a cache-based processing framework to speed up the forwarding of real-time data flows. By estimating the data processing ability of nodes online, when the processing ability of nodes is out of order, some computing tasks can be mapped to other preparatory nodes online, so as to achieve fast task. Migration ensures the deadline of computing tasks on nodes. By adjusting reasonable system parameters, the processing capacity of nodes in distributed system can be accelerated, so that the processing capacity of the system can be increased dynamically and the data flow forwarding capability of the whole system can be accelerated. The results show that this method can increase the number of data forwarding by 23% and reduce the data loss rate by 31%.

[1]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[2]  Haitao Wu,et al.  ICTCP: Incast Congestion Control for TCP in Data-Center Networks , 2013, IEEE/ACM Transactions on Networking.

[3]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.

[4]  Mark Handley,et al.  Improving datacenter performance and robustness with multipath TCP , 2011, SIGCOMM 2011.

[5]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[6]  Ion Stoica,et al.  FairCloud: sharing the network in cloud computing , 2011, SIGCOMM '12.

[7]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[8]  Sarbjeet Singh,et al.  Survey on scheduling in hybrid clouds , 2014, Fifth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[9]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).