Fog in the network weather service: a case for novel approaches

A very large amount of data must be used to reasonably measure the available network bandwidth in a Grid by simply checking the time that it takes to send it across the network with TCP. The Network Weather Service (NWS) is the most common tool for obtaining transfer delay predictions from network measurements in Grids. We show that, in simple tests in a real Grid, the results that it obtains are not good enough or require heavily loading the network. The point of this study is to illustrate the need for more sophisticated and appropriately designed network measurement tools.

[1]  Mary Baker,et al.  Nettimer: A Tool for Measuring Bottleneck Link Bandwidth , 2001, USITS.

[2]  Jean-Chrysostome Bolot,et al.  End-to-end packet delay and loss behavior in the internet , 1993, SIGCOMM '93.

[3]  I Bird,et al.  LHC computing grid : Technical design report , 2005 .

[4]  Matthias Frank,et al.  Receiver-Based Path Capacity Estimation for TCP , 2005, KiVS Kurzbeiträge und Workshop.

[5]  Yehia El-khatib,et al.  A survey-based study of grid traffic , 2007, GridNets '07.

[6]  Pascale Vicat-Blanc Primet,et al.  Experiments of Network Throughput Measurement and Forecasting Using the Network Weather , 2002, 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'02).

[7]  Robert T. Braden,et al.  Requirements for Internet Hosts - Communication Layers , 1989, RFC.

[8]  Martin Swany,et al.  Performance information services for computational Grids , 2004 .

[9]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[10]  Richard Wolski,et al.  Synchronizing network probes to avoid measurement intrusiveness with the Network Weather Service , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[11]  Antonio Pescapè,et al.  On the performance of bandwidth estimation tools , 2005, 2005 Systems Communications (ICW'05, ICHSN'05, ICMCS'05, SENET'05).

[12]  Sally Floyd,et al.  HighSpeed TCP for Large Congestion Windows , 2003, RFC.

[13]  Parameswaran Ramanathan,et al.  Packet-dispersion techniques and a capacity-estimation methodology , 2004, IEEE/ACM Transactions on Networking.

[14]  Manish Jain,et al.  End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput , 2003, TNET.

[15]  Mark Allman,et al.  TCP Congestion Control with Appropriate Byte Counting (ABC) , 2003, RFC.

[16]  Vern Paxson,et al.  TCP Congestion Control , 1999, RFC.

[17]  Richard Wolski,et al.  Dynamically forecasting network performance using the Network Weather Service , 1998, Cluster Computing.

[18]  kc claffy,et al.  Bandwidth estimation: metrics, measurement techniques, and tools , 2003, IEEE Netw..