On the effect of large-scale deployment of parallel downloading

In the presence of multiple mirror servers that can serve the same information, clients can improve their performance when downloading large files by concurrently retrieving different parts of the file from different servers. In previous work, experiments with a single client have shown the potential for parallel downloading schemes to improve the performance perceived by this single client. We consider the question of what happens when parallel downloading is widely adopted within the Internet. To that end we start with an experimental evaluation of various parallel downloading schemes and their performance from the perspective of a single client. We use these results as a benchmark for a set of simulations in which we investigate the performance of parallel downloading when performed by multiple clients. We find that, because parallel downloading incurs additional overhead as a result of its use of more network connections, large-scale use of this technique can actually lead to overall degradation of the performance experienced by clients. Further, we uncover a "fairness" tradeoff in that any performance improvement experienced by clients performing parallel downloading comes at the expense of clients who simply go to a single server to retrieve files.

[1]  Pablo Rodriguez,et al.  Parallel-access for mirror sites in the Internet , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[2]  Peter A. Dinda,et al.  Performance characteristics of mirror servers on the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[3]  Harry G. Perros,et al.  A Decomposition Procedure for the Analysis of a Closed Fork/Join Queueing System , 1991, IEEE Trans. Computers.

[4]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.0 , 1996, RFC.

[5]  Asser N. Tantawi,et al.  Approximate Analysis of Fork/Join Synchronization in Parallel Queues , 1988, IEEE Trans. Computers.

[6]  Moshe Sidi,et al.  Resequencing considerations in parallel downloads , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[7]  Tadeusz Czachórski,et al.  Performance evaluation of fork and join synchronization primitives , 1987, Acta Informatica.

[8]  Vern Paxson,et al.  TCP Congestion Control , 1999, RFC.

[9]  Michael O. Rabin,et al.  Efficient dispersal of information for security, load balancing, and fault tolerance , 1989, JACM.

[10]  Michael Mitzenmacher,et al.  Accessing multiple mirror sites in parallel: using Tornado codes to speed up downloads , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[11]  Jia Wang,et al.  A survey of web caching schemes for the Internet , 1999, CCRV.

[12]  Kishor S. Trivedi,et al.  Analytic Queueing Models for Programs with Internal Concurrency , 1983, IEEE Transactions on Computers.

[13]  Don Towsley,et al.  Computing Performance Bounds for Fork-Join Queueing Models , 1994 .