High-throughput Multicast Communication for Grid Applications

[1]  Constantinos Dovrolis,et al.  The effect of layer-2 switches on pathchar-like tools , 2002, IMW '02.

[2]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[3]  Richard G. Baraniuk,et al.  pathChirp: Efficient available bandwidth estimation for network paths , 2003 .

[4]  Bradley Huffaker,et al.  Traceroute probe method and forward IP path inference , 2008, IMC '08.

[5]  Piet Hut,et al.  A hierarchical O(N log N) force-calculation algorithm , 1986, Nature.

[6]  Larry L. Peterson,et al.  Reliability and Security in the CoDeeN Content Distribution Network , 2004, USENIX Annual Technical Conference, General Track.

[7]  D. Martin Swany,et al.  Improving Throughput for Grid Applications with Network Logistics , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[8]  Jason Lee,et al.  Exploring practical limitations of TCP over transatlantic networks , 2005, Future Gener. Comput. Syst..

[9]  K. Claffy,et al.  Topology discovery by active probing , 2002, Proceedings 2002 Symposium on Applications and the Internet (SAINT) Workshops.

[10]  R. Prim.  Shortest connection networks and some generalizations , 1957 .

[11]  Richard Wolski,et al.  Experiences with predicting resource performance on-line in computational grid settings , 2003, PERV.

[12]  Robert L. Grossman,et al.  UDT: UDP-based data transfer for high-speed wide area networks , 2007, Comput. Networks.

[13]  Kees Verstoep,et al.  Cluster communication protocols for parallel-programming systems , 2004, TOCS.

[14]  Francine Berman,et al.  Using Effective Network Views to Promote Distributed Application Performance , 1999, PDPTA.

[15]  Kees Verstoep,et al.  Wide-area communication for grids: an integrated solution to connectivity, performance and security problems , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[16]  William Chan,et al.  Improving Traffic Locality in BitTorrent via Biased Neighbor Selection , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[17]  Sergei Gorlatch,et al.  Towards High-Level Grid Programming and Load-Balancing: A Barnes-Hut Case Study , 2005, Euro-Par.

[18]  Vinay S. Pai,et al.  Chainsaw: Eliminating Trees from Overlay Multicast , 2005, IPTPS.

[19]  Henri E. Bal,et al.  User-friendly and reliable grid computing based on imperfect middleware , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[20]  Richard Wolski,et al.  Synchronizing network probes to avoid measurement intrusiveness with the Network Weather Service , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[21]  Klara Nahrstedt,et al.  Maxmin overlay multicast: rate allocation and tree construction , 2004, Twelfth IEEE International Workshop on Quality of Service, 2004. IWQOS 2004..

[22]  David L. Mills.  The fuzzball , 1988, SIGCOMM.

[23]  Dick H. J. Epema,et al.  An Amortized Tit-For-Tat Protocol for Exchanging Bandwidth instead of Content in P2P Networks , 2007, First International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2007).

[24]  Borja Sotomayor,et al.  Virtual Clusters for Grid Communities , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[25]  Amin Vahdat,et al.  Using Random Subsets to Build Scalable Network Services , 2003, USENIX Symposium on Internet Technologies and Systems.

[26]  Manish Jain,et al.  End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput , 2002, SIGCOMM 2002.

[27]  Ying Ding,et al.  Logistical multicast for data distribution , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[28]  S. Hemminger.  Network Emulation with NetEm , 2022 .

[29]  Demetres Antoniades,et al.  Available bandwidth measurement as simple as running wget , 2006 .

[30]  Hao Jiang,et al.  Passive estimation of TCP round-trip times , 2002, CCRV.

[31]  Van Jacobson,et al.  A tool to infer characteristics of internet paths , 1997 .

[32]  Klara Nahrstedt,et al.  On achieving optimized capacity utilization in application overlay networks with multiple competing sessions , 2004, SPAA '04.

[33]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[34]  A. Frieze,et al.  On the connectivity of randomm-orientable graphs and digraphs , 1982 .

[35]  Kees Verstoep,et al.  Efficient reliable multicast on Myrinet , 1996, Proceedings of the 1996 ICPP Workshop on Challenges for Parallel Processing.

[36]  Jeffrey D. Case,et al.  Simple Network Management Protocol (SNMP) , 1989, RFC.

[37]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[38]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[39]  B. A. Mar,et al.  pchar : A Tool for Measuring Internet Path Characteristics , 2000 .

[40]  Kai Lai Chung,et al.  Markov Chains with Stationary Transition Probabilities , 1961 .

[41]  A. Cayley.  A theorem on trees , 2009 .

[42]  Amin Vahdat,et al.  Bullet: high bandwidth data dissemination using an overlay mesh , 2003, SOSP '03.

[43]  GWD-C.  A Hierarchy of Network Performance Characteristics for Grid Applications and Services , 2003 .

[44]  Jon Postel,et al.  Internet Control Message Protocol , 1981, RFC.

[45]  Gilles Fedak,et al.  A File Transfer Service with Client/Server, P2P and Wide Area Storage Protocols , 2008, Globe.

[46]  Mark Allman,et al.  Measuring end-to-end bulk transfer capacity , 2001, IMW '01.

[47]  Peter A. Dinda,et al.  An Extensible Toolkit for Resource Prediction In Distributed Systems , 1999 .

[48]  Sandeep Chandra,et al.  Grid systems deployment & management using Rocks , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).

[49]  Jason Maassen,et al.  Ibis: a flexible and efficient Java‐based Grid programming environment , 2005, Concurr. Pract. Exp..

[50]  Henri E. Bal,et al.  MagPIe: MPI's collective communication operations for clustered wide area systems , 1999, PPoPP '99.

[51]  Omer F. Rana,et al.  Distributed Storage of High-Volume Environmental Simulation Data: Mantle Modelling , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[52]  Yoshio Tanaka,et al.  A Multi-Site Virtual Cluster System for Wide Area Networks , 2008, LASCO.

[53]  Parameswaran Ramanathan,et al.  What do packet dispersion techniques measure? , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[54]  Henri E. Bal,et al.  Efficient load balancing for wide-area divide-and-conquer applications , 2001, PPoPP '01.

[55]  B. Cohen,et al.  Incentives Build Robustness in Bit-Torrent , 2003 .

[56]  G. Wrzesinska.  Handling complexity and change in grid computing , 2007 .

[57]  Dick H. J. Epema,et al.  Replication in bandwidth-symmetric BitTorrent networks , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[58]  Kurt Stockinger,et al.  Dynamic data replication in LCG 2008 , 2008 .

[59]  Mark Crovella,et al.  Measuring Bottleneck Link Speed in Packet-Switched Networks , 1996, Perform. Evaluation.

[60]  Jason Maassen,et al.  Smartsockets: solving the connectivity problems in grid computing , 2007, HPDC '07.

[61]  John Shalf,et al.  Enabling Applications on the Grid: A Gridlab Overview , 2003, Int. J. High Perform. Comput. Appl..

[62]  Mingchu Li,et al.  On the connectedness of peer-to-peer overlay networks , 2005, 11th International Conference on Parallel and Distributed Systems (ICPADS'05).

[63]  Jason Maassen,et al.  Middleware adaptation with the Delphoi service , 2006, Concurr. Comput. Pract. Exp..

[64]  Robert L. Grossman,et al.  PSockets: The Case for Application-level Network Striping for Data Intensive Applications using High Speed Wide Area Networks , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[65]  Mary Baker,et al.  Measuring link bandwidths using a deterministic model of packet delay , 2000, SIGCOMM.

[66]  Robert E. Tarjan,et al.  Depth-First Search and Linear Graph Algorithms , 1972, SIAM J. Comput..

[67]  Mats Björkman,et al.  Regression-Based Available Bandwidth Measurements , 2002 .

[68]  Rauf Izmailov,et al.  Fast Parallel File Replication in Data Grid , 2004 .

[69]  Brian E. Smith,et al.  Massively Parallel BLAST for the Blue Gene / L , 2005 .

[70]  Jason Maassen,et al.  Satin: Simple and Efficient Java-based Grid Programming , 2005, Scalable Comput. Pract. Exp..

[71]  Jun Wang,et al.  TRIBLER: a social‐based peer‐to‐peer system , 2008, IPTPS.

[72]  Richard Wolski,et al.  Network Scheduling for Computational Grid Environments , 2001, Scalable Comput. Pract. Exp..

[73]  Srinivasan Seetharaman,et al.  Analyzing Cross-layer Interaction in Overlay Networks , 2007 .

[74]  Dah-Ming Chiu,et al.  Experiences in programming a traffic shaper , 2000, Proceedings ISCC 2000. Fifth IEEE Symposium on Computers and Communications.

[75]  Min Sik Kim,et al.  Optimal distribution tree for Internet streaming media , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[76]  Paul Mackerras,et al.  The rsync algorithm , 1996 .

[77]  Christophe Diot,et al.  Deployment issues for the IP multicast service and architecture , 2000, IEEE Netw..

[78]  Richard Wolski,et al.  Building Performance Topologies for Computational Grids , 2004, Int. J. High Perform. Comput. Appl..

[79]  Kirk L. Johnson,et al.  Overcast: reliable multicasting with on overlay network , 2000, OSDI.

[80]  Vinay Pai,et al.  Improving Robustness of Peer-to-Peer Streaming with Incentives , 2006 .

[81]  Thilo Kielmann,et al.  MOB: zero-configuration high-throughput multicasting for grid applications , 2007, HPDC '07.

[82]  Fred Baker,et al.  Requirements for IP Version 4 Routers , 1995, RFC.

[83]  Xing Li,et al.  End-to-End Inference of Router Packet Forwarding Priority , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[84]  Steven Tuecke,et al.  GridFTP: Protocol Extensions to FTP for the Grid , 2001 .

[85]  Reuven Cohen,et al.  A unicast-based approach for streaming multicast , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[86]  Christos Gkantsidis,et al.  Network coding for large scale content distribution , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[87]  Marcel Worring,et al.  High-Performance Distributed Image and Video Content Analysis with Parallel-Horus , 2007 .

[88]  Van Jacobson,et al.  TCP Extensions for High Performance , 1992, RFC.

[89]  Brian D. Noble,et al.  The end-to-end performance effects of parallel TCP sockets on a lossy wide-area network , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[90]  Jameela Al-Jaroodi,et al.  A Middleware-Level Parallel Transfer Technique over Multiple Network Interfaces , 2003 .

[91]  Baochun Li,et al.  How Practical is Network Coding? , 2006, 200614th IEEE International Workshop on Quality of Service.

[92]  Brian D. Noble,et al.  The Effects of Systemic Packet Loss on Aggregate TCP Flows , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[93]  Yves Robert,et al.  Broadcast trees for heterogeneous platforms , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[94]  Kees Verstoep,et al.  Network performance-aware collective communication for clustered wide-area systems , 2001, Parallel Comput..

[95]  kc claffy,et al.  Bandwidth estimation: metrics, measurement techniques, and tools , 2003, IEEE Netw..

[96]  KyoungSoo Park,et al.  Scale and Performance in the CoBlitz Large-File Distribution Service , 2006, NSDI.

[97]  Peter H Beckman,et al.  Building the TeraGrid , 2005, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[98]  Mary Baker,et al.  Nettimer: A Tool for Measuring Bottleneck Link Bandwidth , 2001, USITS.

[99]  E. L. Hahne,et al.  Round-Robin Scheduling for Max-Min Fairness in Data Networks , 1991, IEEE J. Sel. Areas Commun..

[100]  Allen B. Downey.  Using pathchar to estimate Internet link characteristics , 1999, SIGCOMM '99.

[101]  Thilo Kielmann,et al.  Collective Receiver-Initiated Multicast for Grid Applications , 2011, IEEE Transactions on Parallel and Distributed Systems.

[102]  Jason Maassen,et al.  Resource tracking in parallel and distributed applications , 2008, HPDC '08.

[103]  Jason Maassen,et al.  Programming environments for high-performance Grid computing: the Albatross project , 2002, Future Gener. Comput. Syst..

[104]  Alexandru Iosup,et al.  2Fast : Collaborative Downloads in P2P Networks , 2006, Sixth IEEE International Conference on Peer-to-Peer Computing (P2P'06).

[105]  Richard G. Baraniuk,et al.  Locating available bandwidth bottlenecks , 2004, IEEE Internet Computing.

[106]  Pangfeng Liu,et al.  Experiences with parallel N-body simulation , 1994, SPAA '94.

[107]  Henri E. Bal,et al.  TOPOMON: A Monitoring Tool for Grid Network Topology , 2002, International Conference on Computational Science.

[108]  Bronis R. de Supinski,et al.  Exploiting hierarchy in parallel computer networks to optimize collective operation performance , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[109]  Krishna P. Gummadi,et al.  Sprobe: A fast technique for measuring bottleneck bandwidth in uncooperative environments , 2002, INFOCOM 2002.

[110]  Hideo Saito,et al.  A Stable Broadcast Algorithm , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).