Swift/T: scalable data flow programming for many-task applications

Swift/T, a novel programming language implementation for highly scalable data flow programs, is presented.

[1]  Justin M. Wozniak,et al.  Coasters: Uniform Resource Provisioning and Access for Clouds and Grids , 2011, 2011 Fourth IEEE International Conference on Utility and Cloud Computing.

[2]  Daniel S. Katz,et al.  A Workflow-Aware Storage System: An Opportunity Study , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[3]  S. Leyffer,et al.  Solving Mixed-Integer Nonlinear Programs by QP-Diving , 2012 .

[4]  K. R. Traub,et al.  A COMPILER FOR THE MIT TAGGED-TOKEN DATAFLOW ARCHITECTURE , 1986 .

[5]  Daniel S. Katz,et al.  Swift: A language for distributed parallel scripting , 2011, Parallel Comput..

[6]  Christian Lengauer,et al.  A Methodology for Programming with Concurrency: An Informal Presentation , 1982, Sci. Comput. Program..

[7]  Werner Vogels,et al.  Dynamo: amazon's highly available key-value store , 2007, SOSP.

[8]  Carl Hewitt,et al.  The incremental garbage collection of processes , 1977 .

[9]  Steven Hand,et al.  CIEL: A Universal Execution Engine for Distributed Data-Flow Computing , 2011, NSDI.

[10]  Elkin Garcia,et al.  TIDeFlow: The Time Iterated Dependency Flow Execution Model , 2011, 2011 First Workshop on Data-Flow Execution Models for Extreme Scale Computing.

[11]  Vivek Sarkar,et al.  Data-Driven Tasks and Their Implementation , 2011, 2011 International Conference on Parallel Processing.

[12]  Pietro Cicotti.  Tarragon : a programming model for latency-hiding scientific computations , 2011 .

[13]  Sriram Krishnamoorthy,et al.  Scioto: A Framework for Global-View Task Parallelism , 2008, 2008 37th International Conference on Parallel Processing.

[14]  Sarita V. Adve,et al.  Parallel programming must be deterministic by default , 2009 .

[15]  David C. Cann,et al.  A Report on the Sisal Language Project , 1990, J. Parallel Distributed Comput..

[16]  Ewing Lusk,et al.  More scalability, less pain : A simple programming model and its implementation for extreme computing. , 2010 .

[17]  James W. Jones,et al.  Decision support system for agrotechnology transfer: DSSAT v3 , 1998 .

[18]  David M. Beazley,et al.  Automated scientific software scripting with SWIG , 2003, Future Gener. Comput. Syst..

[19]  Daniel S. Katz,et al.  Turbine: a distributed-memory dataflow engine for extreme-scale many-task applications , 2012, SWEET '12.

[20]  Anthony Skjellum,et al.  A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard , 1996, Parallel Comput..

[21]  Daniel S. Katz,et al.  Scheduling many-task workloads on supercomputers: Dealing with trailing tasks , 2010, 2010 3rd Workshop on Many-Task Computing on Grids and Supercomputers.

[22]  Sriram Krishnamoorthy,et al.  Fault oblivious eXascale whitepaper , 2011, ROSS '11.

[23]  Thomas Hérault,et al.  DAGuE: A Generic Distributed DAG Engine for High Performance Computing , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[24]  Brad Fitzpatrick,et al.  Distributed caching with memcached , 2004 .

[25]  Vivek Sarkar,et al.  Partitioning parallel programs for macro-dataflow , 1986, LFP '86.

[26]  Alfred V. Aho,et al.  Compilers: Principles, Techniques, and Tools , 1986, Addison-Wesley series in computer science / World student series edition.

[27]  Thomas L. Sterling,et al.  ParalleX An Advanced Parallel Execution Model for Scaling-Impaired Applications , 2009, 2009 International Conference on Parallel Processing Workshops.

[28]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[29]  John K. Ousterhout,et al.  Scripting: Higher-Level Programming for the 21st Century , 1998, Computer.

[30]  Matei Ripeanu,et al.  The case for a versatile storage system , 2010, OPSR.