Thread Migration in the River Data ow Environment

River is a prototype I/O programming environment for large-scale cluster of workstations. The assignment of the data ow and its operators (called modules) to participating nodes is currently done statically before any processing starts. The ow is dynamic because some data can be routed to modules that are processing data faster. We introduce module migration (by migrating the underlying thread) as an orthogonal load-balancing method. Module migration can help reduce load on nodes and improve performance by co-locating modules that communicate frequently.

[1]  Edward D. Lazowska,et al.  A Comparison of Receiver-Initiated and Sender-Initiated Adaptive Load Sharing , 1986, Perform. Evaluation.

[2]  Songnian Zhou.  Performance Studies of Dynamic Load Balancing in Distributed Systems , 1987 .

[3]  Andrew P. Black,et al.  Fine-grained mobility in the emerald system , 1987, SOSP '87.

[4]  Andrew P. Black,et al.  Fine-grained mobility in the Emerald system , 1987, TOCS.

[5]  Andreas Reuter,et al.  Transaction Processing: Concepts and Techniques , 1992 .

[6]  Seth Copen Goldstein,et al.  Active Messages: A Mechanism for Integrated Communication and Computation , 1992, [1992] Proceedings the 19th Annual International Symposium on Computer Architecture.

[7]  Edward Mascarenhas,et al.  Ariadne: Architecture of a Portable Threads system supporting Mobile Processes , 1995 .

[8]  Jean-François Méhaut,et al.  PM2: Parallel Multithreaded Machine. A Computing Environment for Distributed Architectures , 1995, PARCO.

[9]  David E. Culler,et al.  A case for NOW (networks of workstation) , 1995, PODC '95.

[10]  David E. Culler,et al.  Active Message Applications Programming Interface , 1996 .

[11]  Miron Livny,et al.  Checkpoint and Migration of UNIX Processes in the Condor Distributed Processing System , 1997 .

[12]  Andrea C. Arpaci-Dusseau,et al.  Parallel computing on the berkeley now , 1997 .

[13]  A. Schuster,et al.  Thread migration and its applications in distributed shared memory systems , 1998, J. Syst. Softw..

[14]  Peter Reading,et al.  High-throughput deep sequencing reveals that microRNAs play important roles in salt tolerance of euhalophyte Salicornia europaea , 2015, BMC Plant Biology.

[15]  Jürgen Quittek,et al.  Efficient fine-grain thread migration with active threads , 1998, Proceedings of the First Merged International Parallel Processing Symposium and Symposium on Parallel and Distributed Processing.

[16]  Noah Treuhaft,et al.  Cluster I/O with River: making the fast case common , 1999, IOPADS '99.