A flexible library for dependable master-worker parallel programs

We describe a robust library for parallel and dependable master-worker programs (raftnet). From a software client's viewpoint, flexibility hardware independence and ease of use are the main features offered by this library, while its users may take advantage of a framework that optimises the available redundant resources so as to reach at the same time dependability, high performance and load balancing. A wide variety of applications can be targeted without major rewritings of the existing sequential code. This paper describes the implementation of this library and provides evidence to our claims describing two case studies from vision and multimedia applications.

[1]  Jeff T. Linderoth,et al.  An enabling framework for master-worker applications on the Computational Grid , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[2]  Phillip Chan,et al.  NetFiles: a novel approach to parallel programming of master/worker applications , 2001 .

[3]  Francine Berman,et al.  Master/slave computing on the Grid , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[4]  William I. Nowicki,et al.  NFS: Network File System Protocol specification , 1989, RFC.

[5]  Rudy Lauwereins,et al.  An Application-Level Dependable Technique for Farmer-Worker Parallel Programs , 1999, Informatica.

[6]  Francky Catthoor,et al.  Custom Memory Management Methodology: Exploration of Memory Organisation for Embedded Multimedia System Design , 1998 .

[7]  Flaviu Cristian,et al.  Understanding fault-tolerant distributed systems , 1991, CACM.

[8]  Alex Rapaport,et al.  Mpi-2: extensions to the message-passing interface , 1997 .

[9]  Message Passing Interface Forum.  MPI: A message - passing interface standard , 1994 .

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  Algirdas Avizienis,et al.  The N-Version Approach to Fault-Tolerant Software , 1985, IEEE Transactions on Software Engineering.

[12]  Reinhard Koch,et al.  Metric 3D Surface Reconstruction from Uncalibrated Image Sequences , 1998, SMILE.

[13]  M. Pollefeys.  Self-calibration and metric 3d reconstruction from uncalibrated image sequences , 1999 .

[14]  Joseph O'Rourke,et al.  Computational Geometry in C. , 1995 .

[15]  Laxmikant V. Kalé,et al.  Converse: an interoperable framework for parallel programming , 1996, Proceedings of International Conference on Parallel Processing.

[16]  J. O´Rourke,et al.  Computational Geometry in C: Arrangements , 1998 .