Applying scheduling and tuning to on-line parallel tomography

Tomography is a popular technique to reconstruct the three-dimensional structure of an object from a series of two-dimensional projections. Tomography is resource-intensive and deployment of a parallel implementation onto Computational Grid platforms has been studied in previous work. In this work, we address on-line execution of the application where computation is performed as data is collected from an on-line instrument. The goal is to compute incremental 3-D reconstructions that provide quasi-real-time feedback to the user.We model on-line parallel tomography as a tunable application: trade-offs between resolution of the reconstruction and frequency of feedback can be used to accommodate various resource availabilities. We demonstrate that application scheduling/tuning can be framed as multiple constrained optimization problems and evaluate our methodology in simulation. Our results show that prediction of dynamic network performance is key to efficient scheduling and that tunability allows for production runs of on-line parallel tomography in Computational Grid environments.

[1]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[2]  David Abramson,et al.  High performance parametric modeling with Nimrod/G: killer application for the global grid? , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[3]  Maxine D. Brown,et al.  The ImmersaDesk and Infinity Wall projection-based virtual reality displays , 1997, COMG.

[4]  Andrew S. Grimshaw,et al.  Wide-Area Computing: Resource Sharing on a Large Scale , 1999, Computer.

[5]  Francine Berman,et al.  The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[6]  Carl Kesselman,et al.  Quasi-real-time x-ray microtomography system at the Advanced Photon Source , 1999, Optics & Photonics.

[7]  Henri Casanova,et al.  NetSovle: A Network Server for Solving Computational Science Problems , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[8]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[9]  Peter A. Dinda,et al.  The Case for Prediction-Based Best-Effort Real-Time Systems , 1999, IPPS/SPDP Workshops.

[10]  Carl Kesselman,et al.  Real-time Analysis, Visualization, and Steering of Microtomography Experiments at Photon Source , 2000, PP.

[11]  Fangzhe Chang,et al.  Exploiting Application Tunability for Efficient, Predictable Resource Management in Parallel and Distributed Systems , 2000, J. Parallel Distributed Comput..

[12]  Mark H. Ellisman,et al.  Serial Section Electron Tomography: A Method for Three-Dimensional Reconstruction of Large Structures , 1994, NeuroImage.

[13]  Henri Casanova,et al.  Simgrid: a toolkit for the simulation of application scheduling , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[14]  Francine Berman,et al.  Application-Level Scheduling on Distributed Heterogeneous Networks , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[15]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[16]  Selim G. Akl,et al.  Real-time computation: a formal definition and its applications , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[17]  Francine Berman,et al.  Combining workstations and supercomputers to support grid applications: the parallel tomography experience , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[18]  Stamatis Vassiliadis,et al.  Parallel Computer Architecture , 2000, Euro-Par.

[19]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[20]  G A Perkins,et al.  Electron tomography of large, multicomponent biological structures. , 1997, Journal of structural biology.

[21]  Ian T. Foster,et al.  The Globus project: a status report , 1998, Proceedings Seventh Heterogeneous Computing Workshop (HCW'98).

[22]  Satoshi Matsuoka,et al.  Overview of a performance evaluation system for global computing scheduling algorithms , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[23]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[24]  Francine Berman,et al.  The AppLeS Project: A Status Report , 1997 .

[25]  Francine Berman,et al.  Applying scheduling and tuning to on-line parallel tomography , 2002 .

[26]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[27]  M. Radermacher,et al.  Three-dimensional reconstruction of single particles from random and nonrandom tilt series. , 1988, Journal of electron microscopy technique.

[28]  Torben Hagerup,et al.  Allocating Independent Tasks to Parallel Processors: An Experimental Study , 1996, J. Parallel Distributed Comput..

[29]  N. Hassani,et al.  Principles of computerized tomography. , 1976, Journal of the National Medical Association.

[30]  Francine Berman,et al.  Using Apples to Schedule Simple SARA on the Computational Grid , 1999, Int. J. High Perform. Comput. Appl..

[31]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[32]  Francine Berman,et al.  Application-aware scheduling of a magnetohydrodynamics application in the Legion metasystem , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[33]  Francine Berman,et al.  Using Effective Network Views to Promote Distributed Application Performance , 1999, PDPTA.

[34]  Reinhard Klette,et al.  Handbook of image processing operators , 1996 .

[35]  Neil Spring,et al.  Application level scheduling of gene sequence comparison on metacomputers , 1998 .

[36]  Joachim Frank,et al.  Three-Dimensional Reconstruction of Nonperiodic Macromolecular Assemblies from Electron Micrographs , 1986 .

[37]  P. Gilbert.  Iterative methods for the three-dimensional reconstruction of an object from projections. , 1972, Journal of theoretical biology.