On-the-fly XMM-Newton spacecraft data reduction on the Grid

We present the results of the first prototype of a XMM-Newton pipeline processing task, parallelized at a CCD level, which can be run in a Grid system. By using the Grid Way application and the XMM-Newton Science Archive system, the processing of the XMM-Newton data is distributed across the Virtual Organization (VO) constituted by three different research centres: ESAC (European Space Astronomy Centre), ESTEC (the European Space research and TEchnology Centre) and UCM (Complutense University of Madrid). The proposed application workflow adjusts well to the Grid environment, making use of the massive parallel resources in a flexible and adaptive fashion.

[1]  Eduardo Huedo,et al.  A framework for adaptive execution in grids , 2004, Softw. Pract. Exp..

[2]  Sathish S. Vadhiyar,et al.  A performance oriented migration framework for the grid , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[3]  Eduardo Huedo,et al.  Experiences on adaptive grid scheduling of parameter sweep applications , 2004, 12th Euromicro Conference on Parallel, Distributed and Network-Based Processing, 2004. Proceedings..

[4]  Warren Smith,et al.  Distributed Generation of NASA Earth Science Data Products , 2003, Journal of Grid Computing.

[5]  P. Gondoin,et al.  XMM-Newton observatory. I. The spacecraft and operations , 2001 .

[6]  Eduardo Huedo,et al.  The GridWay Framework for Adaptive Scheduling and Execution on Grids , 2001, Scalable Comput. Pract. Exp..

[7]  Francine Berman,et al.  Adaptive Computing on the Grid Using AppLeS , 2003, IEEE Trans. Parallel Distributed Syst..

[8]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[9]  Elmar Pfeffermann,et al.  The European Photon Imaging Camera on XMM-Newton: The pn-CCD camera , 2001 .

[10]  Eric Gilbert,et al.  Virtual data Grid middleware services for data‐intensive science , 2006, Concurr. Comput. Pract. Exp..