Opportunities and challenges in porting a parallel code from a tightly-coupled system to the distributed EU Grid, enabling Grids for E-sciencE

Any large scale computation, either in the science or arts, requires high performance computing (HPC) facilities. This computational environment may change over time. Thus the source code of a computation needs to be ported. The change in the computational architecture or system can make the porting of code between various HPC facilities challenging. This chapter introduces an example of an engineering application which runs on a HPC facility and the porting from a local computing facility to Enabling Grids for E-sciencE (EGEE) is described in detail. The computational architecture of Enabling Grids for E-sciencE is introduced as it made our code porting very challenging, and the discussion presented is directly applicable to EGEE users. The final solution to the code poring problem is proposed, and its performance is examined. The solution to this problem be generally faced in the other large scale computation and so is applicable to users of other HPC facilities. This chapter gives a hint to those who have difficulties in applications with heavy data Input/Output (I/O) under the computational environment whose weak point is the data I/O.

[1]  Wei-keng Liao,et al.  I/O analysis and optimization for an AMR cosmology application , 2002, Proceedings. IEEE International Conference on Cluster Computing.

[2]  Raj Mittra,et al.  A robust parallel conformal finite-difference time-domain processing package using the MPI library , 2005, IEEE Antennas and Propagation Magazine.

[3]  A. D. Meglio,et al.  Programming the Grid with gLite , 2006 .

[4]  I. Codreanu,et al.  FDTD speedups obtained in distributed computing on a Linux workstation cluster , 2000, IEEE Antennas and Propagation Society International Symposium. Transmitting Waves of Progress to the Next Millennium. 2000 Digest. Held in conjunction with: USNC/URSI National Radio Science Meeting (C.

[5]  Erik G. Larsson,et al.  Optimizing Fault Tolerance for Multi-Processor System-on-Chip , 2010 .

[6]  Fumie Costen,et al.  Extension of the FDTD Huygens subgridding to frequency dependent media , 2010, Ann. des Télécommunications.

[7]  José Luis Vázquez-Poletti,et al.  Execution of a Bioinformatics Application in a Joint IRISGrid/EGEE Testbed , 2005, PPAM.

[8]  Marta Mattoso,et al.  Grid Data Management: Open Problems and New Issues , 2007, Journal of Grid Computing.

[9]  D. Pozar,et al.  Theory of electromagnetic waves , 1984, IEEE Antennas and Propagation Society Newsletter.

[10]  J. Crank,et al.  A practical method for numerical evaluation of solutions of partial differential equations of the heat-conduction type , 1947 .

[11]  D. Nurmi,et al.  A Case Study in Application I/O on Linux Clusters , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[12]  A. Balfour,et al.  The numerical solution of equations , 1967 .

[13]  Liliana María Favre A Rigouous Framework for Model-Driven Development , 2010 .

[14]  Shuang-Nan Zhang On the Solution to the , 2010 .

[15]  Steve Pettifer,et al.  The importance of locality in the visualization of large datasets , 2007, Concurr. Comput. Pract. Exp..

[16]  Johan Montagnat,et al.  Workflow-Based Data Parallel Applications on the EGEE Production Grid Infrastructure , 2008, Journal of Grid Computing.

[17]  Tuan-Anh Nguyen,et al.  Programming the Grid with POP-C ++ , 2007, Future Gener. Comput. Syst..

[18]  Robert B. Ross,et al.  PVFS: A Parallel File System for Linux Clusters , 2000, Annual Linux Showcase & Conference.

[19]  Emmanouel A. Varvarigos,et al.  Statistical Analysis and Modeling of Jobs in a Grid Environment , 2007, Journal of Grid Computing.

[20]  Johan Montagnat,et al.  Analyzing the EGEE Production Grid Workload: Application to Jobs Submission Optimization , 2009, JSSPP.

[21]  Heinrich Theodor Vierhaus,et al.  Design and Test Technology for Dependable Systems-on-Chip , 2010 .

[22]  Fumie Costen,et al.  3D crank-nicolson finite difference time domain method for dispersive media , 2009 .

[23]  F. Costen,et al.  Data format selection for an I/O-intensive large-scale FDTD , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[24]  Anders Wäänänen,et al.  Advanced resource connector middleware for lightweight computational Grids , 2007 .

[25]  Seiji Fujino,et al.  On the Solution of 3-D Frequency Dependent Crank-Nicolson FDTD Scheme , 2009 .

[26]  J. Lindemann,et al.  Advanced Resource Connector middleware for lightweight computational Grids , 2007, Future Gener. Comput. Syst..

[27]  S. Watanabe,et al.  Computation with a parallel FDTD system of human-body effect on electromagnetic absorption for portable telephones , 2004, IEEE Transactions on Microwave Theory and Techniques.

[28]  Fumie Costen,et al.  Alternative formulation of three dimensional frequency dependent ADI-FDTD method , 2004, IEICE Electron. Express.

[29]  J. J. Douglas On the Numerical Integration of $\frac{\partial ^2 u}{\partial x^2 } + \frac{\partial ^2 u}{\partial y^2 } = \frac{\partial u}{\partial t}$ by Implicit Methods , 1955 .

[30]  Sergio Andreozzi,et al.  Standards-Based Job Management in Grid Systems , 2010, Journal of Grid Computing.

[31]  Thomas Hérault,et al.  MPI Applications on Grids: A Topology Aware Approach , 2009, Euro-Par.

[32]  F. Costen,et al.  Comparison of FDTD Hard Source With FDTD Soft Source and Accuracy Assessment in Debye Media , 2009, IEEE Transactions on Antennas and Propagation.

[33]  Paul Shannon,et al.  Improving Lean, Service-Oriented Software Development at Codeweavers Ltd , 2013 .

[34]  Rajeev Thakur,et al.  On implementing MPI-IO portably and with high performance , 1999, IOPADS '99.

[35]  Jean-Pierre Bérenger,et al.  On the Huygens absorbing boundary conditions for electromagnetics , 2007, J. Comput. Phys..

[36]  Ondrej Novák Reduction of the Transferred Test Data Amount , 2011 .

[37]  K. Mahdjoubi,et al.  A parallel FDTD algorithm using the MPI library , 2001 .

[38]  Richard Vidgen,et al.  Agile and Lean Service-Oriented Development: Foundations, Theory, and Practice , 2012 .

[39]  Jin Au Kong,et al.  Theory of electromagnetic waves , 1975 .

[40]  Fabrizio Gagliardi,et al.  Building an infrastructure for scientific Grid computing: status and goals of the EGEE project , 2005, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[41]  Ricardo Jiménez-Peris,et al.  Enterprise Grids: Challenges Ahead , 2007, Journal of Grid Computing.

[42]  Charles Loomis,et al.  Scheduling for Responsive Grids , 2008, Journal of Grid Computing.

[43]  Raj Mittra,et al.  Parallel FDTD Modeling of a Focal Plane Array with Vivaldi Elements on the Highly Parallel LOFAR BlueGene/L Supercomputer , 2006, 2006 IEEE Antennas and Propagation Society International Symposium.

[44]  Marios D. Dikaiakos,et al.  Heterogeneous Grid Computing: Issues and Early Benchmarks , 2005, International Conference on Computational Science.

[45]  Melinda Piket-May,et al.  9 – Computational Electromagnetics: The Finite-Difference Time-Domain Method , 2005 .

[46]  I. Sakagami,et al.  Effective 2-Debye-Pole FDTD Model of Electromagnetic Interaction Between Whole Human Body and UWB Radiation , 2007, IEEE Microwave and Wireless Components Letters.

[47]  Peter V Coveney,et al.  Scientific Grid computing , 2005, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[48]  Fusheng Yu,et al.  Semidefinite Programming-Based Method for Implementing Linear Fitting to Interval-Valued Data , 2011, Int. J. Fuzzy Syst. Appl..

[49]  Bob Jones An Overview of the EGEE Project , 2004, DELOS.

[50]  Zhizhang Chen,et al.  A finite-difference time-domain method without the Courant stability conditions , 1999 .

[51]  J. Gerring A case study , 2011, Technology and Society.

[52]  Dheeraj Bhardwaj Application I/O on a Parallel File System for Linux Clusters , 2006 .

[53]  Liliana Favre Model Driven Architecture for Reverse Engineering Technologies: Strategic Directions and System Evolution , 2010 .

[54]  K. Kunz,et al.  A frequency-dependent finite-difference time-domain formulation for transient propagation in plasma , 1991 .

[55]  Carey M. Rappaport,et al.  A general method for FDTD modeling of wave propagation in arbitrary frequency-dispersive media , 1997 .

[56]  Stephen Childs,et al.  An Introduction to Grid Computing Using EGEE , 2009 .

[57]  R. W. Lau,et al.  The dielectric properties of biological tissues: III. Parametric models for the dielectric spectrum of tissues. , 1996, Physics in medicine and biology.

[58]  Jie Pan,et al.  Introduction to Grid Computing , 2009 .

[59]  J. Bérenger A Huygens Subgridding for the FDTD Method , 2006, IEEE Transactions on Antennas and Propagation.