A novel FDTD application featuring OpenMP-MPI hybrid parallelization

We have developed a high performance hybridized parallel finite difference time domain (FDTD) algorithm featuring both OpenMP shared memory programming and MPl message passing. Our goal is to effectively model the optical characteristics of a novel light source created by utilizing a new class of materials known as photonic band-gap crystals. Our method is based on the solution of the second order discretized Maxwell's equations in space and time. This novel hybrid parallelization scheme allows us to take advantage of the new generation parallel machines possessing connected SMP nodes. By using parallel computations, we are able to complete a calculation on 24 processors in less than a day, where a serial version would have taken over three weeks. We present a detailed study of this hybrid scheme on an SGI origin 2000 distributed shared memory ccNUMA system along with a complete investigation of the advantages versus drawbacks of this method.

[1]  K. Yee.  Numerical solution of initial boundary value problems involving maxwell's equations in isotropic media , 1966 .

[2]  Marco Zagha,et al.  OriginTM 2000 and Onyx2® Performance Tuning and Optimization Guide , 1993 .

[3]  Jean-Pierre Berenger,et al.  A perfectly matched layer for the absorption of electromagnetic waves , 1994 .

[4]  John B. Pendry,et al.  Calculating photonic band structure , 1996 .

[5]  David A. Bader,et al.  SIMPLE: A Methodology for Programming High Performance Algorithms on Clusters of Symmetric Multiprocessors (SMPs) , 1998, J. Parallel Distributed Comput..

[6]  M. Sigalas,et al.  Metallic photonic crystals at optical wavelengths , 2000 .

[7]  David A. Bader,et al.  Algorithm Engineering for Parallel Computation , 2000, Experimental Algorithmics.

[8]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[9]  Ihab F El-Kady,et al.  Modeling of Photonic Band Gap Crystals and Applications , 2002 .

[10]  James G. Fleming,et al.  Experimental observation of photonic-crystal emission near a photonic band edge , 2003 .

[11]  S Y Lin,et al.  Highly efficient light emission at lambda = 1.5 microm by a three-dimensional tungsten photonic crystal. , 2003, Optics letters.

[12]  Shawn-Yu Lin,et al.  Three-dimensional photonic-crystal emission through thermal excitation. , 2003, Optics letters.

[13]  James G. Fleming,et al.  Photonic band gap effect in layer-by-layer metallic photonic crystals , 2003 .

[14]  Kai-Ming Ho,et al.  Lattice Symmetry Applied in Transfer-Matrix Methods for Photonic Crystals , 2003 .

[15]  James G. Fleming,et al.  Origin of absorption enhancement in a tungsten, three-dimensional photonic crystal , 2003 .

[16]  Melinda Piket-May,et al.  9 – Computational Electromagnetics: The Finite-Difference Time-Domain Method , 2005 .