A novel FDTD application featuring OpenMP-MPI hybrid parallelization

We have developed a high performance hybridized parallel finite difference time domain (FDTD) algorithm featuring both OpenMP shared memory programming and MPl message passing. Our goal is to effectively model the optical characteristics of a novel light source created by utilizing a new class of materials known as photonic band-gap crystals. Our method is based on the solution of the second order discretized Maxwell's equations in space and time. This novel hybrid parallelization scheme allows us to take advantage of the new generation parallel machines possessing connected SMP nodes. By using parallel computations, we are able to complete a calculation on 24 processors in less than a day, where a serial version would have taken over three weeks. We present a detailed study of this hybrid scheme on an SGI origin 2000 distributed shared memory ccNUMA system along with a complete investigation of the advantages versus drawbacks of this method.

[1]  Shawn-Yu Lin,et al.  Three-dimensional photonic-crystal emission through thermal excitation. , 2003, Optics letters.

[2]  James G. Fleming,et al.  Experimental observation of photonic-crystal emission near a photonic band edge , 2003 .

[3]  Dennis J. Volper,et al.  Geometric retrieval in parallel , 1988 .

[4]  Ihab F El-Kady,et al.  Modeling of Photonic Band Gap Crystals and Applications , 2002 .

[5]  James G. Fleming,et al.  Origin of absorption enhancement in a tungsten, three-dimensional photonic crystal , 2003 .

[6]  Bob Francis,et al.  Silicon Graphics Inc. , 1993 .

[7]  James G. Fleming,et al.  Photonic band gap effect in layer-by-layer metallic photonic crystals , 2003 .

[8]  Highly efficient light emission at λ = 1.5 μm by a three-dimensional tungsten photonic crystal , 2003 .

[9]  Kai-Ming Ho,et al.  Lattice Symmetry Applied in Transfer-Matrix Methods for Photonic Crystals , 2003 .

[10]  Jean-Pierre Berenger,et al.  A perfectly matched layer for the absorption of electromagnetic waves , 1994 .

[11]  J. G. Fleming,et al.  All-metallic three-dimensional photonic crystals with a large infrared bandgap , 2002, Nature.

[12]  David A. Bader,et al.  Algorithm Engineering for Parallel Computation , 2000, Experimental Algorithmics.

[13]  John B. Pendry,et al.  Calculating photonic band structure , 1996 .

[14]  Melinda Piket-May,et al.  9 – Computational Electromagnetics: The Finite-Difference Time-Domain Method , 2005 .

[15]  M. Sigalas,et al.  Metallic photonic crystals at optical wavelengths , 2000 .

[16]  K. Yee.  Numerical solution of initial boundary value problems involving maxwell's equations in isotropic media , 1966 .