Hybrid (OpenMP and MPI) parallelization of MFIX: a multiphase CFD code for modeling fluidized beds

We describe the effort and experience in generating a hybrid parallel version of MFIX (Multiphase Flow with Interphase eXchanges), a code for modeling reactive multiphase flow in fluidized beds. The code uses portable OpenMP and MPI in a unified source code. The resulting parallel code has been ported to Beowulf Linux clusters, SGI shared memory multiprocessors, Compaq SC clusters, and an IBM SP. We present hybrid parallel performance results specifically on the 32-way node of IBM SP. This experience is relevant, as most modern high-performance computing (HPC) systems are clusters of SMP nodes.

[1]  Homer F. Walker,et al.  NITSOL: A Newton Iterative Solver for Nonlinear Systems , 1998, SIAM J. Sci. Comput..

[2]  D. Gidaspow.  Multiphase Flow and Fluidization: Continuum and Kinetic Theory Descriptions , 1994 .

[3]  Madhava Syamlal,et al.  MFIX documentation numerical technique , 1998 .

[4]  R. M. Bowen.  Part I – Theory of Mixtures , 1976 .

[5]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[6]  T. B. Anderson,et al.  Fluid Mechanical Description of Fluidized Beds. Equations of Motion , 1967 .

[7]  Chia-Jung Hsu.  Numerical Heat Transfer and Fluid Flow , 1981 .

[8]  M. Syamlal,et al.  MFIX documentation theory guide , 1993 .

[9]  Pierre Perrochet,et al.  On the primary variable switching technique for simulating unsaturated–saturated flows , 1999 .

[10]  Kjell Gustafsson,et al.  Control Strategies for the Iterative Solution of Nonlinear Equations in ODE Solvers , 1997, SIAM J. Sci. Comput..

[11]  Christine M. Hrenya,et al.  Effects of particle‐phase turbulence in gas‐solid flows , 1997 .

[12]  S. L. Passman,et al.  A Theory of Multiphase Mixtures , 1984 .

[13]  D. Joseph,et al.  ENSEMBLE AVERAGED AND MIXTURE THEORY EQUATIONS FOR INCOMPRESSIBLE FLUID-PARTICLE SUSPENSIONS , 1990 .

[14]  John R. Grace,et al.  Particle velocity profiles in a circulating fluidized bed riser of square cross-section , 1995 .

[15]  Stephan Schmidt.  From a Vector Computer to an SMP-Cluster Hybrid Parallelization of the CFD Code PANTA , 2000 .

[16]  Philippe Blaise,et al.  OpenMP optimisation of a parallel MPI CFD code , .

[17]  Lee A. Segel,et al.  Averaged Equations for Two-Phase Flows , 1971 .

[18]  S. Sundaresan,et al.  The role of meso-scale structures in rapid gas–solid flows , 2001, Journal of Fluid Mechanics.

[19]  Y. Tsuji,et al.  Cluster patterns in circulating fluidized beds predicted by numerical simulation (discrete particle model versus two-fluid model) , 1998 .

[20]  W. B. VanderHeyden,et al.  Toward a General Theory for Multiphase Turbulence Part I: Development and Gauging of the Model Equations , 2000 .

[21]  John R. Grace,et al.  Voidage profiles in a circulating fluidized bed of square cross-section , 1994 .

[22]  Peter A. Forsyth,et al.  Robust numerical methods for saturated-unsaturated flow with dry initial conditions in heterogeneous media , 1996 .

[23]  D. S. Drumheller,et al.  Theories of immiscible and structured mixtures , 1983 .