Linearly scaling 3D fragment method for large-scale electronic structure calculations

We present a new linearly scaling three-dimensional fragment (LS3DF) method for large scale ab initio electronic structure calculations. LS3DF is based on a divide-and-conquer approach, which incorporates a novel patching scheme that effectively cancels out the artificial boundary effects due to the subdivision of the system. As a consequence, the LS3DF program yields essentially the same results as direct density functional theory (DFT) calculations. The fragments of the LS3DF algorithm can be calculated separately with different groups of processors. This leads to almost perfect parallelization on over one hundred thousand processors. After code optimization, we were able to achieve 60.3 Tflop/s, which is 23.4% of the theoretical peak speed on 30,720 Cray XT4 processor cores. In a separate run on a BlueGene/P system, we achieved 107.5 Tflop/s on 131,072 cores, or 24.2% of peak. Our 13,824-atom ZnTeO alloy calculation runs 400 times faster than a direct DFT calculation, even presuming that the direct DFT calculation can scale well up to 17,280 processor cores. These results demonstrate the applicability of the LS3DF method to material simulations, the advantage of using linearly scaling algorithms over conventional O(N3) methods, and the potential for petascale computation using the LS3DF method.

[1]  Yuto Komeiji,et al.  Fragment molecular orbital method: analytical energy gradients , 2001 .

[2]  J Wu,et al.  Diluted II-VI oxide semiconductors with multiple band gaps. , 2003, Physical review letters.

[3]  Kohn,et al.  Density functional and density matrix method scaling linearly with the number of atoms. , 1996, Physical review letters.

[4]  Jean-Luc Fattebert,et al.  Linear-scaling first-principles molecular dynamics with plane-waves accuracy , 2006 .

[5]  Franz Franchetti,et al.  Large-Scale First-Principles Molecular Dynamics simulations on the BlueGene/L Platform using the Qbox code , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[6]  Yang,et al.  Direct calculation of electron density in density-functional theory. , 1991, Physical review letters.

[7]  A. Luque,et al.  Increasing the Efficiency of Ideal Solar Cells by Photon Induced Transitions at Intermediate Levels , 1997 .

[8]  Lin-wang Wang,et al.  A divide-and-conquer linear scaling three-dimensional fragment method for large scale electronic structure calculations , 2008 .

[9]  Lin-Wang Wang,et al.  Optical properties of ZnO/ZnS and ZnO/ZnTe heterostructures for photovoltaic applications. , 2007, Nano letters.

[10]  Lin-wang Wang,et al.  Solving Schrödinger’s equation around a desired energy: Application to silicon quantum dots , 1994 .

[11]  K. Kitaura,et al.  Fragment molecular orbital method: an approximate computational method for large molecules , 1999 .

[12]  P. Hohenberg,et al.  Inhomogeneous Electron Gas , 1964 .

[13]  Juan C. Meza,et al.  A Linear Scaling Three Dimensional Fragment Method for Large ScaleElectronic Structure Calculations , 2008 .

[14]  Lin-wang Wang,et al.  First principle thousand atom quantum dot calculations , 2004 .

[15]  T. Arias,et al.  Iterative minimization techniques for ab initio total energy calculations: molecular dynamics and co , 1992 .

[16]  S. Goedecker.  Linear scaling electronic structure methods , 1999 .

[17]  W. Kohn,et al.  Self-Consistent Equations Including Exchange and Correlation Effects , 1965 .

[18]  D. Sánchez-Portal,et al.  The SIESTA method for ab initio order-N materials simulation , 2001, cond-mat/0111138.

[19]  Rajiv K. Kalia,et al.  Embedded divide-and-conquer algorithm on hierarchical real-space grids: parallel molecular dynamics simulation based on linear-scaling density functional theory , 2005, Comput. Phys. Commun..