Applied Mathematics Research for Exascale Computing

Cover art by George Kitrinos, a derivative of " Circuit board elements background " from freedesign-file.com, used under Creative Commons Attribution 3.0. Equations from a far-field approximation of the Green's function solution to the acoustic analogy equation with thermoacoustic sources. Government nor any agency thereof, nor any of their employees or officers, makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States Government or any agency thereof. The views and opinions of document authors expressed herein do not necessarily state or reflect those of the United States Government or any agency thereof and shall not be used for advertising or product endorsement purposes. Abstract This report details the findings and recommendations of the DOE ASCR Exascale Mathematics Working Group that was chartered to identify mathematics and algorithms research opportunities that will enable scientific applications to harness the potential of exascale computing. The working group organized a workshop, held August 21-22, 2013 in Washington, D.C., to solicit input from over seventy members of the applied mathematics community. Research gaps, approaches, and directions across the breadth of applied mathematics were discussed, and this report synthesizes these perspectives into an integrated outlook on the applied mathematics research necessary to achieve scientific breakthroughs using exascale systems.

[1]  Cetin Unal,et al.  Science Based Nuclear Energy Systems Enabled by Advanced Modeling and Simulation at the Extreme Scale White Paper on Integrated Performance and Safety Codes , 2009 .

[2]  Andreas Griewank,et al.  Evaluating derivatives - principles and techniques of algorithmic differentiation, Second Edition , 2000, Frontiers in applied mathematics.

[3]  Habib N. Najm,et al.  Probabilistic Approaches for Communication Avoidance and Resilience in Exascale Simulations. , 2013 .

[4]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[5]  Alice Koniges,et al.  Material Point Methods and Multiphysics for Fracture and Multiphase Problems , 2013 .

[6]  Henry Hoffmann Managing Competing Goals with a Self-aware Runtime System , 2012 .

[7]  Erik G. Boman Randomized and Asynchronous Algorithms for Large Linear Systems. , 2013 .

[8]  L. Greengard,et al.  Spectral Deferred Correction Methods for Ordinary Differential Equations , 2000 .

[9]  D. Brandt,et al.  Multi-level adaptive solutions to boundary-value problems math comptr , 1977 .

[10]  John Shalf,et al.  Exascale and Beyond: Configuring, Reasoning, Scaling. Report of the 2011 Workshop on Architectures II: Exascale and Beyond, held August 8-10, Albuquerque, N.M. , 2011 .

[11]  Joshua B. Tenenbaum,et al.  The Isomap Algorithm and Topological Stability , 2002, Science.

[12]  Dongbin Xiu,et al.  High-Order Collocation Methods for Differential Equations with Random Inputs , 2005, SIAM J. Sci. Comput..

[13]  John Shalf,et al.  Exascale Operating Systems and Runtime Software Report , 2012 .

[14]  Timothy G. Trucano,et al.  Predictive Capability Maturity Model for computational modeling and simulation. , 2007 .

[15]  R. P. Fedorenko A relaxation method for solving elliptic difference equations , 1962 .

[16]  H. D. Victory,et al.  The convergence theory of particle-in-cell methods for multidimensional VLASOV-POISSON systems , 1991 .

[17]  N. Bakhvalov On the convergence of a relaxation method with natural constraints on the elliptic operator , 1966 .

[18]  Charles E. Clark,et al.  Monte Carlo , 2006 .

[19]  Ralf Giering,et al.  Increasing Memory Locality by Executing Several Model Instances Simultaneously , 2012 .

[20]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[21]  M. Hochbruck,et al.  Exponential integrators , 2010, Acta Numerica.

[22]  Shi Jin ASYMPTOTIC PRESERVING (AP) SCHEMES FOR MULTISCALE KINETIC AND HYPERBOLIC EQUATIONS: A REVIEW , 2010 .

[23]  M. Berger,et al.  Adaptive mesh refinement for hyperbolic partial differential equations , 1982 .

[24]  Mohammad A. Khaleel,et al.  Scientific Grand Challenges: Challenges in Climate Change Science and the Role of Computing at the Extreme Scale , 2009 .

[25]  J. Lions,et al.  Résolution d'EDP par un schéma en temps « pararéel » , 2001 .

[26]  G. Dilts MOVING-LEAST-SQUARES-PARTICLE HYDRODYNAMICS-I. CONSISTENCY AND STABILITY , 1999 .

[27]  Guannan Zhang,et al.  Stochastic finite element methods for partial differential equations with random input data* , 2014, Acta Numerica.

[28]  Elizabeth L. Bouzarth,et al.  A multirate time integrator for regularized Stokeslets , 2010, J. Comput. Phys..

[29]  Emil M. Constantinescu,et al.  Resilient, Communication-Reducing, and Adaptive Time Stepping to Accelerate Exascale Scientic Applications , 2013 .

[30]  Sivasankaran Rajamanickam,et al.  Combinatorial Scientific Computing for Exascale Systems and Applications. , 2013 .

[31]  Ali Pinar,et al.  Sublinear Algorithms for In-situ and In-transit Data Analysis at the Extreme-Scale. , 2013 .

[32]  Mohammad A. Khaleel Scientific Grand Challenges: Crosscutting Technologies for Computing at the Exascale - February 2-4, 2010, Washington, D.C. , 2011 .

[33]  Alejandro L. Garcia,et al.  Adaptive Mesh and Algorithm Refinement Using Direct Simulation Monte Carlo , 1999 .

[34]  B. Mohammadi Principal angles between subspaces and reduced order modelling accuracy in optimization , 2014 .

[35]  Jacob A. Abraham,et al.  Algorithm-Based Fault Tolerance for Matrix Operations , 1984, IEEE Transactions on Computers.

[36]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[37]  Wim Vanroose,et al.  Hiding global communication latency and increasing the arithmetic intensity in extreme-scale Krylov solvers , 2013 .

[38]  Giulia Galli,et al.  Scientific Grand Challenges: Discovery In Basic Energy Sciences: The Role of Computing at the Extreme Scale - August 13-15, 2009, Washington, D.C. , 2009 .

[39]  John C. Butcher General linear methods , 2006, Acta Numerica.

[40]  Fabio Nobile,et al.  An Anisotropic Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data , 2008, SIAM J. Numer. Anal..

[41]  Harold C. Edwards,et al.  Realizing Exascale Performance for Uncertainty Quantification. , 2013 .

[42]  Ray W. Grout,et al.  Feature-Based Statistical Analysis of Combustion Simulation Data , 2011, IEEE Transactions on Visualization and Computer Graphics.

[43]  D. Birchall,et al.  Computational Fluid Dynamics , 2020, Radial Flow Turbocompressors.

[44]  Margaret H. Wright,et al.  The opportunities and challenges of exascale computing , 2010 .

[45]  John C. Butcher,et al.  On the Convergence of Numerical Solutions to Ordinary Differential Equations , 1966 .

[46]  Ted Belytschko,et al.  A unified stability analysis of meshless particle methods , 2000 .

[47]  Shanhui Fan,et al.  Parallel stochastic methods for exploring randomness in solar cell designs , 2013 .

[48]  Michael A. Heroux Toward resilient algorithms and applications , 2013, FTXS '13.

[49]  R. Zwanzig Nonequilibrium statistical mechanics , 2001, Physics Subject Headings (PhySH).

[50]  Christian Engelmann,et al.  Position Paper : Operating System and Runtime Software for Exascale Systems July 
 13 , 
 2012 
 1 / 4 
 Dynamic Self-Aware Runtime Software for Exascale Systems , 2012 .

[51]  William Gropp,et al.  Applied Mathematics at the U.S. Department of Energy: Past, Present and a View to the Future , 2008 .

[52]  Raúl Tempone,et al.  Galerkin Finite Element Approximations of Stochastic Elliptic Partial Differential Equations , 2004, SIAM J. Numer. Anal..

[53]  Marlis Hochbruck,et al.  Exponential Integrators for Large Systems of Differential Equations , 1998, SIAM J. Sci. Comput..

[54]  Emil M. Constantinescu,et al.  Multiphysics simulations , 2013, HiPC 2013.

[55]  Shuaiwen Song,et al.  Exploring Machine Learning Techniques For Dynamic Modeling on Future Exascale Systems , 2013 .

[56]  Mihai Anitescu,et al.  A Multifaceted Mathematical Approach for Complex Systems , 2012 .

[57]  Jürg Nievergelt,et al.  Parallel methods for integrating ordinary differential equations , 1964, CACM.

[58]  J. W. Ruge,et al.  4. Algebraic Multigrid , 1987 .

[59]  M. Minion Semi-implicit spectral deferred correction methods for ordinary differential equations , 2003 .