Supporting extended precision on graphics processors

Scientific computing applications often require support for non-traditional data types, for example, numbers with a precision higher than 64-bit floats. As graphics processors, or GPUs, have emerged as a powerful accelerator for scientific computing, we design and implement a GPU-based extended precision library to enable applications with high precision requirement to run on the GPU. Our library contains arithmetic operators, mathematical functions, and data-parallel primitives, each of which can operate at either multi-term or multi-digit precision. The multi-term precision maintains an accuracy of up to 212 bits of signifcand whereas the multi-digit precision allows an accuracy of an arbitrary number of bits. Additionally, we have integrated the extended precision algorithms to a GPU-based query processing engine to support efficient query processing with extended precision on GPUs. To demonstrate the usage of our library, we have implemented three applications: parallel summation in climate modeling, Newton's method used in nonlinear physics, and high precision numerical integration in experimental mathematics. The GPU-based implementation is up to an order of magnitude faster, and achieves the same accuracy as their optimized, quadcore CPU-based counterparts.

[1]  T. J. Dekker,et al.  A floating-point technique for extending the available precision , 1971 .

[2]  Andrew Thall.  Extended-precision floating-point numbers for GPU computation , 2006, SIGGRAPH '06.

[3]  Bingsheng He,et al.  Frequent itemset mining on graphics processors , 2009, DaMoN '09.

[4]  David H. Bailey,et al.  Integer relation detection , 2000, Computing in Science & Engineering.

[5]  Jonathan M. Borwein,et al.  Resolution of the Quinn–Rand–Strogatz Constant of Nonlinear Physics , 2009, Exp. Math..

[6]  Jonathan M. Borwein,et al.  Highly Parallel, High-Precision Numerical Integration , 2005 .

[7]  D Dane Quinn,et al.  Singular unlocking transition in the Winfree model of coupled oscillators. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Xiaoye S. Li,et al.  Algorithms for quad-double precision floating point arithmetic , 2000, Proceedings 15th IEEE Symposium on Computer Arithmetic. ARITH-15 2001.

[9]  David Defour,et al.  Implementation of float-float operators on graphics hardware , 2006, ArXiv.

[10]  Michael Stonebraker,et al.  A Demonstration of SciDB: A Science-Oriented DBMS , 2009, Proc. VLDB Endow..

[11]  Bingsheng He,et al.  Relational joins on graphics processors , 2008, SIGMOD Conference.

[12]  Robert Strzodka,et al.  Accelerating Double Precision FEM Simulations with GPUs , 2011 .

[13]  David J. DeWitt,et al.  Scientific data management in the coming decade , 2005, SGMD.

[14]  Xiaoye S. Li,et al.  ARPREC: An arbitrary precision computation package , 2002 .

[15]  Xiaoye S. Li,et al.  A Comparison of Three High-Precision Quadrature Schemes , 2003, Exp. Math..

[16]  George Lake,et al.  From Sir Isaac to the Sloan survey: calculating the structure and chaos owing to gravity in the universe , 1997, SODA '97.

[17]  Chris H. Q. Ding,et al.  Using accurate arithmetics to improve numerical reproducibility and stability in parallel applications , 2000, ICS '00.

[18]  Susan S. Margulies,et al.  Efficient high-precision dense matrix algebra on parallel architectures for nonlinear discrete optimization , 2008 .

[19]  David H. Bailey,et al.  High-precision floating-point arithmetic in scientific computation , 2004, Computing in Science & Engineering.

[20]  Bingsheng He,et al.  Relational query coprocessing on graphics processors , 2009, TODS.

[21]  Jens H. Krüger,et al.  A Survey of General‐Purpose Computation on Graphics Hardware , 2007, Eurographics.

[22]  David H. Bailey,et al.  Algorithm 719: Multiprecision translation and execution of FORTRAN programs , 1993, TOMS.

[23]  Dinesh Manocha,et al.  Fast computation of database operations using graphics processors , 2005, SIGGRAPH Courses.

[24]  Jonathan Richard Shewchuk,et al.  Adaptive Precision Floating-Point Arithmetic and Fast Robust Geometric Predicates , 1997, Discret. Comput. Geom..