Middleware and Performance Issues for Computational Finance Applications on Blue Gene/L

We discuss real-world case studies involving the implementation of a Web services middleware tier for the IBM Blue Gene/L supercomputer to support financial business applications. These programs that are representative of a class of modern financial analytics that take part in distributed business workflows and are heavily database-centric with input and output data stored in external SQL data warehouses. We describe the design issues related to the development of our middleware tier that provides a number of core features, including an automated SQL data extraction and staging gateway, a standardized high-level job specification schema, a well-defined Web services (SOAP) API for interoperability with other applications, and a secure HTML/JSP Web-based interface suitable for general users. Further, we provide observations on performance optimizations to support the relevant data movement requirements.

[1]  David J. DeWitt,et al.  Scientific data management in the coming decade , 2005, SGMD.

[2]  Gerd Heber,et al.  Supporting Finite Element Analysis with a Relational Database Backend, Part I: There is Life beyond Files , 2007, ArXiv.

[3]  Paul Glasserman,et al.  Efficient Monte Carlo methods for value-at-risk , 2001 .

[4]  William Gropp,et al.  MPI on BlueGene/L: Designing an Efficient General Purpose Messaging Solution for a Large Cellular System , 2003, PVM/MPI.

[5]  Jan Mendling,et al.  Business Process Execution Language for Web Services , 2006, EMISA Forum.

[6]  José E. Moreira,et al.  An Overview Of The Bluegene/L System Software Organization , 2003, Parallel Process. Lett..

[7]  Shuji Tanaka,et al.  Monte Carlo grid for financial risk management , 2005, Future Gener. Comput. Syst..

[8]  José E. Moreira,et al.  An Overview of the Blue Gene/L System Software Organization , 2003, Euro-Par.

[9]  Philip Heidelberger,et al.  Early Experience with Scientific Applications on the Blue Gene/L Supercomputer , 2005, Euro-Par.

[10]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[11]  Fred G. Gustavson,et al.  Custom math functions for molecular dynamics , 2005, IBM J. Res. Dev..

[12]  Hans Werner Meuer,et al.  Top500 Supercomputer Sites , 1997 .

[13]  Kavitha Ranganathan,et al.  Evolving Toward the Perfect Schedule: Co-scheduling Job Assignments and Data Replication in Wide-Area Systems Using a Genetic Algorithm , 2005, JSSPP.

[14]  M. Crouhy,et al.  A comparative analysis of current credit risk models , 2000 .

[15]  Matjaz B. Juric,et al.  Business process execution language for web services , 2004 .

[16]  D. Duffie,et al.  An Overview of Value at Risk , 1997 .

[17]  Ajay K. Royyuru,et al.  Blue Gene: A vision for protein science using a petaflop supercomputer , 2001, IBM Syst. J..

[18]  Alex Rapaport,et al.  Mpi-2: extensions to the message-passing interface , 1997 .

[19]  Philip Heidelberger,et al.  Architecture and Performance of the BlueGene/L Message Layer , 2004, PVM/MPI.