Petascale IO Using The Adaptable IO System

ADIOS, the adaptable IO system, has demonstrated excellent scalability to 29,000 cores. With the introduction of the XT5 upgrades to Jaguar, new optimizations are required to successfully reach 140,000+ cores. This paper explains the techniques employed and shows the performance levels attained.

[1]  Karsten Schwan,et al.  Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS) , 2008, CLADE '08.

[2]  R. Samtaney,et al.  Grid -Based Parallel Data Streaming implemented for the Gyrokinetic Toroidal Code , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[3]  Lustre : A Scalable , High-Performance File System Cluster , 2003 .

[4]  Karsten Schwan,et al.  Adaptable, metadata rich IO methods for portable high performance IO , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[5]  Philip H. Carns,et al.  Using server-to-server communication in parallel file systems to simplify consistency and improve performance , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[6]  Karsten Schwan,et al.  LIVE data workspace: A flexible, dynamic and extensible platform for petascale applications , 2007, 2007 IEEE International Conference on Cluster Computing.

[7]  Wei-keng Liao,et al.  Scaling parallel I/O performance through I/O delegate and caching system , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[8]  Fang Zheng,et al.  Input/output APIs and data organization for high performance scientific computing , 2008, 2008 3rd Petascale Data Storage Workshop.